Skip to content
View Tyler-Simas's full-sized avatar

Block or report Tyler-Simas

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. Rolling-Window-Normalization Rolling-Window-Normalization Public

    Companion code for a paper showing a statistically significant GPT-2 perplexity-S&P 500 correlation is spurious -- and how rolling-window normalization eliminates this correlation with no retraining.

    Python

  2. Thorngrad Thorngrad Public

    A NumPy-backed autograd engine with broadcasting-aware gradients, built from scratch as an extension of Karpathy's micrograd. Employs tensors instead of scalars, the use of optimizers, activations,…

    Python

  3. Transformer-From-Scratch Transformer-From-Scratch Public

    A full encoder-decoder Transformer (Vaswani et al. 2017) built from PyTorch primitives. Includes Pre-LN vs. Post-LN experiment on a sequence-reversal toy task.

    Python