Skip to content
View umer-ateeq's full-sized avatar
3 followers · 20 following

Block or report umer-ateeq

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Pinned Loading

  1. GPT-Pretraining GPT-Pretraining Public

    A 134M-parameter GPT pretrained from scratch on FineWeb-Edu on one free-tier GPU, then audited: 4 bugs found in its own training run, every reported number shipped with the command that reproduces it.

    Jupyter Notebook 6 3

  2. Coding-Transformers-using-pytorch Coding-Transformers-using-pytorch Public

    Breaking down the Attention Is All You Need paper into clean, modular PyTorch code — making the Transformer architecture accessible to learners and researchers. Full Article: https://medium.com/@Um…

    Jupyter Notebook

  3. llm-expermients llm-expermients Public

    it is an experimental GPT Pre-training on a very small corpus of text of around 500M tokens!

    Python