Popular repositories Loading

1. Experiment Experiment Public

2. TG-Shakespeare-GPT TG-Shakespeare-GPT Public

   This is an implementation of a transformer-based language model, trained on the Tiny Shakespeare Dataset

3. assignment1-basics assignment1-basics Public

   Forked from stanford-cs336/assignment1-basics

   Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch

   Python

4. alexnet alexnet Public

5. Persona-Lab Persona-Lab Public

   Python

6. Transformer_Memory_Optimization Transformer_Memory_Optimization Public

   This is a repo that aims to teach-by-doing the following memory optimization techniques: flash attention, MQA, GQA, Activation Checkpointing

   Python