what_is_a_transformer

Series of studies about deep learning, machine learning and statistics. So far includes micrograd and makemore from Karparthy, and code GPT-2 from scratch by Neel Nanda. Check the Journal.md to see the studies diary.

Name		Name	Last commit message	Last commit date
papers		papers
.gitignore		.gitignore
README.md		README.md
journal.md		journal.md
makemore_part1.ipynb		makemore_part1.ipynb
makemore_part2.ipynb		makemore_part2.ipynb
makemore_part3.ipynb		makemore_part3.ipynb
makemore_part4.ipynb		makemore_part4.ipynb
makemore_part5.ipynb		makemore_part5.ipynb
makemore_part6.ipynb		makemore_part6.ipynb
micrograd_from_scratch.ipynb		micrograd_from_scratch.ipynb
my_mnist.ipynb		my_mnist.ipynb
my_transformer.ipynb		my_transformer.ipynb
scratch.ipynb		scratch.ipynb

Navigation Menu

Repository navigation

About

Repository files navigation

what_is_a_transformer

About

Releases

Packages

Contributors

Languages

Latest commit

History

Folders and files

Repository files navigation

what_is_a_transformer

About

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages