Skip to content
BranchesTags

Latest commit

 

History

13 Commits

Folders and files

NameName
Last commit message
Last commit date
08_saving-and-loading
08_saving-and-loading
 
 
.gitignore
.gitignore
 
 
00_pytorch-vit-random-init.py
00_pytorch-vit-random-init.py
 
 
01_pytorch-vit.py
01_pytorch-vit.py
 
 
02_pytorch-vit-compile.py
02_pytorch-vit-compile.py
 
 
03_fabric-vit.py
03_fabric-vit.py
 
 
04_fabric-vit-mixed-precision.py
04_fabric-vit-mixed-precision.py
 
 
05_fabric-vit-mixed-ddp.py
05_fabric-vit-mixed-ddp.py
 
 
06_fabric-vit-mixed-fsdp.py
06_fabric-vit-mixed-fsdp.py
 
 
07_fabric-vit-mixed-fsdp-with-scheduler.py
07_fabric-vit-mixed-fsdp-with-scheduler.py
 
 
LICENSE.txt
LICENSE.txt
 
 
README.md
README.md
 
 
cvpr-talk__slides.pdf
cvpr-talk__slides.pdf
 
 
local_utilities.py
local_utilities.py
 
 
logs.md
logs.md
 
 
requirements.txt
requirements.txt
 
 

Repository files navigation

Experiments for CVPR 2023 Talk

Scaling PyTorch Model Training With Minimal Code Changes

In this short tutorial, Sebastian I'll show you how to accelerate the training of LLMs and Vision Transformers with minimal code changes using open-source libraries.

About

No description, website, or topics provided.

Resources

Readme
Apache-2.0 license
Activity

Stars

130 stars

Watchers

3 watching

Forks

13 forks
Report repository

Releases

Packages

Used by

Contributors

Languages