Name		Name	Last commit message	Last commit date
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
deploy-llama-2-13b-chat-inferentia-2-lmi.ipynb		deploy-llama-2-13b-chat-inferentia-2-lmi.ipynb
deploy-tinyllama-inferentia-2-lmi.ipynb		deploy-tinyllama-inferentia-2-lmi.ipynb

Repository files navigation

inferentia-deployments

About

Deploy Large Models on AWS Inferentia (Inf2) instances.

aws aws-inferentia inf2 inferentia inferentia-2 large-language-model large-model large-model-inference llm lmi

0 stars

1 watching

Report repository

Releases

Packages

Contributors

Languages