Skip to content
BangBOOMPublic
forked from cafaxo/Llama2.jl

About

one file version llama2 inference in julia

Resources

Stars

0 stars

Watchers

0 watching

Forks

 
 

Latest commit

 

History

6 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 
 
 

Repository files navigation

Llama2 JL

This is a one file version of Llama2.jl and also a julia version of Llama2.c

Features

  • support Llama2-7B
  • support Mmap

How to use

You need to download original Llama2 model, then use the method from Llama2.c to convert it to a llama2-7b.bin file.

julia run.jl

About

one file version llama2 inference in julia

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages