Skip to content

Add fp8 KV-cache quantization (--kv-dtype) - #126

Open
mkornreich wants to merge 1 commit into
FlashML-org:mainfrom
mkornreich:add-fp8-kv-cache
Open

Add fp8 KV-cache quantization (--kv-dtype)#126
mkornreich wants to merge 1 commit into
FlashML-org:mainfrom
mkornreich:add-fp8-kv-cache

Commits

Commits on Aug 24, 2026