Skip to content

fix(attention): map grouped decode heads to KV groups - #177

Open
taking-lying-flat wants to merge 1 commit into
FlashML-org:mainfrom
taking-lying-flat:fix/triton-decode-gqa-head-mapping
Open

fix(attention): map grouped decode heads to KV groups#177
taking-lying-flat wants to merge 1 commit into
FlashML-org:mainfrom
taking-lying-flat:fix/triton-decode-gqa-head-mapping

Commits

Commits on Aug 25, 2026