Skip to content

Segmented KV on Macs without tensor units (M1-M4): per-segment attention with a logsumexp merge - #630

Open
jvmenen wants to merge 37 commits into
youssofal:mainfrom
jvmenen:feat/segmented-kv-without-nax
Open

Segmented KV on Macs without tensor units (M1-M4): per-segment attention with a logsumexp merge#630
jvmenen wants to merge 37 commits into
youssofal:mainfrom
jvmenen:feat/segmented-kv-without-nax

Segmented KV lse decode route: round the merged output once, to the q…

4fb7480
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
scan
succeeded Oct 14, 2026 in 9s