Skip to content

Segmented KV cache: follow-up turns, forks and restores without copying the history (MTPLX_SEGMENTED_KV) - #610

Open
jvmenen wants to merge 38 commits into
youssofal:mainfrom
jvmenen:feat/segmented-kv
Open

jvmenen wants to merge 38 commits into
youssofal:mainfrom
jvmenen:feat/segmented-kv

Segmented KV spill: segment digests first, kept through merges, memo …

8270858
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 notice
scan
succeeded Oct 20, 2026 in 10s