debug(mac): root-cause MLX batched-recall break — upstream mlx_lm gemma-4 batch>1 decode bug (RotatingKVCache ruled out) - #133

Merged

cursor[bot] merged 4 commits into

mainfrom

AgentMemory/mac-batched-mlx-fix-2815

Jun 14, 2026

Commits on Jun 14, 2026

diag(mac): per-row batched-vs-serialized first-token logging + short-prompt preset (isolate RotatingKVCache rotation-under-batch)

cursoragent
and
FluffyAIcode
committed
9bcf99e
diag: haystack 15 (>=10 min, < sliding window) for short-prompt no-rotation diagnostic

cursoragent
and
FluffyAIcode
committed
1fe38a5
fix(mac): --kakeya-cache mode — concat-based SinkWindowKVCache (S5) for batched decode, sidestepping mlx_lm in-place buffer batch>1 bug

cursoragent
and
FluffyAIcode
committed
d0cd21f
docs(adr0014): root-cause Mac batched-recall break — ruled out RotatingKVCache/rotation + cache type; it's an upstream mlx_lm gemma-4 batch>1 decode bug (prefill correct, decode diverges, cache-ind…

cursoragent
and
FluffyAIcode
committed
711ae16