docs(scheduler): spike recompute preemption parity

.agents/coordination.md

@@ -132,6 +132,21 @@ leaves. Owns only NEW `.agents/specs/cli-chat-complete.md`, the
 fixture, or GPU/model-download change; verification is the CPU record/doc
 checker suite. The row and open-PR list were unclaimed at selection time.
 
+**Scheduler recompute-preemption anchor-backfill spike (`ENG-PREEMPT-RECOMPUTE`,
+2026-08-01, `CLAIM-ENG-PREEMPT-RECOMPUTE-SPIKE`).** Codex (GPT-5), isolated
+worktree `/home/mudler/.cache/codex-vllm-cpp-eng-preempt-spike`, branch
+`codex/eng-preempt-recompute-spike`, base `upstream/main` `1448e981`. CPU-only
+records/spec pass: inventory pinned-vLLM recompute-preemption dispatch,
+request-state/KV lifecycle, matching upstream tests, exact local anchors, and a
+row-sized follow-on breakdown for the already-shipped bounded implementation.
+Owns only NEW `.agents/specs/preemption.md`, the `ENG-PREEMPT-RECOMPUTE` row,
+this claim, the matching roadmap/status/benchmark current-state cells,
+`.agents/parity-ledger.md`, and append-only `.agents/state.md`. No source,
+header, build, test, fixture, model, kernel, README, lifecycle support claim,
+or benchmark number changes. Verification uses the scheduler/request-queue CPU
+tests when build tooling permits and all record/document checkers; no GPU,
+model, download, compiler installation, or external execution host is needed.
+
 **Canonical DONE-owner reachability repair (`KV-PREFIX-CACHE`,
 `SAMPLE-LOGPROBS`, `SPEC-DFLASH`,
 `MODEL-SPEC-qwen3-dflash-dflash-qwen3-for-causal-lm`,
@@ -1328,6 +1343,7 @@ table, tests, CMake. Details in the state-log entry of the same date.
 | Claim | Row IDs | Agent | Worktree / remote dir | Branch | Owned scope | State | Last update |
 |---|---|---|---|---|---|---|---|
 | `CLAIM-SERVE-CLI-CHAT-SPIKE` | `SERVE-CLI-CHAT` (`INVENTORIED` -> `SPIKE`) | Codex (GPT-5) | isolated worktree `/home/mudler/.cache/sdd/localai-org-maint-bot-vllm.cpp/codex-serve-cli-chat-spike`; CPU-only records/spec, no GPU/model/download | branch `codex/serve-cli-chat-spike`, base `upstream/main` `1448e981` | Owns only NEW `.agents/specs/cli-chat-complete.md`; the `SERVE-CLI-CHAT` engine-matrix row and rollup; matching feature-matrix, porting-inventory, roadmap, STATUS, BENCHMARKS, coordination, ledger, and append-only state entries. No source/header/CMake/test/README/model/kernel/fixture edits. | `SPIKE` | 2026-08-01 - pinned-source inventory corrected: vLLM does ship remote `chat`/`complete`; accepted dual-mode design preserves the existing local invocation. CPU record/doc checker suite is the closing gate. |
+| `CLAIM-ENG-PREEMPT-RECOMPUTE-SPIKE` | `ENG-PREEMPT-RECOMPUTE` (`ANCHOR-BACKFILL` -> `SPIKE`) | Codex (GPT-5) | isolated worktree `/home/mudler/.cache/codex-vllm-cpp-eng-preempt-spike`; CPU-only records/spec, no GPU/model/download/compiler install | branch `codex/eng-preempt-recompute-spike`, base `upstream/main` `1448e981` | Owns NEW `.agents/specs/preemption.md`, the `ENG-PREEMPT-RECOMPUTE` row, this claim, roadmap/status/benchmark checkpoint text, parity-ledger and append-only state. No executable or README changes. | `SPIKE` | 2026-08-01 - pinned-source audit and W1-W4 contract written; agent-record and document checkers plus mutation suites pass. |
 | `CLAIM-LAGUNA-W1W2` | `MODEL-TEXT-laguna-laguna-for-causal-lm` (INVENTORIED→ACTIVE) | Claude Code (opus-4-8) | isolated worktree `.claude/worktrees/wf_2ae79b7a-246-1`; CPU-only `build-cpu` (`-DVLLM_CPP_CUDA=OFF` Release `-Werror`); NO GPU, NO 73 GB download — structural bring-up + oracle DECISION only | branch `spike/laguna-s21-w1w2`, base `main` `5c3da2f1` | Laguna-S-2.1 W1 oracle-decision + W2 structural bring-up. Owns ONLY: NEW `include/vllm/model_executor/models/laguna.h`, NEW `src/vllm/model_executor/models/{laguna_registry,laguna_weights,laguna}.cpp`, NEW `tests/vllm/models/test_laguna_scaffold.cpp`, NEW `.agents/specs/laguna-s21-w1w2-2026-07-30.md`, its two CMake registration lines (`CMakeLists.txt` source list + `tests/CMakeLists.txt`), the `LagunaForCausalLM` sorted-set + error-message insert in `tests/vllm/models/test_model_registry.cpp`, the `MODEL-TEXT-laguna-laguna-for-causal-lm` row (INVENTORIED→ACTIVE) + checklist rollup (ACTIVE 23→24 / INVENTORIED 285→284, engaged 42→43), and the record surfaces (this claim, roadmap breadth, docs/STATUS, docs/BENCHMARKS, parity-ledger, state). **NON-COLLISION:** additive TU + one REGISTER line ⇒ ZERO edit to any shared array; the forward is a `VT_CHECK(false)` W3 stub so no production path changes; MUST NOT touch README, Metal/SACRED/apex/darwin, or any other model/kernel source. | `DONE` | 2026-07-30 — **W1 oracle-decision + W2 structural bring-up LANDED (foreground, NOT pushed).** Registry (`laguna`/`LagunaForCausalLM`) + `ParseLagunaParams` (nested dual-rope + variable Q-head + ungrouped sigmoid-noaux MoE) + GGUF `blk.N.*` name-map + UD-Q4_K_XL quant-mix (ZERO new decode kernel) + KV-cache spec + per-layer forward-composition scaffold with reuse citations. `test_laguna_scaffold` 3/3·40 + `test_model_registry` 24/24; CPU full-library `-Werror` clean; record checkers rc=0. RESIDUALS (W3/W4): device materialization + real forward + the 3 new ops + strict dual-oracle gate on a fetched checkpoint. **SUPERSEDED by `CLAIM-LAGUNA-W3` (2026-07-31) which landed the real forward + the 3 new ops.** |
 | `CLAIM-LAGUNA-W3` | `MODEL-TEXT-laguna-laguna-for-causal-lm` (stays `ACTIVE`; W3 real forward + the 3 new ops landed; real-model dual-oracle gate still PENDING W4) | Claude Code (opus-4-8) | isolated worktree `.claude/worktrees/wf_43e61a78-0e2-1`; CPU-only `build-cpu` (`-DVLLM_CPP_CUDA=OFF` Release `-Werror`); NO GPU, NO 73 GB download — real forward CODE + unit gates only | branch `laguna-s21-w3`, base `main` `f2e463d5` (confirmed via `git rev-parse HEAD`) | Laguna-S-2.1 W3 — turn the W1/W2 `VT_CHECK(false)` forward stub into a REAL runnable host-reference composition + land the 3 genuinely-NEW small host ops. Owns ONLY: NEW `include/vllm/model_executor/models/laguna_ops.h` + `src/vllm/model_executor/models/laguna_ops.cpp` (softplus head-gate + ungrouped sigmoid-noaux router + dual per-layer RoPE cos/sin builders), the rewritten `src/vllm/model_executor/models/laguna.cpp` (`LagunaModel::Forward` real composition), the `LagunaParams` per-layer variable-Q-head helpers in `include/vllm/model_executor/models/laguna.h`, the new-op + forward unit cases appended to `tests/vllm/models/test_laguna_scaffold.cpp`, the `laguna_ops.cpp` line in `CMakeLists.txt`, NEW `.agents/specs/laguna-s21-w3-2026-07-31.md`, the `MODEL-TEXT-laguna-laguna-for-causal-lm` row cells + this claim, and docs/STATUS + docs/BENCHMARKS pointers. **NON-COLLISION:** file-disjoint from the concurrent MLA-fold lane (`mla_attention.cpp`/`deepseek_v2.cpp` untouched); additive `laguna_ops` TU + one CMake line; the loaders still `VT_CHECK(false)` so NO production/device path changes; MUST NOT touch README, Metal/SACRED/apex/darwin, or any other model/kernel source. | `ACTIVE` | 2026-07-31 — **W3 REAL forward + 3 new ops LANDED + UNIT-GATED (foreground, NOT pushed).** `laguna_ops.cpp`: `LagunaSoftplusHeadGate` (per-head softplus out-gate), `LagunaUngroupedRouterTopK` (sigmoid noaux_tc MINUS the group step + tie-break razor: lower index on equal choice, UNBIASED weights, renorm, routed_scaling), `BuildLaguna{FullYarn,Sliding}CosSin` (dual per-layer RoPE, reusing the pinned `compute_yarn_inv_freq` over the partial-64 dims). `LagunaModel::Forward` is now a REAL runnable f32 host-reference composition (variable-Q-head GQA + dual RoPE + sliding-window mask + softplus gate + dense L0 / ungrouped-MoE L1..47 + untied lm_head). `test_laguna_scaffold` **8/8·166** (softplus math; router selection + tie-break RED-first; dual-RoPE cos/sin bit-match vs hand ref; variable-Q-head shapes; forward composition on synthetic weights — RUNS, deterministic, gather==full-row, softplus gate wired) + `test_model_registry` 24/24; CPU full-library `-DVLLM_CPP_CUDA=OFF` `-Werror` clean; all record checkers rc=0. **HONEST residual (DEFERRED W4, needs the 73 GB checkpoint):** GGUF keep-quant tower materialization (loaders still LOUDLY throw) + device/paged production forward (runner variable-Q-head device wiring) + the strict dual-oracle greedy gate (llama.cpp-Q4_K token-exact + vLLM-NVFP4 near-tie). Risks: dual-RoPE numerics vs the fork on the real config; the reference forward is f32 whole-sequence (bf16 paged token-exactness is a W4 boundary); router tie-break vs the oracle's actual greedy selection. Row stays `ACTIVE`. |
 | `CLAIM-LAGUNA-W4` | `MODEL-TEXT-laguna-laguna-for-causal-lm` (stays `ACTIVE`; checkpoint fetched + fidelity corrected; real-model greedy gate is the W5 close) | Claude Code (opus-4-8) | isolated worktree `.claude/worktrees/wf_63140a7b-03e-1`; DGX `dgx.casa` GB10 for the 73.4 GiB fetch + GGUF metadata read + llama.cpp oracle build (foreground); CPU-verified fidelity corrections; NOT pushed | branch `worktree-wf_63140a7b-03e-1`, base `main` `570510a9` | Laguna-S-2.1 W4 — FETCH the UD-Q4_K_XL GGUF, read its metadata + tensor map AUTHORITATIVELY, and correct the fidelity errors the W1-W3 scaffold made from config.json guesses. Owns ONLY: `laguna.h`/`laguna_ops.{h,cpp}`/`laguna.cpp`/`laguna_weights.cpp` (QK-RMSNorm + `LagunaYarnMscale` + separate gate/up + verified name-map/quant-mix), the `test_laguna_scaffold.cpp` cases for those, NEW `.agents/specs/laguna-s21-w4-2026-07-31.md`, the `MODEL-TEXT-laguna-laguna-for-causal-lm` row cells + this claim, docs/STATUS + docs/BENCHMARKS pointers. **NON-COLLISION:** laguna-only additive edits; loaders still throw the keep-quant residual so NO production/device path changes; MUST NOT touch README, Metal/SACRED/apex/darwin, or any other model/kernel source. | `ACTIVE` | 2026-07-31 — **Checkpoint FETCHED + arch grounded in REAL bytes + 3 fidelity bugs fixed.** UD-Q4_K_XL GGUF (73.4 GiB, 3 shards, 814 tensors) fetched to dgx; metadata read authoritatively (arch `laguna`, `expert_gating_func=2` sigmoid, `expert_weights_scale=2.5`, `leading_dense_block_count=1`, rope factor 32/yarn_attn_factor 1.0, per-layer head_count `[48,72,72,72]`, quant mix: attn Q8_0 / experts gate-up Q4_K + down Q5_K / shared Q8_0 / router+norms F32). Fixed: (a) per-head QK-RMSNorm `attn_q/k_norm` (scope MISSED it — no config flag), (b) dual-RoPE mscale via llama.cpp `yarn_attn_factor·(1+0.1·ln(factor))` off GGUF factor 32 (not HF 128/1.4852), (c) SEPARATE `ffn_gate/up_exps`. Oracle = `poolsideai/llama.cpp@laguna` (mainline b10087+) same-quant; no vLLM-GGUF path for `laguna`. **HONEST residual (W5 close, needs the resident 73 GB run):** keep-quant tower materialization (`Mw`/`Sew` mirror of ds4) + host-orchestrated `ForwardGguf` (vt::MatmulBT/GemmRowSlice) + dual-RoPE inv_freq ramp bit-match + the real greedy run vs the llama.cpp same-quant oracle (token-exact or characterized near-tie). Row stays `ACTIVE`. |