feat(maple): BF16 KV tier, q4k head, head overlays, and six measured default fixes - #670

Closed

nwoolmer wants to merge 21 commits into

feat/maple-bf16-kv

Commits on Aug 31, 2026

moe: barrier the top-k winner invalidation; it was emitting DUPLICATE experts

nwoolmer
and
claude
committed
e891c00
feat(kv): add a flat BF16 KV storage tier and its windowed attention kernels

nwoolmer
and
claude
committed
fb09ef2
feat(maple): make --kv-mode functional for arch 15, with a bf16 option

nwoolmer
and
claude
committed
3b43085
feat(maple): default the KV cache to bf16; q8 costs 39% of the divergence

nwoolmer
and
claude
committed
ed3a735
fix(maple): use the vendor chat template and sampling defaults

nwoolmer
and
claude
committed
ea2c8f7
feat(maple): default the lm_head to q8, and add an mq4v2 head option

nwoolmer
and
claude
committed
4f61c95
fix(maple): load qt=44 heads, and measure mq4v2 — q8 stays the default

nwoolmer
and
claude
committed
aea2664
refactor(maple): deprecate the mq4 head in favour of mq4v2; keep reading qt=30

nwoolmer
and
claude
committed
984dcae

Commits on Sep 1, 2026

feat(quant): add a q4k lm_head, and fix Q4_K's scale search

nwoolmer
and
claude
committed
fb245ef
fix(maple): derive flash_partials from the real tile size, not a hardcoded 128

nwoolmer
and
claude
committed
c0f69df
feat(maple): --head-only, emitting the lm_head as a load-time overlay

nwoolmer
and
claude
committed
e391519
feat(maple): --head selects a head overlay, without the REAP env var

nwoolmer
and
claude
committed
ae23212
feat(registry): ship maple head variants as overlays instead of full models

nwoolmer
and
claude
committed
2f60bd7
feat(cli): hipfire run --head, connecting head overlays end to end

nwoolmer
and
claude
committed
910a61e
fix(registry): a newer bundled registry wins, and edit the curated source

nwoolmer
and
claude
committed
c787187
fix(maple): preserve BF16 artifact semantics
Kaden-Schutt
committed
5d22e54
Merge origin/master into feat/maple-bf16-kv
Kaden-Schutt
committed
4813f27
chore: rerun CI after conflict metadata fix
Kaden-Schutt
committed
995eedf
Merge remote-tracking branch 'origin/master' into review-pr-670
Kaden-Schutt
committed
9d90364
test(redline): admit bf16 kv validation
Kaden-Schutt
committed
96cf1dc
Merge remote-tracking branch 'origin/master' into review-pr-670
Kaden-Schutt
committed
caf80a5