Commit 4d64f9b
docs(adr-0014): L>=2 padded decode confirms B>1,L=1 kernel bug — recall 0.125->1.0, 0.67x tps
Mac evidence (preset mlx-batched-pad-decode, 8 sessions): batched
per-session recall recovered to 1.0 (matches serialized bit-for-bit on
tok0 across all rows) by forcing length-2 decode forwards (qmm, avoids
the qmv L=1 B>1 quantized kernel). Throughput 0.67x serialized — the 2x
padding tax exceeds the batching gain at this scale, so it is a
correctness-recovery probe, not a shippable throughput path.
Co-authored-by: FluffyAIcode <FluffyAIcode@users.noreply.github.com>1 parent d11020e commit 4d64f9b
2 files changed
Lines changed: 47 additions & 0 deletions
File tree
- docs/adr
- results/research
Lines changed: 26 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
318 | 318 | | |
319 | 319 | | |
320 | 320 | | |
| 321 | + | |
| 322 | + | |
| 323 | + | |
| 324 | + | |
| 325 | + | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
| 333 | + | |
| 334 | + | |
| 335 | + | |
| 336 | + | |
| 337 | + | |
| 338 | + | |
| 339 | + | |
| 340 | + | |
| 341 | + | |
| 342 | + | |
| 343 | + | |
| 344 | + | |
| 345 | + | |
| 346 | + | |
321 | 347 | | |
322 | 348 | | |
323 | 349 | | |
| |||
Lines changed: 21 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
0 commit comments