Commit 5efa19d
docs(adr-0015): vLLM prefill techniques through the Kakeya lens (adopt/wrap/drop)
Record the precise stance: chunked prefill = our native chunked restoration
(adopt, reinterpreted); FlashAttention = a kernel we wrap (table stakes); paged
KV = structurally NOT needed (paging manages a growing full KV that a
Kakeya-native on-demand-restoration engine never holds). The engine needs
chunked restoration + wrapped flash + native bounded-KV mgmt, not PagedAttention
- the concrete sense in which it replaces vLLM's design rather than extending it.
Co-authored-by: FluffyAIcode <FluffyAIcode@users.noreply.github.com>1 parent 9420e49 commit 5efa19d
1 file changed
Lines changed: 17 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
49 | 66 | | |
50 | 67 | | |
51 | 68 | | |
| |||
0 commit comments