forked from ggml-org/llama.cpp
-
Notifications
You must be signed in to change notification settings - Fork 44
Pull requests: unslothai/llama.cpp
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
rpc: do not abort on shutdown when a teardown round trip fails
#203
opened Sep 6, 2026 by
danielhanchen
Member
Loading…
server: do not abort a completion when the model emits invalid UTF-8
#202
opened Sep 6, 2026 by
danielhanchen
Member
Loading…
server: reuse checkpoint state buffers from a bounded pool
#201
opened Sep 6, 2026 by
danielhanchen
Member
•
Draft
server: remove two host side stalls in the decode loop at high concurrency
#200
opened Sep 6, 2026 by
danielhanchen
Member
•
Draft
rpc: cut the protocol cost of uploading weights to a remote server
#199
opened Sep 6, 2026 by
danielhanchen
Member
•
Draft
CUDA: MMQ tile configuration and FP4 accumulation for GB10 (sm_121)
#198
opened Sep 6, 2026 by
danielhanchen
Member
•
Draft
server: preemption notices, asynchronous parks and exact concurrency together
#197
opened Sep 6, 2026 by
danielhanchen
Member
•
Draft
rpc: direct server-to-server tensor transfer for a layer split
#196
opened Sep 6, 2026 by
danielhanchen
Member
•
Draft
convert: support compressed-tensors mixed-precision NVFP4 checkpoints
#195
opened Sep 6, 2026 by
danielhanchen
Member
•
Draft
cuda: opt-in exact concurrency, byte-identical output regardless of neighbours or parks
#194
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
rpc: one tensor read per decode step and asynchronous split copies
#193
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
server: take the park and restore copies off the decode loop
#192
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
trace: event tracer for the RPC backend, rpc-server and llama-server
#191
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
server: tell a streaming client when its slot is parked and restored
#190
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
server: priority-aware preemption with an explicit slot park and unpark API
#189
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
server: park unified requests with proactive KV watermarks
#188
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
server: --pipeline-groups, run the slots over several contexts of one model
#187
opened Sep 5, 2026 by
danielhanchen
Member
Loading…
server: one preemption path, swap under --preempt-ram and recompute above it
#186
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
server: KV preemption by recompute, a zero host RAM alternative to #184
#185
opened Sep 5, 2026 by
danielhanchen
Member
•
Draft
server: preempt a slot instead of ending every conversation when the KV pool fills
#184
opened Sep 5, 2026 by
danielhanchen
Member
Loading…
server: on a full KV cache, terminate one slot instead of every slot
#183
opened Sep 4, 2026 by
danielhanchen
Member
Loading…
server: shift the speculative batch indices on the sub-batch retry
#182
opened Sep 4, 2026 by
danielhanchen
Member
Loading…
mtmd: test that every projector is registered and uniquely named
#176
opened Sep 3, 2026 by
danielhanchen
Member
Loading…
--load-mode none/mlock silently ignored for large lazy tensors (undocumented --lazy-mode override)
#169
opened Sep 2, 2026 by
dan64
Loading…
qwen4exp: gather-based sparse attention for QSA decode (+ cuda top-k batching fix)
#165
opened Aug 31, 2026 by
abdel-darwish-27
Loading…
Previous Next
ProTip!
Updated in the last three days: updated:>2026-09-04.