All pull requests

Pull requests

• feat(sampling): add repetition penalty, dynamic depth temperature, and CLI arguments

  #62·cs-ai-li opened Sep 25, 2026·

  ·
  1

• Implement Wavefront Chunked Prefill Batching(WCPP)

  #60·LyxWxj opened Sep 24, 2026·

  ·
  2

• Add opt-in single-fallback proposals for greedy speculation

  #59·prettygirlisnotme opened Sep 24, 2026·

  ·

• bench: add adaptive-exit options and depth statistics to the GSM8K ha…

  #58·MinhaoLi0318 opened Sep 24, 2026·

  ·

• [REFACT] [M4 1/N] Document KV cache ownership and add public allocation views

  #57·BuckMulligan99 opened Sep 24, 2026·

  ·

• Support speculative scheduling, preemption, and KV migration

  #52·0z5a opened Sep 24, 2026·

  ·

• Remove per-candidate and metadata host syncs from speculative decoding

  #51·IDEA-V opened Sep 24, 2026·

  ·

• [M3] Keep preemption queue transitions in Scheduler

  #50·YzXiao101 opened Sep 23, 2026·

  ·

• Capture fixed-depth speculative decode with CUDA Graphs

  #48·0z5a opened Sep 23, 2026·

  ·

• [BENCH] Evaluate synchronous self-speculation on H800

  #47·Levius-Fubuki opened Sep 23, 2026·

  ·
  1

• [M8 1/3] Extract attention backend and metadata contracts

  #46·Levius-Fubuki opened Sep 23, 2026·

  ·

• [REFACT] [M7 1/3] Extract the sampling module and pin request-local RNG behavior

  #45·ycjcx123 opened Sep 23, 2026·

  ·
  2

• [chore] Align package and project names with vllm-rlt

  #36·hsliuustc0106 opened Sep 22, 2026Collaborator·

  ·

• feat: reuse eager Ouro decode buffers with BF16 storage

  #29·hsliuustc0106 opened Sep 13, 2026Collaborator·

  ·

• docs: add repository-scoped vllm-lt contribution skill

  #28·hsliuustc0106 opened Sep 13, 2026Collaborator·

  ·

• feat: support inactive Ouro recurrent rows

  #27·hsliuustc0106 opened Sep 13, 2026Collaborator·

  ·
  2

• docs: move M5 assessment out of the source tree

  #19·hsliuustc0106 opened Sep 11, 2026Collaborator·

  ·
  1

• Add a bounded FP32 Ouro quality baseline (Q2)

  #18·hsliuustc0106 opened Sep 11, 2026Collaborator·

  ·
  2

• feat: add cached Ouro reference adapter

  #17·hsliuustc0106 opened Sep 11, 2026Collaborator·

  ·
  3

• Evaluate a 64-token Ouro attention tile against M4 guardrails

  #16·hsliuustc0106 opened Sep 11, 2026Collaborator·

  ·
  1

• feat: capture bounded Ouro recurrent CUDA graphs

  #15·hsliuustc0106 opened Sep 10, 2026Collaborator·

  ·
  6

• feat: reuse eager Ouro decode buffers

  #14·hsliuustc0106 opened Sep 10, 2026Collaborator·

  ·
  2