Repository navigation

serve: --reference-mode — client sampling + model's own template, nothing else (MLPerf Endpoints) - #161

Closed

AzeezIsh wants to merge 6 commits into

mainfrom

feat/reference-sampling

Closed

serve: --reference-mode — client sampling + model's own template, nothing else (MLPerf Endpoints)#161
AzeezIsh wants to merge 6 commits into
mainfrom
feat/reference-sampling

Commits on Oct 3, 2026
- serve: --reference-mode — client sampling and the model's own template, nothing else
  
  AzeezIsh
  and
  claude
  committed
  02f43fa
- reference-mode: also gate the stream-side cuts; log every guard stop
  
  AzeezIsh
  and
  claude
  committed
  8fa4ed8
- cuda backend: name the kernel in a launch-failure error
  
  AzeezIsh
  and
  claude
  committed
  a31fcad
Commits on Oct 14, 2026
- Merge main into feat/reference-sampling
  AzeezIsh
  committed
  aad13bf
- cargo fmt
  AzeezIsh
  committed
  6613805
- ci: stub cuFuncGetName for the no-GPU link
  AzeezIsh
  committed
  22ab89e