Repository navigation

scheduler: tool-parameter markers from the served tokenizer (Nemotron tool calls cut at 1024 tokens) - #196

Merged

AzeezIsh merged 6 commits into

mainfrom

fix/tool-markers-per-tokenizer

Oct 27, 2026

Merged

scheduler: tool-parameter markers from the served tokenizer (Nemotron tool calls cut at 1024 tokens)#196
AzeezIsh merged 6 commits into
mainfrom
fix/tool-markers-per-tokenizer

Commits on Oct 18, 2026
- scheduler: resolve the tool-parameter marker ids from the served tokenizer (Nemotron large tool calls were cut at 1024 tokens)
  
  AzeezIsh
  and
  claude
  committed
  3ed23a1
- scheduler: rustfmt the tool-marker wiring
  
  AzeezIsh
  and
  claude
  committed
  217776c
- scheduler: tool markers default to the Qwen ids until a tokenizer installs its own; per-thread in tests
  
  AzeezIsh
  and
  claude
  committed
  b1a9621
- scheduler: tool-parameter markers are token classes from the vocabulary, not five ids
  
  AzeezIsh
  and
  claude
  committed
  d89c8b0
- scheduler: rustfmt the marker classes
  
  AzeezIsh
  and
  claude
  committed
  f69e599
Commits on Oct 19, 2026
- Merge remote-tracking branch 'origin/main' into fix/tool-markers-per-tokenizer
  AzeezIsh
  committed
  dfd3a80