[WIP] Connorli/fix func call for KimiK2.5#1070

Open

ConnorLi96 wants to merge 7 commits intomainfrom

connorli/fix-func-call-all

Commits on Apr 4, 2026

read engine metrics from PROMETHEUS_MULTIPROC_DIR in grpc mode

scottjlee
authored and
ConnorLi96
committed
lint and format

scottjlee
authored and
ConnorLi96
committed

Commits on Apr 7, 2026

fix(tool_parser): fix function call parsing for models with native tool-call tokens
ConnorLi96
committed

Commits on Apr 8, 2026

fix(gateway): comprehensive func call and response quality fixes
ConnorLi96
committed
fix(trtllm): add <|im_end|> stop string for TRT-LLM gRPC requests
ConnorLi96
committed
fix(tokenizer): load merged EOS token IDs from config.json + generation_config.json
ConnorLi96
committed

Commits on Apr 9, 2026

fix(metrics): guard against empty prometheus multiproc metrics output
ConnorLi96
committed