Skip to content

chore(frontend): bump vllm rust crates to d3e2888c - #961

Merged
xiaguan merged 3 commits into
mainfrom
chore/bump-vllm-crates
Aug 25, 2026
Merged

xiaguan merged 3 commits into
mainfrom
chore/bump-vllm-crates

Conversation

@xiaguan

@xiaguan xiaguan commented Aug 25, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Bump the five pinned vLLM Rust crates from cc706b05 (2026-07-16) to d3e2888c (vllm main as of 2026-08-25).
  • Fill the EngineCore impersonation for upstream handshake / output / Config / PrefillStats field growth (same pattern as chore(frontend): bump vllm rust crates to cc706b05 #898's ec_transfer_params).
  • Mac pegainfer-sim A/B at 128-in / 64-out / 3200 prompts / c=320: 0-fail both sides; steady-state req/s 402 vs 401; TPOT p50 still the 12.11ms sim floor.

Dependency Update

Crate Previous revision New revision
vllm-chat cc706b05 d3e2888c
vllm-engine-core-client cc706b05 d3e2888c
vllm-server cc706b05 d3e2888c
vllm-text cc706b05 d3e2888c
vllm-tokenizer cc706b05 d3e2888c

Notable upstream: Kimi K3 rust frontend + tool/reasoning fixes, GLM-5.2 chat-template parity, MiniJinja 2.24, protocprotox, --max-model-len engine-owned, per-request spec-decode metrics.

Test plan

  • cargo test --release --locked -p pegainfer-frontend --lib — 65 passed
  • cargo test --release --locked -p pegainfer-sim --lib — 6 passed
  • cargo test --release --locked -p pegainfer-sim --test frontend_e2e — 13 passed
  • Mac sim vllm-bench A/B vs cc706b05 binary, same flags as above — 3200/0 both; steady-state throughput flat

xiaguan and others added 3 commits August 25, 2026 11:53
Keep the EngineCore impersonation compiling after six weeks of upstream handshake, output, and Config field growth.

Co-authored-by: Cursor <cursoragent@cursor.com>
Signed-off-by: susun <751080330@qq.com>
Drop the session notes from the crate-rev change.

Co-authored-by: Cursor <cursoragent@cursor.com>
Signed-off-by: susun <751080330@qq.com>
Signed-off-by: susun <751080330@qq.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Signed-off-by: susun <751080330@qq.com>
@xiaguan
xiaguan force-pushed the chore/bump-vllm-crates branch from ef4c233 to 459407d Compare August 25, 2026 03:53
@xiaguan
xiaguan merged commit 8125a35 into main Aug 25, 2026
17 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant