Rebase by qianlihuang · Pull Request #15 · jeejeelee/vllm

qianlihuang · 2026-05-25T09:05:18Z

Purpose

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.

Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com> Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

…llm-project#42716) Signed-off-by: weizhoublue <weizhou.lan@daocloud.io>

Signed-off-by: Qi Zhou <qizzzh@google.com>

Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>

Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

…ding from global config (vllm-project#42851) Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>

…ect#42810) Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>

Signed-off-by: Luka Govedič <luka.govedic@gmail.com>

…2) (vllm-project#42497) Signed-off-by: qianlihuang <yiliu.dong@qq.com> Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com> Co-authored-by: qianlihuang <yiliu.dong@qq.com>

Signed-off-by: Alec Flowers <aflowers@nvidia.com> Co-authored-by: OpenAI Codex <codex@openai.com>

Signed-off-by: JisoLya <523420504@qq.com> Signed-off-by: Soyaazz <523420504@qq.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

…ntization (vllm-project#42869) Signed-off-by: gaozihao-shy <gaozihao-shy@users.noreply.github.com> Signed-off-by: gaozihao <gaozihao3@huawei.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: TheDuyIT <nduy250299@gmail.com> Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai> Signed-off-by: dtnguyen <dtnguyen@nvidia.com> Co-authored-by: Jee Jee Li <jeejeelee@inferact.ai> Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

…ect#42242) Signed-off-by: Jee Jee Li <pandaleefree@gmail.com> Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Roger Wang <hey@rogerw.io>

…project#42311) Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>

…nd (vllm-project#42923) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

…2849) Signed-off-by: Xin Yang <xyangx@amazon.com>

Signed-off-by: wenjun.liu <wenjun.liu@intel.com> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

…m-project#42740) Signed-off-by: Tony Lin <tony.lin@intel.com> Co-authored-by: Li, Jiang <jiang1.li@intel.com>

Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>

Signed-off-by: jiang1.li <jiang1.li@intel.com>

Signed-off-by: Li, Tianmu <tianmu.li@intel.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

Signed-off-by: yuwenzho <yuwen.zhou@intel.com> Signed-off-by: Yuwen Zhou <yuwen.zhou@intel.com>

Signed-off-by: inisis <desmond.yao@buaa.edu.cn> Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

…llm-project#42945) Signed-off-by: Kfir Toledo <kfir.toledo@ibm.com>

…coding crash (vllm-project#41233) Signed-off-by: Roi Koren <roik@nvidia.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

…and_lora[1] in Intel GPU CI (vllm-project#42954) Signed-off-by: zengxian <xiangdong.zeng@intel.com>

…ject#42691) Signed-off-by: sfeng33 <4florafeng@gmail.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

…ct#43494) Signed-off-by: Dao Le <daole@inferact.ai> Signed-off-by: Dao Le <Dao007forever@gmail.com> Co-authored-by: Claude <noreply@anthropic.com>

Signed-off-by: Or Ozeri <oro@il.ibm.com>

…llm-project#43016) Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>

…3083) Signed-off-by: Banani Ghosh <bg2502@nyu.edu> Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com> Co-authored-by: Banani Ghosh <bg2502@nyu.edu>

Signed-off-by: Rotem Shavitt <rshavitt@gmail.com> Signed-off-by: Or Ozeri <oro@il.ibm.com> Co-authored-by: Or Ozeri <oro@il.ibm.com>

Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>

…project#42373) Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io>

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io> Signed-off-by: wang.yuqi <noooop@126.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

…root target (vllm-project#40275) Signed-off-by: TheDuyIT <nduy250299@gmail.com> Signed-off-by: dtnguyen <dtnguyen@nvidia.com> Co-authored-by: Claude <noreply@anthropic.com>

…ject#42296) Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>

…3568) Signed-off-by: esmeetu <jasonailu87@gmail.com>

Signed-off-by: Yihuki <wangbovbvb@gmail.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

* port code from 43276 Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com> * address copilot review comments Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com> * rm contiguous Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com> * fix comment Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com> --------- Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com>

Copilot

Copilot wasn't able to review this pull request because it exceeds the maximum number of files (300). Try reducing the number of changed files and requesting a review from Copilot again.

arpera and others added 30 commits May 16, 2026 14:55

[CI/Build] Bump flashinfer to v0.6.11.post2 (vllm-project#41711)

0867497

Signed-off-by: Artem Perevedentsev <aperevedents@nvidia.com> Co-authored-by: Vadim Gimpelson <156319763+vadiklyutiy@users.noreply.github.com>

Fix Weight loading for Qwen3.5-MTP and Qwen3-VL using runai_streamer (v…

a941892

…llm-project#42716) Signed-off-by: weizhoublue <weizhou.lan@daocloud.io>

Support bf16 for mamba ssm cache (vllm-project#41680)

504a26c

Signed-off-by: Qi Zhou <qizzzh@google.com>

[MRV2][XPU] add Model Runner V2 log (vllm-project#42710)

ff712f6

Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>

[XPU] fix weight scale shape (vllm-project#42725)

0fa8884

Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

Refactor: Pass num_labels explicitly to PoolerClassify instead of rea…

1c8e9c0

…ding from global config (vllm-project#42851) Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>

[ROCm] [Bugfix] Fix DeepSeek V4 Functionality and Accuracy (vllm-proj…

599e75f

…ect#42810) Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>

[torch.compile] Add patch for fullgraph compilation (vllm-project#42686)

966903e

Signed-off-by: Luka Govedič <luka.govedic@gmail.com>

[Perf] Wire silu_and_mul_per_block_quant into TritonFP8MoE (MiniMax-M…

03ddc1c

…2) (vllm-project#42497) Signed-off-by: qianlihuang <yiliu.dong@qq.com> Signed-off-by: Yiliu Dong <91178480+qianlihuang@users.noreply.github.com> Co-authored-by: qianlihuang <yiliu.dong@qq.com>

[CI] Add NIXL EP import canary (vllm-project#42567)

1072104

Signed-off-by: Alec Flowers <aflowers@nvidia.com> Co-authored-by: OpenAI Codex <codex@openai.com>

[MM][CG] Enable encoder Cudagraph for Step3VL (vllm-project#42224)

990f49b

Signed-off-by: JisoLya <523420504@qq.com> Signed-off-by: Soyaazz <523420504@qq.com>

[ROCm][CI] Stabilize ROCm pooling and multimodal CI (vllm-project#42909)

b50646e

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

[BugFix] Kimi-K2.5: skip vision tower dtype conversion when using qua…

23c15ac

…ntization (vllm-project#42869) Signed-off-by: gaozihao-shy <gaozihao-shy@users.noreply.github.com> Signed-off-by: gaozihao <gaozihao3@huawei.com>

Improve logging when docs build is skipped (vllm-project#42929)

c1f7854

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

[Model] [Perf] Use flatten for Qwen3.5's GDN output projection (vllm-…

5ab6d1b

…project#42311) Signed-off-by: Rishapveer Singh <singhrishapveer@gmail.com>

Revert checkpoint specific workaround in Transformers modelling backe…

9537542

…nd (vllm-project#42923) Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

[Perf] Add do_not_specialize in fused FP8 RoPE kernel (vllm-project#4…

998714b

…2849) Signed-off-by: Xin Yang <xyangx@amazon.com>

delete xpu ci (vllm-project#42582)

c38bed4

Signed-off-by: wenjun.liu <wenjun.liu@intel.com> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

[CPU] Specify required KV cache layout for CPU attention backend (vll…

965d076

…m-project#42740) Signed-off-by: Tony Lin <tony.lin@intel.com> Co-authored-by: Li, Jiang <jiang1.li@intel.com>

[Kernel] Pack topk id/weights triton kernel (vllm-project#42527)

2267f70

Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>

[CPU] Add fused GDN support for AMX CPU platform (vllm-project#42707)

b4601ad

Signed-off-by: jiang1.li <jiang1.li@intel.com>

[CPU Backend] Improve cpu thread utilization (vllm-project#42666)

cac81b6

Signed-off-by: Li, Tianmu <tianmu.li@intel.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

[CPU] Add MXFP4 W4A16 MoE support (vllm-project#41922)

88a860d

Signed-off-by: yuwenzho <yuwen.zhou@intel.com> Signed-off-by: Yuwen Zhou <yuwen.zhou@intel.com>

fix: remove unused norm for dpskv4 (vllm-project#41710)

df852ed

Signed-off-by: inisis <desmond.yao@buaa.edu.cn> Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

[Bugfix][KV Offload] count appended GPU blocks in store group_sizes (v…

e414e1f

…llm-project#42945) Signed-off-by: Kfir Toledo <kfir.toledo@ibm.com>

[Bugfix][Hybrid][NemotronH] Fix mamba_cache_mode=all + speculative de…

737bfa3

…coding crash (vllm-project#41233) Signed-off-by: Roi Koren <roik@nvidia.com>

[MRv2] Default to MRv1 when a connector is present (vllm-project#42955)

69c91d0

Signed-off-by: NickLucche <nlucches@redhat.com>

[XPU][CI] Temporarily skip test_moe_lora_align_block_size_mixed_base_…

2e40faf

…and_lora[1] in Intel GPU CI (vllm-project#42954) Signed-off-by: zengxian <xiangdong.zeng@intel.com>

mgoin and others added 25 commits May 23, 2026 14:21

Revert "[Misc] add humming to dependencies" (vllm-project#43492)

10d264a

[Bugfix] Fix reasoning dropped on streaming boundary deltas (vllm-pro…

b32fe41

…ject#42691) Signed-off-by: sfeng33 <4florafeng@gmail.com>

[Model Runner v2] Force v1 runner for tests (vllm-project#43233)

33d7cbe

Signed-off-by: yewentao256 <zhyanwentao@126.com>

[KV Connector] Keep MooncakeStore full hits block-aligned (vllm-proje…

0902d8e

…ct#43494) Signed-off-by: Dao Le <daole@inferact.ai> Signed-off-by: Dao Le <Dao007forever@gmail.com> Co-authored-by: Claude <noreply@anthropic.com>

[kv_offload]: Add DSv4 support (vllm-project#43142)

357fddf

Signed-off-by: Or Ozeri <oro@il.ibm.com>

[ROCm][CI] Stabilize 400 error return code for invalid schema inputs (v…

5940590

…llm-project#43016) Signed-off-by: Andreas Karatzas <akaratza@amd.com>

[ROCm] [DSv4] [Perf] Support DeepSeek v4 MTP (vllm-project#43385)

1806d1a

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>

Tuning script and configs for Triton Mamba SSU kernel (vllm-project#4…

d56285c

…3083) Signed-off-by: Banani Ghosh <bg2502@nyu.edu> Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com> Co-authored-by: Banani Ghosh <bg2502@nyu.edu>

File system secondary tier implemented in python (vllm-project#41735)

d0a100c

Signed-off-by: Rotem Shavitt <rshavitt@gmail.com> Signed-off-by: Or Ozeri <oro@il.ibm.com> Co-authored-by: Or Ozeri <oro@il.ibm.com>

[Kernel] Add mhc_pre_big_fuse_with_norm_tilelang (vllm-project#43474)

b06813e

Signed-off-by: Jee Jee Li <jeejeelee@inferact.ai>

fix: MoE model using shared routed experts crashes on AMD GPUs (vllm-…

6cbe448

…project#42373) Signed-off-by: weizhou.lan@daocloud.io <weizhou.lan@daocloud.io>

[Docs] Reorganize offline inference docs. (vllm-project#43552)

1b26fa3

Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io> Signed-off-by: wang.yuqi <noooop@126.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

[Docker] Non-root support for vllm-openai; add opt-in vllm-openai-non…

3df1c7c

…root target (vllm-project#40275) Signed-off-by: TheDuyIT <nduy250299@gmail.com> Signed-off-by: dtnguyen <dtnguyen@nvidia.com> Co-authored-by: Claude <noreply@anthropic.com>

[Feat][KVConnector] Support DSV4 in SimpleCPUOffloadBackend (vllm-pro…

81252d4

…ject#42296) Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>

[Doc] Add section on escalating stalled contributions (vllm-project#4…

0c942c6

…3568) Signed-off-by: esmeetu <jasonailu87@gmail.com>

Reduce memory usage for granite_speech. (vllm-project#42933)

5c1aec3

Signed-off-by: Yihuki <wangbovbvb@gmail.com> Co-authored-by: mergify[bot] <37929162+mergify[bot]@users.noreply.github.com>

Init

026c7f0

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Move

8ed3ef1

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Move

115946e

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Move

03854b2

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Move

7f0a790

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Move

b420431

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Fix comments

0614b52

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Enable PDL

3c42f56

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Copilot AI review requested due to automatic review settings May 25, 2026 09:05

qianlihuang requested a review from jeejeelee as a code owner May 25, 2026 09:05

Copilot AI reviewed May 25, 2026

View reviewed changes

qianlihuang changed the title ~~M2 gate function rebase dco~~ Rebase May 25, 2026

qianlihuang closed this May 25, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Rebase#15

Rebase#15
qianlihuang wants to merge 1601 commits into
jeejeelee:m2-gate-functionfrom
qianlihuang:m2-gate-function-rebase-dco

qianlihuang commented May 25, 2026 •

edited by github-actions Bot

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

Conversation

qianlihuang commented May 25, 2026 • edited by github-actions Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

20 participants

qianlihuang commented May 25, 2026 •

edited by github-actions Bot

Loading