Skip to content

Enable DeepSeek-V3 Wide-EP disaggregated inference + fix DP=32 correctness - #181

Open
raviguptaamd wants to merge 6 commits into
ROCm:developfrom
raviguptaamd:dsv3-wideep-disagg-enablement
Open

Enable DeepSeek-V3 Wide-EP disaggregated inference + fix DP=32 correctness#181
raviguptaamd wants to merge 6 commits into
ROCm:developfrom
raviguptaamd:dsv3-wideep-disagg-enablement

vllm_dissag: default prefill MoRI backend to low_latency at EP>=32

a5f074f
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs