Skip to content

feat: keep eplb for pure prefill and optimize remap and record - #1715

Merged
valarLip merged 2 commits into
ROCm:mainfrom
JiaoliangYu:jyu/eplb-standalone
Jul 28, 2026
Merged

feat: keep eplb for pure prefill and optimize remap and record#1715
valarLip merged 2 commits into
ROCm:mainfrom
JiaoliangYu:jyu/eplb-standalone

Conversation

@JiaoliangYu

@JiaoliangYu JiaoliangYu commented Jul 28, 2026

Copy link
Copy Markdown
Contributor

Motivation

  • Keep rebalance only during the prefill phase, step and loading count only for prefill
  • fused triton kernel for remap and record, 150+us -> ~20us

Technical Details

Test Plan

Test Result

Submission Checklist

@github-actions

Copy link
Copy Markdown
Contributor

🏷️ CI Guide

Runs automatically on every eligible PR before approval:

  • ✅ Pre Checkin: Black, Ruff, catalog schema validation, non-GPU unit tests

Heavy model tests:

  • ✅ Run after the PR is approved and Pre Checkin passes
  • ✅ Run immediately when an approval review is submitted
  • ✅ Can be requested before approval with labels
Label Tests
ci:full Run all heavy PR model tests: native ATOM, vLLM, and SGLang
ci:atom Run native ATOM model accuracy tests
ci:vllm Run ATOM vLLM OOT model accuracy tests
ci:sglang Run ATOM SGLang model accuracy tests

Heavy jobs are skipped when the PR is not approved and no matching ci:* label is present.
Add labels via the sidebar or gh pr edit 1715 --add-label <label>

@JiaoliangYu
JiaoliangYu force-pushed the jyu/eplb-standalone branch from a3200c4 to 07b31a9 Compare July 28, 2026 07:25
@JiaoliangYu
JiaoliangYu marked this pull request as ready for review July 28, 2026 07:25
@JiaoliangYu
JiaoliangYu force-pushed the jyu/eplb-standalone branch 4 times, most recently from 3d684c7 to 4928932 Compare July 28, 2026 08:17
@JiaoliangYu
JiaoliangYu force-pushed the jyu/eplb-standalone branch from a2e91cd to 719cb18 Compare July 28, 2026 09:35
@JiaoliangYu
JiaoliangYu force-pushed the jyu/eplb-standalone branch from b8ddd4c to 235b22d Compare July 28, 2026 10:43
@valarLip
valarLip merged commit 4a090c7 into ROCm:main Jul 28, 2026
44 of 72 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants