[Feature] Add DAPO preset and Soft Overlong support - #362

Open

CalvinXKY wants to merge 7 commits into

vllm-project:mainfrom

CalvinXKY:feature/dapo-advantage-estimator

Commits on Jul 22, 2026

Add DAPO advantage estimator and Soft Overlong support.
CalvinXKY
committed
a2a332a
Validate rollout-max-response-len for Soft Overlong.
CalvinXKY
committed
af2cb5e
Validate soft-overlong-cache against rollout-max-response-len.
CalvinXKY
committed
e0c3fb9

Commits on Jul 23, 2026

Clarify DAPO token-level loss and Soft Overlong docs.
CalvinXKY
committed
98b3b99

Commits on Aug 4, 2026

Merge branch 'main' of https://github.com/vllm-project/vime into feature/dapo-advantage-estimator
CalvinXKY
committed
935a40f

Commits on Aug 24, 2026

Merge branch 'main' of https://github.com/vllm-project/vime into feature/dapo-advantage-estimator
CalvinXKY
committed
d8b3673

Commits on Aug 28, 2026

refactor: reduce DAPO to a GRPO preset
aoshen02
committed
0851942