feat(p3o): add ESS-adaptive policy optimization - #234

Closed

DreamEnding wants to merge 45 commits into

redai-studio:mainfrom

DreamEnding:feature/p3o-adaptive-cap

Commits on Jul 30, 2026

feat(p3o): add adaptive policy optimization with optimizer-step ESS scope
DreamEnding
committed
59da44c
style(p3o): make docstrings docformatter-clean

DreamEnding
and
claude
committed
d11a9a6

Commits on Jul 31, 2026

Merge branch 'redai-infra:main' into feature/p3o-adaptive-cap
DreamEnding
authored
2dde131
feat(p3o): complete Task40 validation
DreamEnding
committed
90f73b7
Merge branch 'redai-infra:main' into feature/p3o-adaptive-cap
DreamEnding
authored
999b1f1
test(p3o): keep megatron-free P3O tests collectable in CI

DreamEnding
and
claude
committed
f40b980
test(p3o): resolve a usable POSIX bash for launch-script dry runs

DreamEnding
and
claude
committed
931df70
fix(p3o): align ESS pre-pass with train pass and remove hot-path syncs

DreamEnding
and
claude
committed
d597ac3
style: apply pre-commit formatting (end-of-file, docformatter)

DreamEnding
and
claude
committed
801abc7

Commits on Aug 1, 2026

feat(p3o): add staleness mismatch launch configs
DreamEnding
committed
8a306e4
feat(p3o): add fixed-lag rollout policy snapshots
DreamEnding
committed
0a659ba
feat(p3o): parameterize behavior temperature
DreamEnding
committed
7b07a40
feat(p3o): add rollout policy lag observability metrics

DreamEnding
and
claude
committed
c717ef1
feat(p3o): add schedule_plan support and extend test coverage

DreamEnding
and
claude
committed
fb2c61b
perf(p3o): keep adaptive cap on device
DreamEnding
committed
5b859b6
docs: enforce DreamEnding git identity
DreamEnding
committed
fc0860d
chore(p3o): fix observability pre-commit checks
DreamEnding
committed
071d0b9
chore: fix repository pre-commit checks
DreamEnding
committed
b5225db

Commits on Aug 3, 2026

feat(p3o): add reproducible validation matrix
DreamEnding
committed
b87b431
feat(p3o): implement P3O adaptive policy optimization algorithm
DreamEnding
committed
52b7841
feat(p3o): integrate P3O into Relax framework
DreamEnding
committed
3e75334
feat(p3o): add context parallel support and actor integration
DreamEnding
committed
b3828a5
feat(p3o): add rollout policy age observability
DreamEnding
committed
ed9f1ca
test(p3o): add comprehensive test suite
DreamEnding
committed
fbea291
feat(p3o): add experiment configurations and launch scripts
DreamEnding
committed
cde02ac
style(p3o): apply ruff formatting to meet line length requirements
DreamEnding
committed
603f9ef

Commits on Aug 4, 2026

fix(p3o): resolve correctness and launcher blockers
DreamEnding
committed
93bb8ea
fix(p3o): complete merge blocker coverage
DreamEnding
committed
f49262f
fix(p3o): address final audit findings
DreamEnding
committed
837ba29
Merge branch 'redai-infra:main' into feature/p3o-adaptive-cap
DreamEnding
authored
942ca60
fix(test): isolate P3O model import from CI stub
DreamEnding
committed
0f26580
fix(test): stub SGLang in P3O registry test
DreamEnding
committed
a3626a9
fix(test): isolate P3O CP world size stub
DreamEnding
committed
a0bd8ac

Commits on Aug 6, 2026

Commits on Aug 11, 2026

Commits on Aug 13, 2026

Merge remote-tracking branch 'upstream/main' into feature/p3o-adaptive-cap
DreamEnding
committed
da52d2d
fix(ci): isolate optional sglang dependency in tests
DreamEnding
committed
f590c01
fix(p3o): resolve P0 blocking issues for PR readiness

DreamEnding
and
claude
committed
883f963
fix(test): resolve NameError in test_p3o_arguments AST extraction
DreamEnding
committed
ba11b13
fix(p3o): align replay metadata and observability
DreamEnding
committed
4855040