feature(pu): add on_policy_distillation#43

Merged

puyuan1996 merged 19 commits intomainfrom

dev-onpolicy-distillation

Apr 17, 2026

Commits on Feb 10, 2026

feature(pu): add init version of on_policy_distillation
puyuan1996
committed

Commits on Mar 16, 2026

Commits on Mar 17, 2026

Commits on Mar 19, 2026

Commits on Mar 20, 2026

fix(pu): polish norm_adv_cross_batch, fix teacher_logprob
puyuan1996
committed

Commits on Apr 3, 2026

fix(pu): fix pad-token bug in _fetch_teacher_logprobs, fix aligned_teacher_lp, not use adv_norm in opd pure mode
puyuan1996
committed

Commits on Apr 17, 2026