【Task.31】feat(sft): add pair-aware DPO training - #257

Open

A-Words wants to merge 17 commits into

redai-studio:mainfrom

A-Words:feat/task-31-dpo

Commits on Aug 7, 2026

feat(sft): add pair-aware DPO training
A-Words
committed
8f99e09
fix(sft): enforce DPO reference integrity
A-Words
committed
46154cd
fix(sft): complete DPO delivery contract
A-Words
committed
f03aa5c

Commits on Aug 8, 2026

fix(sft): reject --ref-load for DPO objectives
A-Words
committed
2903493
refactor(sft): apply DPO P3 review cleanups
A-Words
committed
83016e0

Commits on Aug 9, 2026

fix(dpo): enforce RFC validation contracts
A-Words
committed
76352f2
fix(dpo): pin frozen reference snapshot
A-Words
committed
5b26ecb
fix(dpo): verify local reference metadata
A-Words
committed
cac9492
fix(dpo): verify reference file digests
A-Words
committed
1b9d595
fix(dpo): verify reference weight manifests
A-Words
committed
72d9f69
fix(dpo): avoid iterator device readbacks
A-Words
committed
6f21770

Commits on Aug 10, 2026

refactor(dpo): remove dead identity builder
A-Words
committed
0e8c334

Commits on Aug 11, 2026

chore(task31): merge upstream main into DPO
A-Words
committed
4f149d4
test(dpo): guard Megatron-only checkpoint import
A-Words
committed
0e0b059
test(sft): skip Megatron integration without backend
A-Words
committed
633d386

Commits on Aug 21, 2026

docs(dpo): link Task 31 evidence bundle
A-Words
committed
d1b80d1
chore: merge upstream main into DPO
A-Words
committed
3feb0fe