investigating-bugs eval baseline + behavior-decomposition framing for evaluating-skills - #264

Merged

slowdini merged 15 commits into

devfrom

docs/evaluating-skills-behavior-ablation

Jul 29, 2026

Commits on Jul 28, 2026

docs(evaluating-skills): teach engineering an attractive failure

slowdini
and
claude
committed
3ff7054
test(investigating-bugs): rebuild the eval suite around a baited trap

slowdini
and
claude
committed
671de6d
test(investigating-bugs): let eval dispatches actually run commands

slowdini
and
claude
committed
1e2f02e
test(investigating-bugs): fix rubric technique-bias, add durable-verification case

slowdini
and
claude
committed
a0b496f
test(investigating-bugs): stop handing the agent the test convention

slowdini
and
claude
committed
67dcfdc
test(investigating-bugs): pre-register the n=10 Haiku run

slowdini
and
claude
committed
2b486f2
test(investigating-bugs): record the n=10 run's model deviation

slowdini
and
claude
committed
33ccef6
test(investigating-bugs): pre-register the P1 confirmatory replication

slowdini
and
claude
committed
6fbdb43
test(investigating-bugs): promote the durable-verification baseline

slowdini
and
claude
committed
70b4a06
docs(evaluating-skills): restructure case design around behavior decomposition

slowdini
and
claude
committed
4a9d5ea
test(investigating-bugs): add the behavior-level coverage map

slowdini
and
claude
committed
703a134
test(investigating-bugs): pre-register the B1 ablation pilot

slowdini
and
claude
committed
41c1108
test(investigating-bugs): record the B1 ablation pilot - attribution CONFIRMED

slowdini
and
claude
committed
7265b5b

Commits on Jul 29, 2026