MUSE 106-case sweep runner (DeepSeek-V4.1-Flash + kernelCAD) - #741

Merged

w1ne merged 23 commits into

feat/muse-106-sweep

Sep 20, 2026

Commits on Sep 19, 2026

docs: add MUSE 106-case sweep spec and implementation plan
w1ne
committed
351d0c6
eval(muse): import all 106 MUSE cases as tasks
w1ne
committed
a2ad2bd
eval: add OpenAI-compatible agent client for DeepInfra sweep runs
w1ne
committed
a3012a2
eval: harden OpenAI-compat client retries and tests
w1ne
committed
30d48eb
eval: add selectable system-prompt builder for sweep runs
w1ne
committed
63da3a3
eval: add bounded-concurrency map helper
w1ne
committed
306f3fc
eval: validate mapPool limit and document rejection semantics
w1ne
committed
dee638e
eval: add per-case sweep state machine
w1ne
committed
b347c02
eval: harden sweep state reads and boundary tests
w1ne
committed
816e768
eval: add MUSE pillar aggregation with forced-zero semantics
w1ne
committed
cb665a9
eval: exclude infra cases from MUSE aggregate denominators
w1ne
committed
9818c8f

Commits on Sep 20, 2026

eval: split runTask into generateCase and scoreCase for sweep resume
w1ne
committed
12112c5
eval: add MUSE alignment-judge wrapper and TS judge module
w1ne
committed
2680beb
eval: add MUSE sweep preflight checks
w1ne
committed
a7cd499
eval: add MUSE leaderboard/summary/protocol report generator
w1ne
committed
8e3b11d
eval: add resumable parallel MUSE sweep CLI
w1ne
committed
ab1a660
eval: add mock fixture for MUSE sweep integration test
w1ne
committed
54ca441
eval: ignore Python bytecode from oracle wrappers
w1ne
committed
d8f03a4
fix(eval): return judge payload on wrapper stdout so categories are parsed
w1ne
committed
af1fa9d
fix(eval): pass generation events into sweep scoring transcripts
w1ne
committed
1a94f82
eval: cap oracle CLI and judge spawns with timeouts
w1ne
committed
030da68
eval: record kernelCAD git provenance in sweep envelope and protocol
w1ne
committed
5259122
docs: mark MUSE sweep spec implemented after first full run
w1ne
committed
a345a79