Make a Runway blind-eval round a one-line CLI - #547

Closed

vertix wants to merge 14 commits into

Positronic-Robotics:mainfrom

vertix:gyros-blind-eval

Commits on Jul 31, 2026

Point the type-check ratchet at the venv it builds
vertix
committed
96b7103
Identify sampled endpoints by their label, and warm them in parallel
vertix
committed
254bbb7
Add the `gyros_fm_act` blind pair, sampled uniformly
vertix
committed
e8d9ae3
Correct the `tsu_actuni` endpoint URL, and name the URL on a rejected handshake
vertix
committed
7c32036
Log the sampled sub-policy for every sampler, not just the balanced one
vertix
committed
73551f0
Balance the `gyros_fm_act` pair, like the other eval presets
vertix
committed
ae3c89e
Seed the episode counter before warmup samples against it
vertix
committed
c5dc2bd
Add `n60` to the `gyros_fm_act` set
vertix
committed
6b495f8

Commits on Aug 3, 2026

Replace the per-batch eval presets with a rolling `runway_current`
vertix
committed
b76a7c9
Split the rolling eval preset per Runway owner
vertix
committed
a56a5df

Commits on Aug 5, 2026

Repoint `runway_ziyi` at the 112k gyros batch
vertix
committed
adc126b

Commits on Aug 6, 2026

Repoint `runway_ziyi` at the 150k gyros batch
vertix
committed
2bf06ff
Swap `fm_actuni_150k` for the `nm_n60_50k` endpoint
vertix
committed
ab4690b
Drop `nm_n60_50k`: its handshake stalls and takes the eval down
vertix
committed
7eb323c