Skip to content

fix: regenerate baselines.json so it reproduces - #10

Merged
shaikn6 merged 1 commit into
mainfrom
fix/baselines-reproduce
Oct 28, 2026
Merged

shaikn6 merged 1 commit into
mainfrom
fix/baselines-reproduce

Conversation

@shaikn6

@shaikn6 shaikn6 commented Oct 28, 2026

Copy link
Copy Markdown
Owner

Regenerates baselines.json from two identical re-runs with the pinned stack (0.6558 / 0.3098, same as arena.json) and corrects the README text that quoted the stale numbers.

Re-running baselines.py with the pinned requirements and revisions gives 0.6558 / 0.3098 (1,566 correct) on two runs, identical to arena.json. Replace the stale file, drop the unexplained-gap note, and clarify the v1 eval window and cascade gap wording.
@shaikn6
shaikn6 merged commit 6c02b6f into main Oct 28, 2026
4 checks passed
@shaikn6
shaikn6 deleted the fix/baselines-reproduce branch October 28, 2026 08:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant