Repository navigation
Fix/optimize job - #6
Merged
Merged
Conversation
… 500 on a long run
The 150-per-task report run died at calibrate: POST /v1/judges/{role}/optimize ran the
optimizer subprocess inside the request with a hardcoded ten-minute limit, so 315 training
and 135 dev cases raised subprocess.TimeoutExpired and a 500 (the 90-row runs fit, so no test
caught it). Calibrate now runs on the grade-job pattern: background true answers 202 with a
job id; the record lives with the grade jobs under the workspace out dir (kind optimize, the
role, the agent, the full result block with delta, out_of_sample, corpus_source and the pin);
GET /v1/jobs/{id} reports it; GET /v1/jobs filters by kind; a restart reads as interrupted
and cannot be resumed as a grade; a second calibration of the same role is 409, while a
running calibration no longer blocks a grade. The limit is LITHRIM_OPTIMIZE_TIMEOUT_S (default
four hours), and a timeout is a failed job with nothing pinned (504 on the synchronous path);
the per-case grade limit is LITHRIM_GRADE_TIMEOUT_S (default 600).
Shell: the judge editor starts the calibration as a job, polls it with backoff, finds a
running one again on mount, says it is safe to reload, and shows the service's reason on
failure; the grade restore ignores calibration jobs.
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
…a reload The before round was reachable only from the import card right after a load; after a reload or a lost browser the only way to grade was 'Grade all cases', which grades both splits. Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What this changes
A short description.
Why
The problem or motivation.
Checklist
ruff check .is cleanpytest -qis green without a model key (credential-free)make demostill runs