-
Notifications
You must be signed in to change notification settings - Fork 0
All issues
Issue creation is restricted in this repository
Issues
is:issue state:open
is:issue state:open
Search results
- Status: Open.#34 In evanwtf/limerick-benchmark;
Tighten limerick evaluator to require a full 5-line limerick, not a first-line match
severity:mediumMedium-severity issueMedium-severity issueStatus: Open.#32 In evanwtf/limerick-benchmark;Do not pre-bootstrap Aider workspaces with uv init or flask
severity:mediumMedium-severity issueMedium-severity issueStatus: Open.#33 In evanwtf/limerick-benchmark;Aider: evaluate more tolerant edit-format strategies for weaker local models
enhancementNew feature or requestNew feature or requestseverity:lowLow-severity issueLow-severity issueStatus: Open.#31 In evanwtf/limerick-benchmark;Runner: write a job-level rollup to results/<job_id>/job_summary.json
severity:lowLow-severity issueLow-severity issueStatus: Open.#28 In evanwtf/limerick-benchmark;Report: suppress 'Aider stagnation timeout' row at default unless triggered
severity:lowLow-severity issueLow-severity issueStatus: Open.#27 In evanwtf/limerick-benchmark;Report: include started_at timestamp in each model section
severity:lowLow-severity issueLow-severity issueStatus: Open.#26 In evanwtf/limerick-benchmark;- Status: Open.#25 In evanwtf/limerick-benchmark;
Report: surface entry_point_candidates for failures and non-app.py passes
severity:lowLow-severity issueLow-severity issueStatus: Open.#24 In evanwtf/limerick-benchmark;Report: suppress zero-valued agent telemetry for Aider runs
severity:lowLow-severity issueLow-severity issueStatus: Open.#23 In evanwtf/limerick-benchmark;Report: replace 'Finish Reasons' aggregate with 'Failure Categories'
severity:lowLow-severity issueLow-severity issueStatus: Open.#22 In evanwtf/limerick-benchmark;- Status: Open.#21 In evanwtf/limerick-benchmark;