Skip to content

Pull requests: UKGovernmentBEIS/inspect_ai

New pull request New
56 Open 3,195 Closed
56 Open 3,195 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: warn on unbounded message conversations
#4049 opened May 26, 2026 by deepujain Contributor • Draft
2 of 5 tasks
1
fix(scorer): return NOANSWER (not INCORRECT) when model_graded grade parser fails
#4048 opened May 26, 2026 by vladmesh Loading…
1 of 5 tasks
1
fix: align vLLM logging with Inspect log level
#4047 opened May 26, 2026 by deepujain Contributor • Draft
2 of 5 tasks
1
feat: add OpenRouter app attribution headers
#4046 opened May 26, 2026 by deepujain Contributor • Draft
1
fix: resolve registry task sandbox paths from module dir
#4045 opened May 26, 2026 by deepujain Contributor • Draft
1 of 5 tasks
1
fix: support explicit Azure OpenAI AD token auth
#4044 opened May 26, 2026 by deepujain Contributor • Draft
2 of 5 tasks
1
fix: map metrics to solver score names
#4043 opened May 26, 2026 by deepujain Contributor • Draft
2 of 5 tasks
1
docs: clarify ReAct loop depth controls
#4042 opened May 26, 2026 by deepujain Contributor • Draft
1 of 5 tasks
1
docs: add LLM-to-LLM conversation eval example
#4041 opened May 26, 2026 by deepujain Contributor • Draft
1 of 5 tasks
1
fix(scorer): set Score.answer on model_graded grade-parse failure
#4039 opened May 25, 2026 by ernestprovo23 Loading…
1
Bound transcript memory for long-running samples
#4038 opened May 25, 2026 by rasmusfaber Contributor Loading…
3 of 5 tasks
Complete samples from buffer history
#4037 opened May 25, 2026 by rasmusfaber Contributor Loading…
3 of 5 tasks
Fix transcript subscriber delivery
#4036 opened May 25, 2026 by rasmusfaber Contributor Loading…
2 of 5 tasks
Add Krippendorff's α metric for multi-judge agreement
#4035 opened May 25, 2026 by joesposito8 Contributor Loading…
2 of 5 tasks
Arena: Add pairwise comparison with win rate and Elo metrics
#4034 opened May 25, 2026 by showpiecep • Draft
align CLI --display and --effort type annotations with their choices
#4032 opened May 25, 2026 by RecreationalMath Contributor Loading…
1 of 5 tasks
1
Agent Bridge: Add span_id_resolver callback for providing parent span ids for model generations
#4024 opened May 24, 2026 by jjallaire Collaborator Loading…
Fix Bedrock provider to support adaptive thinking and output_config (closes #3765)
#4020 opened May 22, 2026 by ernestprovo23 Loading…
2 tasks done
1
test: add parse_cli_args coverage for vLLM nested arg preservation (fixes #3348)
#4019 opened May 22, 2026 by finaspirant Loading…
1
Inspect View: edit log tags and metadata in the viewer
#4014 opened May 22, 2026 by ransomr Collaborator Loading…
1 of 5 tasks
text_editor: fix corrupted-history failure mode and cap history size
#4010 opened May 22, 2026 by tadamcz Contributor Loading…
feat: add host-mode backend for computer() tool
#4009 opened May 22, 2026 by marov Loading…
1 of 5 tasks
5
Remote checkpoint directory support
#4007 opened May 21, 2026 by epatey Collaborator • Draft
fix: make emit_sample_event thread-safe (queue + drainer) — fixes #4003
#4006 opened May 21, 2026 by Butanium Contributor • Draft
5 tasks done
1
fix(eval): record default epochs reducer consistently
#4001 opened May 21, 2026 by herbert-apollo Contributor • Draft
1 of 5 tasks
ProTip! What’s not been updated in a month: updated:<2026-04-26.