Skip to content

test: benchmark expert ranking in triage - #127

Merged
cschanhniem merged 1 commit into
mainfrom
oamp-loop-20260702-2
Jul 2, 2026
Merged

cschanhniem merged 1 commit into
mainfrom
oamp-loop-20260702-2

Conversation

@cschanhniem

Copy link
Copy Markdown
Collaborator

Summary

  • add expert_composite to the multi-class triage benchmark and metrics snapshot
  • record expert-composite top-20 class distribution as a top-k failure mode
  • update roadmap/current metrics to state that expert ranking improves selective-vs-hemolytic ordering but leaks decoys into top-k

Verification

  • uv run pytest tests/test_triage_benchmark.py tests/test_cli_triage.py tests/test_metrics_snapshot.py tests/test_expert_ranking_integration.py tests/test_docs_consistent.py -q
  • uv run pytest -q
  • git diff --check
  • pre-push hook: .venv/bin/python -m pytest -q

@cschanhniem
cschanhniem merged commit f58601a into main Jul 2, 2026
1 check passed
@cschanhniem
cschanhniem deleted the oamp-loop-20260702-2 branch July 2, 2026 13:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant