Repository navigation

feat(scorers): judge workflow steps with team scorers - #1297

Merged

jeff-r2026 merged 12 commits into

mainfrom

saulmoro/1085-workflow-scorers

Oct 24, 2026

Merged

feat(scorers): judge workflow steps with team scorers#1297
jeff-r2026 merged 12 commits into
mainfrom
saulmoro/1085-workflow-scorers

Commits on Oct 24, 2026
- refactor: move launch, hashing and revision helpers out of workflow
  
  SaulMoro
  authored and
  dev
  committed
  a97d77c
- feat(scorers): validate and cache scorers/<name>.md
  
  SaulMoro
  authored and
  dev
  committed
  bb5acfd
- feat(workflow): list scorers on a step
  
  SaulMoro
  authored and
  dev
  committed
  be6b77a
- feat(scorers): take judge work with teamai score --next
  
  SaulMoro
  authored and
  dev
  committed
  d4d93ec
- feat(scorers): one label store, published to teamai-reports
  
  SaulMoro
  authored and
  dev
  committed
  de93f60
- feat(scorers): prepare evidence for judge leases
  
  SaulMoro
  authored and
  dev
  committed
  eb4c0e2
- feat(scorers): judge a lease locally
  
  SaulMoro
  authored and
  dev
  committed
  01833c7
- feat(scorers): require a judge isolation from team, scorer and machine
  
  SaulMoro
  authored and
  dev
  committed
  092817c
- feat(scorers): batch the scorers of one pass into one judge lease
  
  SaulMoro
  authored and
  dev
  committed
  f019248
- feat(scorers): score a pass on demand
  
  SaulMoro
  authored and
  dev
  committed
  af4c8d5
- feat(review): check model aliases in agents, workflows and scorers
  
  SaulMoro
  authored and
  dev
  committed
  251187b
- docs(scorers): one guide from scorer file to labels
  
  SaulMoro
  authored and
  dev
  committed
  fe7e22b