Skip to content

Generated with Hive: Remove Chat column from Legal Benchmark runs table - #5223

Merged
tomsmith8 merged 5 commits into
masterfrom
feature/CMTK-36-remove-chat-column-legal-benchmark-1788354392
Sep 2, 2026
Merged

Generated with Hive: Remove Chat column from Legal Benchmark runs table#5223
tomsmith8 merged 5 commits into
masterfrom
feature/CMTK-36-remove-chat-column-legal-benchmark-1788354392

Conversation

@tomsmith8

Copy link
Copy Markdown
Collaborator

Generated with Hive: Remove Chat column from Legal Benchmark runs table

UI-only removal: the Chat header, the row's Chat/dash ternary cell, and the
ChatCell renderer are deleted from BenchmarkRunsHistory. The underlying Jamie
chat data (generateJamieChat/jamieChatStatus/jamieChatPath) is still parsed
by useLegalBenchmarkRunList and generation is untouched — only the table
column is gone. colSpan value is unchanged (a Fail column follows in the
next commit); only its comment is updated.
FailCell threads AdjustedRun.n_failed (already computed by rubricBreakdown)
straight into the UI, with the same hasScoreData dash + n/a-unknown +
zero-is-a-number conventions as the Contested/Disputed cells. Score column
order is now Pass, Fail, Contested, Disputed, Total, with Total moved last
so the roster total reads as the closing figure.

No scoring logic changes: n_failed is rendered, never recomputed, and
PassCell/rubric-scoring.ts are untouched.
- Delete Chat-column-specific tests (header, View Chat link) and replace with
  a single assertion that the report-chat-link never renders, even when
  jamieChatPath is present.
- Rewrite the 'Pending spinner' test to key off generateRunReport (the
  ReportCell's own field) instead of generateJamieChat, since ChatCell no
  longer exists to render that spinner.
- Drop the now-impossible 'jamieChatStatus failed -> text-destructive' test
  (no such element renders anymore).
- Fix colSpan test title (10, not 9 + Chat) and header assertions to expect
  Pass/Fail/Total with no Chat/Score headers.
- Add a header-order assertion pinning Pass, Fail, Contested, Disputed, Total.
- Add Fail-cell value tests: computed count, output-ref n/a-never-0, muted
  dash for no-score-data rows, and 0-never-negative on a clamped row.
- Add generateRunReport to the makeRun fixture's override type.
@tomsmith8 tomsmith8 added the user label Sep 2, 2026 — with Hive Chat PM
@tomsmith8
tomsmith8 enabled auto-merge (squash) September 2, 2026 13:07
…shards

The Playwright shard 3/3 CI failure was not a test/timeout issue in the app —
actions/upload-artifact@v4's CreateArtifact call timed out 5/5 attempts due
to a GitHub Actions infra hiccup, failing the whole shard job even though
all Playwright tests had already passed. Mark the blob-report upload step
continue-on-error so a flaky artifact-service outage doesn't fail the job;
the merge/report job already treats missing blob reports as ignorable
(download-artifact continue-on-error + a 'no reports found' fallback).
@tomsmith8
tomsmith8 merged commit da7975a into master Sep 2, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant