Repository navigation
Align test taxonomy fixtures with live legends - #21
Conversation
|
No actionable comments were generated in the recent review. 🎉 ℹ️ Recent review info⚙️ Run configurationConfiguration used: Organization UI Review profile: ASSERTIVE Plan: Pro Run ID: 📒 Files selected for processing (2)
Summary by CodeRabbit
WalkthroughAdded design and retro documentation for the "Test Taxonomy And Fixture Drift" cycle and updated multiple tests/fixtures to use live legend taxonomy ( Changes
Estimated code review effort🎯 3 (Moderate) | ⏱️ ~25 minutes Possibly related PRs
Poem
🚥 Pre-merge checks | ✅ 3✅ Passed checks (3 passed)
✏️ Tip: You can configure your own custom pre-merge checks in the settings. ✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Actionable comments posted: 2
🤖 Prompt for all review comments with AI agents
Verify each finding against the current code and only fix it if needed.
Inline comments:
In
`@docs/method/retro/0037-test-taxonomy-and-fixture-drift/test-taxonomy-and-fixture-drift.md`:
- Around line 41-45: The "Backlog Maintenance" checklist currently shows
"outcome: hill-met" and the "None recorded" closure note but leaves "Inbox
processed" and "Dead work buried or merged" unchecked; either mark those two
checklist items as completed (tick the boxes for "Inbox processed" and "Dead
work buried or merged") or add a single-line justification under the Backlog
Maintenance section explaining why the retrospective is considered closed
despite those open maintenance tasks (e.g., "Backlog maintenance deferred to
weekly triage; closure still valid because outcome: hill-met").
In `@tests/cli.test.ts`:
- Line 237: The test titled "Does `method status` report legend health using the
live repo legends rather than stale historical codes?" currently only asserts
positive presence of `SYNTH` and `PROCESS`; add negative assertions that known
stale/historical legend codes are NOT present in the command output to match the
test intent. Locate the test case (the it(...) block with that title in
tests/cli.test.ts) and after the existing positive assertions, add expectations
that the output does not include the stale codes used in your fixtures (e.g.,
assert output does not contain the legacy/stale legend identifiers used
elsewhere in the repo) so the test fails if old codes are reported. Ensure you
use the same output variable/assertion helpers already in the test for
consistency.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Organization UI
Review profile: ASSERTIVE
Plan: Pro
Run ID: d622e348-ece8-402b-aacc-2a1ab51a324a
📒 Files selected for processing (10)
docs/design/0037-test-taxonomy-and-fixture-drift/test-taxonomy-and-fixture-drift.mddocs/method/backlog/bad-code/PROCESS_test-taxonomy-and-fixture-drift.mddocs/method/retro/0037-test-taxonomy-and-fixture-drift/test-taxonomy-and-fixture-drift.mddocs/method/retro/0037-test-taxonomy-and-fixture-drift/witness/verification.mdtests/api.test.tstests/cli.test.tstests/exec.test.tstests/github-adapter.test.tstests/ship-sync.test.tstests/witness.test.ts
💤 Files with no reviewable changes (1)
- docs/method/backlog/bad-code/PROCESS_test-taxonomy-and-fixture-drift.md
|
Follow-up fix summary for the latest review round:
Local verification after both fixes:
|
What changed
PROCESS,SYNTH, or none) instead of obsoletePROTO,VIZ,TUI, andFEATexamples0037design packet with a concrete hill and playback questions, then closed the cycle with a retro and witnessWhy
The committed suite was still proving an older METHOD taxonomy than the repo now documents. That made test intent ambiguous and made close-time playback drift harder to reason about.
Impact
0037witness now closes cleanly with no playback-question driftValidation
npm test -- tests/api.test.ts tests/cli.test.ts tests/github-adapter.test.ts tests/witness.test.ts tests/ship-sync.test.ts tests/exec.test.tsnpm test -- tests/cli.test.ts tests/witness.test.ts tests/ship-sync.test.tsnpm testnpm run buildnpm test -- tests/docs.test.tsgit diff --check