Skip to content

docs: sync README with closed judge search, Milestone 1, and a legal notice - #12

Merged
serpeigd merged 1 commit into
mainfrom
claude/nifty-ride-vpu93a
Aug 13, 2026
Merged

docs: sync README with closed judge search, Milestone 1, and a legal notice#12
serpeigd merged 1 commit into
mainfrom
claude/nifty-ride-vpu93a

Conversation

@serpeigd

Copy link
Copy Markdown
Owner

What changed and why

Scheduled documentation-sync run. README.md only — no product or measurement-track code touched.

The README had drifted behind D15/D16. Its Roadmap still listed "Resolve the judge-trust gap before Milestone 1 (retrieval)" and its Limitations still said "this is why Milestone 1 hasn't started" — but Milestone 1 is complete at 20/20 titles, and the judge search has been closed after six attempts.

Stale numbers, verified against the tree

Claim Was Now
Test suite 8 tests (4 places) 26 — counted across the five files in tests/
Design log D1–D14 (2 places) D1–D16
judge.py "SubstringJudge + LLMJudge" all six judge classes

Status / Roadmap / Limitations rewritten to match reality

  • Judge calibration is now marked closed-and-unsolved rather than in progress, with the reason SubstringJudge stays the default stated plainly: not because it's good, but because missing things is a bounded failure mode and inventing them isn't. The SimilarityJudge result that ended the search is included — a film's own public premise scored 0.561, higher than the one confirmed real leak at 0.525.
  • The three confirmed leaks are documented as a limitation, with both mechanisms kept distinct: Los cronocrímenes leaked from the model's own memory (the corpus never mentions it), while Tetsuo and Hard to Be a God leaked because Wikipedia's own overview section carries those films' core spoilers verbatim — the GREEN corpus itself wasn't safe for them. Come and See has the same risk latent. Milestone 1's real gain is stated alongside it (grounding 0.0 → 1.0, judge-independent; the five highest-risk twist titles clean) without letting it read as a safety guarantee.
  • Roadmap replaces the obsolete judge-then-retrieval sequencing with what actually replaced it: --save-briefs plus a human reading the text, which caught all three leaks when no judge caught any.

Project layout

Filled in the modules added since the last sync: retrieval.py, retrieval_groq.py, retrieval_prompts.py, stats.py, external_dataset.py, train_spoiler_classifier.py, generator.py/demo_generator.py, and the three newer calibration scripts.

Legal notice (requested directly)

## License previously read "No license defined yet — personal portfolio repo." It's now an explicit notice: copyright reserved, with the point that public visibility on GitHub is not itself a licence, plus the third-party terms this repo can't relicense — TMDB's non-commercial attribution terms, Wikipedia's CC BY-SA, the IMDb Spoiler Dataset (gitignored, never redistributed; direct scraping prohibited by ToS and not done), and the cited director/critic quotes in content/researched/*.json.

No LICENSE file was added — choosing a licence is the author's call, not something a docs-sync run should decide. Flagged below.

Verification

Counts and module lists come from the tree itself (tests/, evals/judge.py, docs/DESIGN.md, run_eval.py's argument parser), not from CLAUDE.md. pytest isn't installed in this environment, so the suite wasn't run locally — CI is the check.

Needs a human decision

Whether to add an actual LICENSE file (and which one). The README now states the default reservation accurately in the meantime.


Generated by Claude Code

…notice

- Fix stale counts: the suite is 26 tests, not 8 (four places), and
  docs/DESIGN.md now runs D1-D16, not D1-D14 (two places).
- Rewrite the Status row, Roadmap, and Limitations for the actual state:
  judge iteration is closed after six judges, Milestone 1 is complete at
  20/20 titles, and the three confirmed leaks are documented with both
  mechanisms (model memory vs. Wikipedia's own overview section).
- Drop the Roadmap item that still framed retrieval as not started and
  the judge gap as the thing blocking it; both are resolved.
- Expand the project layout with retrieval.py, retrieval_groq.py,
  retrieval_prompts.py, stats.py, external_dataset.py,
  train_spoiler_classifier.py and the three newer calibration scripts,
  and correct judge.py's description from two judges to six.
- Replace the placeholder License section with a real notice: explicit
  copyright reservation (no LICENSE file exists, so public visibility is
  not a grant), and the third-party terms it cannot relicense (TMDB,
  Wikipedia CC BY-SA, the IMDb Spoiler Dataset, cited quotes).

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01MDoFHbKZRxhUhyFQuYVFUc
@serpeigd
serpeigd marked this pull request as ready for review August 13, 2026 19:38
@serpeigd
serpeigd merged commit 266d06b into main Aug 13, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant