Skip to content

feat: improve paraphrase recall coverage - #53

Merged
davidrobertson merged 1 commit into
mainfrom
codex/feat/reformulate-recall-queries
Jul 26, 2026
Merged

feat: improve paraphrase recall coverage#53
davidrobertson merged 1 commit into
mainfrom
codex/feat/reformulate-recall-queries

Conversation

@davidrobertson

Copy link
Copy Markdown
Contributor

Summary

  • retry lcm_grep with up to two same-scope query reformulations after an empty result
  • expand retrieval benchmark corpus v2 to 39 sessions and 38 queries
  • report development and holdout metrics across 32 paraphrase cases

The old eight-query corpus overstated retrieval quality. Corpus v2 keeps exact, cross-session, and temporal checks while exposing the lexical paraphrase gap without changing the search engine.

Results

  • overall Recall@1: 42.11%
  • paraphrase Recall@1: 31.25%
  • exact, cross-session, and temporal Recall@1: 100%

Validation

  • npm test (184 tests passed)
  • npm run smoke
  • npx tsc --noEmit
  • npm --cache /tmp/codex-lcm-npm-cache pack --dry-run
  • retrieval benchmark corpus v2
  • skill validation
  • independent VoltFlow review

Risk

Search ranking and storage are unchanged. The behavioral change is limited to the shipped recall skill; the larger benchmark records a stricter baseline.

@davidrobertson
davidrobertson marked this pull request as ready for review July 26, 2026 20:08
@davidrobertson
davidrobertson merged commit ad2abb2 into main Jul 26, 2026
1 check passed
@davidrobertson
davidrobertson deleted the codex/feat/reformulate-recall-queries branch July 26, 2026 20:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant