Skip to content

docs: add an Experiments section and list experiments/ in the layout - #32

Merged
yodablocks merged 1 commit into
masterfrom
docs/experiments-section
Oct 4, 2026
Merged

yodablocks merged 1 commit into
masterfrom
docs/experiments-section

Conversation

@yodablocks

Copy link
Copy Markdown
Owner

Docs only. The top-level README did not mention experiments/ at all, although #28, #30 and #31 added three experiments with their own READMEs.

  • New Experiments section between Status and limitations and Development: one table row per experiment (question and headline result), linking to each experiment's README.
  • experiments/ added to the layout block.
  • A short caveat paragraph: small gold set, 28 of 38 questions drafted from the searched chunks, LLM-drafted hard questions not reviewed by a person, saturation on an iterated set.
  • The Retrieval quality section and the Status and limitations bullets are untouched: they describe the shipped defaults, and none of the experiments changes a default.

The numbers in the table were checked against experiments/*/results/*.json (33/38 and 38 at Hit@5 for bge on the union pool; 36, 35 and 38 pool recall at N=10 for embedding, RRF and union; 38/38 for union + Jev), and the three links resolve.

@yodablocks
yodablocks merged commit 0e152c0 into master Oct 4, 2026
4 checks passed
@yodablocks
yodablocks deleted the docs/experiments-section branch October 4, 2026 05:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant