Skip to content

Add Evidence Graph paired A/B pilot - #498

Merged
GiulioDER merged 4 commits into
masterfrom
codex/evidence-graph-ab-pilot
Aug 24, 2026
Merged

Add Evidence Graph paired A/B pilot#498
GiulioDER merged 4 commits into
masterfrom
codex/evidence-graph-ab-pilot

Conversation

@GiulioDER

Copy link
Copy Markdown
Owner

Summary

  • add a deterministic paired Evidence Graph V1 pilot runner
  • include baseline, deterministic graph, shuffled relation, removed relation, authored, and proposal-only arms
  • fix shuffled relation controls to rewire endpoints while preserving degree distributions
  • add pilot tests for routing gains, trust rejection, determinism, and control validity

Validation

  • python -m benchmarks.evidence_graph_pilot
  • python -m pytest -q tests/test_evidence_graph_eval.py tests/test_evidence_graph_pilot.py tests/test_semantic_graph.py tests/test_semantic_graph_db.py
  • 13 passed, 3 skipped
  • ruff check passed

The pilot is explicitly directional: it measures evidence routing over a labeled fixture, not end-to-end answer quality.

@GiulioDER
GiulioDER merged commit 4197bef into master Aug 24, 2026
13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants