Problem
The deterministic public corpus is useful as a regression contract, but curated retrospective evidence does not replace feedback from engineers using the output during real review work.
Goal
Run a limited open-alpha feedback cycle focused on whether the top three findings change reviewer or test behavior.
Scope
- Collect at least five independently submitted or reviewer-observed public PR runs.
- Prefer backend-heavy FastAPI, Django/DRF, and Express/Node changes.
- Record the command, merge decision, top three findings, useful output, noise, missed risk, setup friction, and workflow preference.
- Separate product defects from unsupported-stack requests and distribution requests.
- Turn repeated precision/noise patterns into focused follow-up issues or code changes.
- Publish only privacy-reviewed aggregate conclusions.
Guardrails
- Do not include private repository names, customer context, secrets, or non-public vulnerability details.
- Do not count internally curated benchmark labeling as external alpha feedback.
- Do not prioritize hosted workflow or broad stack expansion until repeated requests justify it.
Done when
Problem
The deterministic public corpus is useful as a regression contract, but curated retrospective evidence does not replace feedback from engineers using the output during real review work.
Goal
Run a limited open-alpha feedback cycle focused on whether the top three findings change reviewer or test behavior.
Scope
Guardrails
Done when