Repository navigation
harness：独立评审试行与评审校准（阶段二 P7，T006） - #63
Merged
Merged
Conversation
- 新增 harness/review.py、review_prompt.md：非设计方在只读评审工作区评审 R2 以上 PR（只看任务书、PR 描述、 diff 与证据包），结论以固定格式评论到 PR；评审方 Pi（默认，glm-5.3）、Codex（gpt-6-sol、max）、Claude Code； 与执行方同宿主时标出；评审方失败（报错、超时、额度或限流）记为评审失败，不评论为结论、不计入校准 - 校准集 evals/review/samples.json（回放用例重新注入的问题改动 + 已知良好 PR），calibrate 逐个落盘、 --resume 续跑、--jobs 并行、连续失败即停；2026-09-28 Pi 校准结果入库（56 个样本，TPR 1.0、TNR 1.0，局限见规范） - auto-merge 对 R2 以上 PR 打 needs-independent-review；bin/dispatch review 子命令 - run_check：任务书随本 PR 提交视为设计方自行实现，不要求运行记录（用户决定方案 B）；任务书 T006 随本 PR - 规范、PR 模板、harness README、待办同步（B27 改为 3 个 PR 试行；攒批关闭 B30、B11） Task: T006 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Task: T006 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
规范 §6 保留 P7 与 P8 两行验证状态；待办 B29 已由 #62 关闭，B27 保留本 PR 的改写。 Task: T006 Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
SnowsonZ
approved these changes
Sep 28, 2026
This was referenced Sep 28, 2026
SnowsonZ
added a commit
that referenced
this pull request
Sep 28, 2026
harness：补上 #63 漏合的提交；评审方只读锁定与后台自动评审（T007）
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
任务
docs/plans/task-006-independent-review.md（T006，K7，随本 PR 提交：设计方自行实现，方案 B）校准结果（
evals/review/results/2026-09-28-pi.json，Pi + glm-5.3）局限：问题样本的 PR 描述统一写「行为不变」而 diff 改了行为，识破偏容易，TPR 偏乐观；评审方偏保守，真实 PR 多推回用户确认。
过程中发现并修复
--resume续跑，--jobs并行（GLM 限流下 3 路可行、12 路被拒），连续失败 3 次即停。证据
需要人工验收的部分
bin/dispatch review <PR>，与你的判断对照，决定是否常态化（B27）。建议第一个用 P8 的 harness：熵治理纳入 Swift 与文档链接（目标态设计阶段二 P8） #62。🤖 Generated with Claude Code