Repository navigation
docs: make emitter verification self-service - #46
Merged
Merged
Conversation
dsh-vet reportGrade: A · coverage: unknown · audited
Findings
2 info findings (never affect the grade)
Findings are signals, not verdicts — a low-confidence finding never lowers a grade. A finding you believe is wrong? Open a public dispute. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Ships milestone M4 of the release-risk plan — the public kit for detection quality and contract guarantees, expanded and executed per
2026-09-19-calibration-conformance-kit.md. No scanner behavior change; everything is data, tests, and docs around the published surfaces.Calibration corpus (
test/fixtures/calibration/, locked bytest/calibration.test.ts): eight labeled cases — benign/detection pairs (hex palette vs encoded payload), charcode chain, secret-adjacent egress, a formatting-variant pair asserting zero risk deltas underdsh-vet diff, the imports-map false-positive regression from the chalk pilot (since: unreleased, bumped at release), and the empty-audit vacuity check. Each manifest records source, license,since, expectations, rationale, and limitations;docs/calibration-method.mdpublishes the method, the per-case table, and the revision record — deliberately no aggregate accuracy percentage.Conformance corpus (
test/fixtures/conformance/, locked bytest/conformance.test.ts): eight committed reports covering legacy (no extension), complete/partial coverage, a forged summary (rejected — the summary is derived), a future v2 context (valid base report, never trusted), a comparable same-profile pair, and aprofile-mismatchpair. Valid files regenerate viascripts/gen-conformance-fixtures.mjs; third parties reproduce withnpx dsh-vet@<version> validate|diffas documented indocs/consumer-conformance.md.Consumer example (
examples/consumer/consume-report.mjs): the validate → coverage → applicability → render workflow in one file; unknown states stay visible and applicability says plainly that artifact matching is not supported yet (M3 keeps its entry gate).Registry split (
docs/emitters.md): structural conformance / detection calibration / origin verification are now separate claims; meeting one never implies another.Two corrections surfaced by the red-green loop:
egress.secret-adjacentgrades D (not C) when the network call is statically reachable from the secret read — the manifest and method doc now state the escalation semantics; and the ROADMAP's "no maintainer has replied" was stale — it now reflects the dsh-wechat reply (used once, second release pending; the M2 gate conclusion is unchanged).Out of scope, unchanged: M4 bullet 7 (exercising the kit with an external maintainer — outreach, separate authorized action) and the M2/M3 entry gates.
Verification:
pnpm verify— 225 tests across 20 files, typecheck, build, and package checks pass; the documented reproduction commands re-run green throughnode bin/dsh-vet.mjs(validate ok, diff comparable with zero deltas).