Add fuzz coverage for coordinator-only inference error isolation - #2
Conversation
Verified tree: bfa23b3 Policy: 0899a75bbab3c18283279614b63cba0ec5867316cda98dce3f2a032bbea420f7
Numinous Forge · Change and verificationResult: new test coverage, merged into this fork. This example starts from a requested improvement rather than a reported bug. What changed: Added fuzz coverage for inference-error messages. Public error fields must survive JSON encoding and decoding; coordinator-only diagnostic details must stay off the wire. Production behavior is unchanged. What we proved:
Review focus: The test should preserve the public error contract while rejecting diagnostic leakage, including malformed input handling. After merge: We made the new regression a required check. A scheduled protocol run passed on the improved source under the updated check definitions. Both scheduled occurrences kept separate results; the later run did not overwrite the earlier one. The demonstration schedule is currently paused. Review summary for fdb9a4572c3d. Live task and CI progress are reported separately. |
Add fuzz coverage for
InferenceErrorMessageso public fields survive JSON roundtrips while the coordinator-only cause cannot enter or leave through wire JSON. Production behavior is unchanged.The test covers the failure-code vocabulary, quotes, Unicode, empty values, duplicate keys, and attempts to inject coordinator-only fields. Exact string comparisons account for Go's documented replacement of invalid UTF-8.
Validation on fresh Forge workers:
FuzzInferenceErrorWireIsolationseeds and a bounded five-second fuzz run passed.CoordinatorCausefromjson:"-"tojson:"coordinator_cause"makes the new test fail; the original candidate passes.This is the prompted-work demonstration for Numinous Forge. The first agent attempt lost its model connection; the recorded revision produced this candidate. CI on this PR separately verifies its merge with the current default branch.
This change was prepared by Numinous Forge and independently verified on a fresh worker.
Task:
87364f7dbf3d9d72eac9596d34d4625aBase:
bbf6f83d4bbe66ae1a78c8f5cec898e3fbff5783Verified tree:
bfa23b3e397301e8e5ff31eabb456efb856be996Policy:
0899a75bbab3c18283279614b63cba0ec5867316cda98dce3f2a032bbea420f7Verification runs:
53d4185ee124317e6dedb2901b8fd27e,75cc23da57389b7d1b4f289b82483f8eExport full evidence with
numinous-forge task export 87364f7dbf3d9d72eac9596d34d4625a ./evidence.Before:
After: