Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 17 additions & 0 deletions ARCHIVE-CUSTODY.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,17 @@
# TestForge v1.1.1 archive custody

TestForge is one two-skill Augment with several independently useful release objects. The canonical release keeps the complete product, its Codex plugin, and both standalone skills separately obtainable without pretending that a standalone skill is the whole product.

| Object | Canonical release artifact | Use |
|---|---|---|
| Complete Augment | `release-assets/v1.1.1/TestForge-v1.1.1.zip` | Portable two-skill TestForge capability with adapters, docs, evals, and tools |
| Codex plugin | `release-assets/v1.1.1/Plugin-TestForge-v1.1.1.zip` | Branded Codex plugin with both skill entry points and listing assets |
| Software Verification skill | `release-assets/v1.1.1/Skill-software-verification--TestForge-v1.1.1.zip` | Independent `$software-verification` installation and recovery |
| Verification Reviewer skill | `release-assets/v1.1.1/Skill-verification-reviewer--TestForge-v1.1.1.zip` | Independent `$verification-reviewer` installation and recovery |
| Claude.ai uploads | `claude-ai/software-verification-v1.1.1.zip` and `claude-ai/verification-reviewer-v1.1.1.zip` | Host-specific one-skill upload archives |
| Source repository | Git tag `v1.1.1` and its GitHub source archives | Versioned source, documentation, tests, testbed, and provenance |

`release-assets/v1.1.1/archive-custody.json` records exact hashes, sizes, member counts, source-tree digests, and extraction-parity results for the governed archives. GitHub release assets and the latest-only convenience backup shelf must match those hashes. Canonical assets are copied, never moved, to the backup shelf. Older same-family convenience copies may be removed only after the new copies match; unrelated products are untouched.

The two standalone skill archives and their Claude.ai counterparts intentionally carry the same skill content under channel-appropriate names. Static package equality does not establish live Claude activation, live Codex discovery, or directory approval.

9 changes: 6 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -40,9 +40,10 @@ TestForge is advisory verification machinery. It does not prove defect freedom,

## Repository map

- [`testforge/`](testforge/) - the complete portable TestForge Augment v1.1.0.
- [`testforge/`](testforge/) - the complete portable TestForge Augment v1.1.1.
- [`testforge/docs/QUICK-START.md`](testforge/docs/QUICK-START.md) - install and first-use guide.
- [`RELEASE-NOTES-v1.1.0.md`](RELEASE-NOTES-v1.1.0.md) - dual-host release changes and exact untested boundary.
- [`RELEASE-NOTES-v1.1.1.md`](RELEASE-NOTES-v1.1.1.md) - plugin-publication changes and exact untested boundary.
- [`ARCHIVE-CUSTODY.md`](ARCHIVE-CUSTODY.md) - canonical Augment, plugin, standalone-skill, Claude, GitHub, and backup custody.
- [`testforge/docs/SALES-DEMO.md`](testforge/docs/SALES-DEMO.md) - a compact proof-of-value scenario.
- [`tools/augment-evals/`](tools/augment-evals/) - isolated Augment behavioral evaluation harness.
- [`tools/augment-evals/README.md`](tools/augment-evals/README.md) - testbed setup, run, review, seal, promote and regression workflow.
Expand All @@ -54,12 +55,14 @@ codex plugin marketplace add Stunspot/TestForge
codex plugin add testforge@cd-testforge
```

Start a new Codex task, then invoke `$software-verification` or `$verification-reviewer`. The plugin bundles one canonical TestForge v1.1.0 package behind both entry points so their doctrine, tools, examples, and status vocabulary stay aligned. Its marketplace namespace is product-specific, so TestForge can coexist with other Collaborative Dynamics plugin repositories.
Start a new Codex task, then invoke `$software-verification` or `$verification-reviewer`. The plugin bundles the two self-contained TestForge v1.1.1 skills so their doctrine, tools, examples, and status vocabulary stay aligned. The separate Augment behavioral-evaluation harness remains in this repository rather than the skills-only plugin. Its marketplace namespace is product-specific, so TestForge can coexist with other Collaborative Dynamics plugin repositories.

## Quick start: use the standalone Agent SKILLs

Download the latest release, unzip it and keep the `testforge/` tree together. Expose both directories under `testforge/skills/` through your Agent host's skill mechanism. Host-specific notes are included for [Codex](testforge/adapters/codex.md), [Claude Code](testforge/adapters/claude-code.md), [GitHub](testforge/adapters/github.md), [local shell](testforge/adapters/local-shell.md) and [copy-paste chat](testforge/adapters/copy-paste-chat.md).

The GitHub release also preserves the complete Augment, the Codex plugin, and each bundled skill as separately named archives. This keeps `$software-verification` and `$verification-reviewer` independently recoverable without losing the complete two-skill product.

Then start with:

```text
Expand Down
26 changes: 26 additions & 0 deletions RELEASE-NOTES-v1.1.1.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,26 @@
# TestForge v1.1.1 release notes

Release date: 2026-07-20

TestForge v1.1.1 is the official-plugin-publication readiness release. It preserves the v1.1.0 verification behavior and dual-host package architecture while tightening public listing truth, legal links, documentation currency, brand identity, and release evidence.

## Changed

- Align the Codex plugin listing with the two bundled software-verification skills; the separate Augment behavioral-evaluation harness remains available from the repository.
- Add exact privacy-policy and terms-of-use links to the plugin manifest.
- Introduce a TestForge-specific icon: a partially completed optical answer sheet carrying one unmistakable coral release check.
- Add TestForge terms of use and refresh privacy, support, security, installation, host-boundary, provenance, and release documentation.
- Extend public-distribution tests for version parity, listing assets, legal URLs, and customer-document reachability.
- Preserve the complete Augment, Codex plugin, and both bundled standalone skills as governed release archives with a hash and extraction-parity custody ledger.

## Verification required before publication

- Validate the plugin manifest, canonical package, two plugin skills, two Claude folders, and two Claude archives.
- Run all deterministic package, evaluation-harness, distribution, documentation, release-manifest, and archive-parity checks.
- Exercise a clean Codex plugin installation in a fresh task and confirm both skill entry points can reach their runtime resources.
- Run a fresh exact-content Hesperos documentation review and an independent TestForge release-evidence review.
- Publish only after every blocking finding is repaired and the retained evidence supports `READY` or an explicitly accepted residual risk.

## Boundary

Structural and local host checks do not establish defect freedom, broad behavioral reliability, live Claude behavior, accessibility conformance, compliance certification, production fitness, directory approval, or customer outcomes. OpenAI review and accountable Collaborative Dynamics publication approval remain separate gates until observed.
2 changes: 1 addition & 1 deletion SECURITY.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

Do not open a public issue containing live credentials, private keys, customer records, exploit payloads against third parties, proprietary source code you are not authorized to share, or other sensitive material.

For ordinary defects, provide the smallest synthetic reproduction that preserves the failure. For a suspected vulnerability, contact Collaborative Dynamics privately through the security contact published on the official repository once available.
For ordinary defects, provide the smallest synthetic reproduction that preserves the failure through the [TestForge issue tracker](https://github.com/Stunspot/TestForge/issues). For a suspected vulnerability that cannot be safely disclosed in public, request a private reporting route through [Collaborative Dynamics](https://collaborative-dynamics.com).

TestForge's security-testing guidance requires a named target, explicit permission, non-production default, time window, rate and concurrency limits, prohibited actions, data-handling rules and a stop contact. Without those boundaries, remain in review-and-plan mode.

Expand Down
10 changes: 10 additions & 0 deletions archive-plan.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,10 @@
{
"schema_version": "cd-augment-archive-plan/v1",
"product": {"name": "TestForge", "version": "1.1.1"},
"artifacts": [
{"id": "augment", "kind": "augment", "source": "testforge", "archive_name": "TestForge-v1.1.1.zip", "top_level": "testforge"},
{"id": "plugin", "kind": "plugin", "source": "plugins/testforge", "archive_name": "Plugin-TestForge-v1.1.1.zip", "top_level": "testforge-plugin"},
{"id": "skill-software-verification", "kind": "standalone-skill", "source": "testforge/skills/software-verification", "archive_name": "Skill-software-verification--TestForge-v1.1.1.zip", "top_level": "software-verification"},
{"id": "skill-verification-reviewer", "kind": "standalone-skill", "source": "testforge/skills/verification-reviewer", "archive_name": "Skill-verification-reviewer--TestForge-v1.1.1.zip", "top_level": "verification-reviewer"}
]
}
Binary file added claude-ai/software-verification-v1.1.1.zip
Binary file not shown.
Binary file added claude-ai/verification-reviewer-v1.1.1.zip
Binary file not shown.
8 changes: 5 additions & 3 deletions documentation-manifest.json
Original file line number Diff line number Diff line change
Expand Up @@ -12,11 +12,13 @@
"testforge/docs/CAPABILITY-MATRIX.md",
"testforge/docs/TROUBLESHOOTING.md",
"testforge/docs/DATA-AND-PRIVACY.md",
"testforge/docs/TERMS-OF-USE.md",
"testforge/SECURITY.md",
"testforge/docs/VALIDATION.md",
"testforge/docs/LIMITATIONS.md",
"testforge/docs/SUPPORT-AND-VERSIONING.md",
"RELEASE-NOTES-v1.1.0.md",
"RELEASE-NOTES-v1.1.1.md",
"ARCHIVE-CUSTODY.md",
"testforge/PROVENANCE.md"
],
"moments": {
Expand All @@ -25,9 +27,9 @@
"first_value": ["testforge/docs/QUICK-START.md"],
"normal_use": ["testforge/docs/WORKFLOWS.md", "testforge/docs/CAPABILITY-MATRIX.md"],
"recovery": ["README.md", "testforge/docs/TROUBLESHOOTING.md", "testforge/docs/SUPPORT-AND-VERSIONING.md"],
"privacy_security": ["testforge/docs/DATA-AND-PRIVACY.md", "testforge/SECURITY.md"],
"privacy_security": ["testforge/docs/DATA-AND-PRIVACY.md", "testforge/docs/TERMS-OF-USE.md", "testforge/SECURITY.md"],
"evidence_limits": ["testforge/docs/VALIDATION.md", "testforge/docs/LIMITATIONS.md"],
"support_maintenance": ["testforge/docs/SUPPORT-AND-VERSIONING.md", "RELEASE-NOTES-v1.1.0.md"],
"support_maintenance": ["testforge/docs/SUPPORT-AND-VERSIONING.md", "RELEASE-NOTES-v1.1.1.md", "ARCHIVE-CUSTODY.md"],
"provenance": ["testforge/PROVENANCE.md"]
}
}
15 changes: 8 additions & 7 deletions documentation-review.json
Original file line number Diff line number Diff line change
Expand Up @@ -3,18 +3,19 @@
"fresh_context": true,
"disposition": "REVIEW_PASS_WITH_CONDITIONS",
"unresolved_material_findings": 0,
"documentation_fingerprint": "b13863cf1a728c83ae649d2482c3ebf992005b1e5d919ec634b05e08216130a4",
"documentation_fingerprint": "0b56836066452c9c91bc6219800a18cafff841e442c842b915a3bba44a14390d",
"reviewed_files": [
"README.md", "testforge/README.md", "testforge/docs/HOST-COMPATIBILITY.md", "testforge/docs/INSTALL-CODEX.md",
"testforge/docs/INSTALL-CLAUDE.md", "testforge/docs/QUICK-START.md", "testforge/docs/WORKFLOWS.md",
"testforge/docs/CAPABILITY-MATRIX.md", "testforge/docs/TROUBLESHOOTING.md", "testforge/docs/DATA-AND-PRIVACY.md",
"testforge/SECURITY.md", "testforge/docs/VALIDATION.md", "testforge/docs/LIMITATIONS.md",
"testforge/docs/SUPPORT-AND-VERSIONING.md", "RELEASE-NOTES-v1.1.0.md", "testforge/PROVENANCE.md"
"testforge/docs/TERMS-OF-USE.md", "testforge/SECURITY.md", "testforge/docs/VALIDATION.md",
"testforge/docs/LIMITATIONS.md", "testforge/docs/SUPPORT-AND-VERSIONING.md", "RELEASE-NOTES-v1.1.1.md",
"ARCHIVE-CUSTODY.md", "testforge/PROVENANCE.md"
],
"reviewer": "hesperos-documentation via documentation-accessibility-reviewer and local gpt-oss:20b",
"review_run_id": "run-20260719T063837Z-b13863cf",
"review_input_evidence": "verification/evidence/hesperos-doc-review-v1/review-input-custody.json",
"evidence_directory": "verification/evidence/hesperos-doc-review-v1",
"reviewer": "Hesperos exact-content review using local gpt-oss:20b, followed by deterministic response-shape validation",
"review_run_id": "hesperos-doc-review-v1.1.1-api-20260720-run2",
"review_input_evidence": "verification/evidence/hesperos-doc-review-v1.1.1-api-20260720-run2/review-input-evidence.json",
"evidence_directory": "verification/evidence/hesperos-doc-review-v1.1.1-api-20260720-run2",
"conditions": [
"Fresh standalone Codex activation, live Claude upload and activation, current Claude interface verification, live resource loading, script execution under customer permissions, clean installation, and representative first-success behavior remain unexecuted.",
"Broad repeated-model behavior, representative developer, browser, keyboard, screen-reader, localization, and accessibility-conformance testing remain unexecuted.",
Expand Down
20 changes: 11 additions & 9 deletions plugins/testforge/.codex-plugin/plugin.json
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
{
"name": "testforge",
"version": "1.1.0",
"description": "Make local coding Agents verify better, then test and remember every Augment you build.",
"version": "1.1.1",
"description": "Risk-driven software verification and independent evidence review for coding Agents.",
"author": {
"name": "Collaborative Dynamics",
"url": "https://collaborative-dynamics.com"
Expand All @@ -19,24 +19,26 @@
"skills": "./skills/",
"interface": {
"displayName": "TestForge",
"shortDescription": "A quality ratchet for local Agent competence.",
"longDescription": "Give inexpensive local coding Agents a risk model, evidence discipline, and independent reviewer, then turn every Agent capability into a test, reengineering, baseline, and regression loop that moves quality upward.",
"shortDescription": "Risk-ranked verification with an independent skeptic.",
"longDescription": "Turn software changes, repositories, defects, and release candidates into risk-ranked evidence, meaningful tests, captured execution, and a traceable release assessment, then challenge the result with an independent skeptical reviewer.",
"developerName": "Collaborative Dynamics",
"websiteURL": "https://github.com/Stunspot/TestForge",
"privacyPolicyURL": "https://github.com/Stunspot/TestForge/blob/main/testforge/docs/DATA-AND-PRIVACY.md",
"termsOfServiceURL": "https://github.com/Stunspot/TestForge/blob/main/testforge/docs/TERMS-OF-USE.md",
"category": "Developer Tools",
"capabilities": [
"Interactive",
"Read",
"Write"
],
"defaultPrompt": [
"Make this local Agent verify the repository before it ships.",
"Find the catastrophic risks this test plan may have missed.",
"Test this Augment and preserve a reviewed behavioral baseline."
"Verify this repository before it ships: reconstruct the blast radius, rank catastrophic risks, run safe authorized checks, and issue a traceable release assessment.",
"Challenge this completed verification package for missed catastrophic risks, weak oracles, broken traceability, and unsupported confidence.",
"Turn this failing test or bug report into the smallest credible evidence set that distinguishes product, test, environment, and uncertainty failures."
],
"brandColor": "#48CBE8",
"composerIcon": "./assets/testforge-icon.png",
"logo": "./assets/testforge-icon.png",
"composerIcon": "./assets/testforge-icon-v1.1.1.png",
"logo": "./assets/testforge-icon-v1.1.1.png",
"screenshots": [
"./assets/testforge-social-preview.png"
]
Expand Down
46 changes: 46 additions & 0 deletions plugins/testforge/assets/testforge-answer-sheet-v1.1.1.svg
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file not shown.
Binary file not shown.
Binary file not shown.
Binary file added release-assets/v1.1.1/TestForge-v1.1.1.zip
Binary file not shown.
54 changes: 54 additions & 0 deletions release-assets/v1.1.1/archive-custody.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,54 @@
{
"schema_version": "cd-augment-archive-custody/v1",
"product": {
"name": "TestForge",
"version": "1.1.1"
},
"created_at": "2026-07-20T10:33:20.941302+00:00",
"artifacts": [
{
"top_level": "testforge",
"source_tree_sha256": "d583947de8453ea69ae84e1e4577ea85b8618524c65cb9dd2c1117234f0d14f1",
"archive_sha256": "d0ebaaf1dfa609998e7898bb781208955bb99859a995b91eebe4a3f99195bef4",
"bytes": 200424,
"member_count": 226,
"id": "augment",
"kind": "augment",
"source": "testforge",
"archive_name": "TestForge-v1.1.1.zip"
},
{
"top_level": "testforge-plugin",
"source_tree_sha256": "a3376e2cc00934ddd1c1801281087c941324b13204a00dc8c9eecc78c81bf685",
"archive_sha256": "8d8e1757de8ccf372221b26c0878357226e66e482962a38ebcbaef3cc03d1c2c",
"bytes": 865820,
"member_count": 106,
"id": "plugin",
"kind": "plugin",
"source": "plugins/testforge",
"archive_name": "Plugin-TestForge-v1.1.1.zip"
},
{
"top_level": "software-verification",
"source_tree_sha256": "621df2a3342d68f1c06c8fcf4050a44269c8b0eb5219fb593130c92bfb0e1f55",
"archive_sha256": "126889cb85278d80dd9cc12d3c2dcef072511cb45e6f851de71896fc66ab8cfa",
"bytes": 73894,
"member_count": 91,
"id": "skill-software-verification",
"kind": "standalone-skill",
"source": "testforge/skills/software-verification",
"archive_name": "Skill-software-verification--TestForge-v1.1.1.zip"
},
{
"top_level": "verification-reviewer",
"source_tree_sha256": "79215a59d6b3561aefc77f86ea62481881461f8567aaf32571f57c4638661c9e",
"archive_sha256": "d7f9ec1faa9fbe38a8c595cdbb8a01ad1de084a1e2b403f60a66b7016aaadcd2",
"bytes": 9619,
"member_count": 9,
"id": "skill-verification-reviewer",
"kind": "standalone-skill",
"source": "testforge/skills/verification-reviewer",
"archive_name": "Skill-verification-reviewer--TestForge-v1.1.1.zip"
}
]
}
Loading
Loading