Skip to content

ci: build all five implementations and gate on unexplained failures and regressions - #1

Merged
stormer78 merged 1 commit into
mainfrom
ci/conformance-matrix
Sep 16, 2026
Merged

stormer78 merged 1 commit into
mainfrom
ci/conformance-matrix

Conversation

@stormer78

Copy link
Copy Markdown
Contributor

Adds .github/workflows/conformance.yml. It checks out affinidi-tdk-rs, vta-browser-plugin (tsp-js), affinidi-tsp-go and affinidi-tsp-dart next to the suite, builds every driver from source, and runs the full matrix.

  • Triggers: push to main, pull requests, a weekly run, and workflow_dispatch with a ref input for each repo.

  • Seed: the run id, so each run uses fresh keys and the report records the seed.

  • Gate: a new runner option, --gate known, is non-zero in three cases:

    • a failure that no entry in findings.toml explains (a new disagreement);
    • a failure that matches a finding marked fixed (a regression);
    • a driver that did not build or start.

    make run keeps --gate all.

  • findings.toml: three findings are now marked fixed: the XSCS body (#803/#249), the accepter's reply digest (#804) and accept correlation (#250). Findings that match nothing are printed as a note.

  • Outputs: the job summary shows the report summary, and the report plus driver logs are uploaded as the conformance-report artifact.

Checked locally against the current merged code: 0 unexplained failures, exit 0. With affinidi-tsp built from a checkout that predates #804, the gate reports REGRESSION (affinidi-accepter-forgets-reply-digest) and exits 1.

…nd regressions

Signed-off-by: Glenn Gore <glenn.g@affinidi.com>
@stormer78
stormer78 force-pushed the ci/conformance-matrix branch from 4a80e15 to e889e7d Compare September 16, 2026 13:36
@stormer78
stormer78 merged commit 68de724 into main Sep 16, 2026
2 checks passed
@stormer78
stormer78 deleted the ci/conformance-matrix branch September 16, 2026 13:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant