Skill to set up PR for testing#118
Open
DavertMik wants to merge 9 commits into
Open
Conversation
…-remote - PR open: post a notice comment with affected manual/automated test counts (reporter run --filter-list), no runs created, never blocks the PR - PR merged: create the manual run (pending) and prepare the automated run as a shared run titled by commit (reporter start), not executed - deploy done: launch the prepared run on a Testomat.io CI profile via reporter run --remote, replacing cross-repo dispatch - rewrite REPORTER_CONTRACT.md and evals for the three-phase model Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
olexandr13
reviewed
May 31, 2026
| tests run there and report back into the same prepared run. | ||
| ``` | ||
|
|
||
| Every phase is **change-aware**: a coverage map (`coverage.*.yml`) maps source |
Contributor
There was a problem hiding this comment.
why rows are so short?)
|
|
||
| The big shift from older setups: **execution moved to after merge+deploy**, the | ||
| **PR-open step is now just an informational comment**, and **automated tests are | ||
| launched through Testomat.io's `--remote` CI profile** instead of this repo |
Contributor
There was a problem hiding this comment.
I ca't find info about this in docs...
Contributor
Author
There was a problem hiding this comment.
it's a new feature!
The deliverable is a working pipeline committed to the project's own CI system. The skill never executes the reporter, runs tests, or creates runs itself — every reporter command is written into the pipeline for CI to run. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Aligns the skill with the reporter change: start prints only the run id to stdout when --format is set, so capture with --format id instead of tail -n1. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Merge manual-coverage and automation-coverage into a single qa-test-coverage-map skill: manual and automated tests of one project go in one map. Split files per project, not per test kind. Coverage maps are now named by content so CI knows what is inside: coverage.<slug>.yml manual + automated coverage.<slug>.manual.yml manual only coverage.<slug>.e2e.yml automated only Update setup-pr-testing to read the filename suffix and pick the reporter --kind flag accordingly: --kind manual (manual only), --kind mixed (combined), or none (e2e only). One regression run is created per coverage map on merge. Refresh README, testomatio-flow, REPORTER_CONTRACT, and evals for the new skill name and naming scheme. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Reconcile the coverage-skill unification on this branch with master's skill-rename refactor (#126). Conflict resolutions: - Keep the unified qa-test-coverage-map skill; drop master's separate qa-manual-tests-to-code-coverage and e2e-test-coverage-mapping (the unified skill supersedes both). - README and senior-qa-testing-workflow: adopt master's renamed skill names, collapse the two coverage rows into the single qa-test-coverage-map. - Align qa-test-coverage-map and setup-pr-testing to master's conventions: cache dir .testclaw-context/ -> .testclaw/, and renamed skill references (project-scan -> scan-automation-project, sync-cases -> sync-test-cases-with-tms, generate-cases -> qa-write-test-cases, reporter-setup -> qa-e2e-tests-reporting). Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Updates workflow files to
Coverage skills unified into
qa-test-coverage-mapMerged
manual-coverage+automation-coverageinto one skill. Manual andautomated tests of a project now share one coverage map; files are split
per project, not per test kind.
Coverage maps are named by content so CI knows what's inside without opening them:
coverage.<slug>.ymlcoverage.<slug>.manual.ymlcoverage.<slug>.e2e.ymlsetup-pr-testingreads the suffix to pick the reporter--kind:--kind manual(manual only),--kind mixed(combined), or none (e2e only),and creates one regression run per coverage map on merge.
README,
testomatio-flow,REPORTER_CONTRACT, and the evals are updated forthe new skill name and naming scheme.
🤖 Generated with Claude Code