Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -90,10 +90,21 @@ Allure results, selected by test labels:
| Dashboard | all results (aggregate) |
| Meshery | `project == "Meshery"` |
| Mesheryctl | `project == "mesheryctl"` |
| Mesheryctl: BATS End-to-End Tests | `project == "mesheryctl"` and `framework == "bats"` |
| **Connection Lifecycle** | `testGroup == "Connection Lifecycle"` (Test Plan Test Group, col B); transitionally, results carrying **no** `testGroup` label also match the legacy `epic == "Kubernetes Connections"` / Kubernetes `componentUnderTest` fallback (UI + CLI connection tests, grouped by `client`) |
| Extension: Remote Provider Layer5 Cloud | `project == "Layer5Cloud"` |
| Extension: Kanvas | `project == "Kanvas"` |

The **Mesheryctl: BATS End-to-End Tests** report is published at
https://qa.meshery.io/mesheryctl-bats/. It selects the Bash/BATS results emitted
by `mesheryctl/bats-to-allure.js`, excluding Go unit tests. The existing
Mesheryctl report continues to include both test types.

The existing `mesheryctl-e2e.yaml` workflow in `meshery/meshery` converts BATS
TAP output to Allure results and publishes them to `mesheryctl-bats-results/`
on eligible push runs. `make report-build` already includes that directory,
so this report needs no additional test run or result-sync workflow.

The Connection Lifecycle report is a **Test-Group-keyed view**: each test is
tagged at its source (UI Playwright specs, CLI converters) with a `testGroup`
label whose value is the Meshery Test Plan "Latest" tab Test Group (column B).
Expand Down
15 changes: 15 additions & 0 deletions allurerc.mjs
Original file line number Diff line number Diff line change
Expand Up @@ -124,6 +124,21 @@ export default defineConfig({
filter: ({ labels }) => isProject(labels, PROJECTS.MESHERYCTL),
},
},
// BATS end-to-end results are a subset of the Mesheryctl project report.
// Match the source converter's framework label to exclude Go unit tests.
"mesheryctl-bats": {
import: "@allurereport/plugin-awesome",
options: {
reportName: "Mesheryctl: BATS End-to-End Tests",
singleFile: false,
reportLanguage: "en",
open: false,
logo: "https://raw.githubusercontent.com/meshery-extensions/qa/refs/heads/master/.github/assets/images/meshery/icon-only/meshery-light-icon.svg",
filter: ({ labels }) =>
isProject(labels, PROJECTS.MESHERYCTL) &&
labels.some(({ name, value }) => name === "framework" && value === "bats"),
},
},
// EXTENSION POINT (see https://docs.meshery.io/extensibility)
// OPEN AN ISSUE TO ADD TEST RESULTS FROM YOUR EXTENSION HERE.
// EXTENSION POINT
Expand Down