Skip to content

test: expand CRC postsubmit E2E with tiered smoke / standard / extended coverage - #2296

Open
fjglira wants to merge 8 commits into
istio-ecosystem:mainfrom
fjglira:expand-crc
Open

test: expand CRC postsubmit E2E with tiered smoke / standard / extended coverage#2296
fjglira wants to merge 8 commits into
istio-ecosystem:mainfrom
fjglira:expand-crc

Conversation

@fjglira

@fjglira fjglira commented Sep 1, 2026

Copy link
Copy Markdown
Contributor

What type of PR is this?

  • Enhancement / New Feature
  • Bug Fix
  • Refactor
  • Optimization
  • Test
  • Documentation Update

What this PR does / why we need it:

This PR adds tiered CRC E2E coverage to the postsubmit workflow. The operator is deployed once on a single OpenShift Local cluster; later steps reuse it and clean up mesh resources between tiers to stay within CRC memory limits and extend the coverage.

The postsubmit job now runs extended; this extends the current coverage as much as we can on a CRC cluster:

  • Before: smoke → operator install, sidecar control plane, ambient install + datapath + teardown (~42 specs)
  • Now (extended): smoke + ambient extended + library
    • Smoke: operator install, sidecar control plane, ambient install + datapath + teardown
    • Standard step: ambient API validation, dependency health, targetRef propagation (+ invalid targetRef recovery)
    • Extended step: library CRD ownership + library reconciliation (TLS, drift detection)

~76 specs vs ~42 before. Most excluded tests are due to CRC memory limits on the GitHub Actions free-tier VM.

Changes done:

  • tests/e2e/crc-e2e-ci.sh — tier entry point with mesh cleanup between steps
  • .github/workflows/crc-e2e-sail.yaml — postsubmit defaults to extended; workflow_dispatch can pick any tier
  • crc labels on E2E suites + Ginkgo filters per tier
  • CRC memory overrides via CreateIstio / CreateZTunnel helpers and CI env vars
  • Fix CRD deletion race in library ownership tests

CRC exclusions (still run on full OCP E2E): ambient-targetref-override, library-upgrade, tls-profile

Note: CRC E2E remains post-submit only and is not a required branch-protection check.

Which issue(s) this PR fixes:

Fixes #

Related Issue/PR #

Additional information:

@fjglira
fjglira requested a review from a team as a code owner September 1, 2026 12:53
@codecov

codecov Bot commented Sep 1, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 88.03%. Comparing base (1e3a0f6) to head (7950c3d).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2296      +/-   ##
==========================================
+ Coverage   87.88%   88.03%   +0.15%     
==========================================
  Files          56       56              
  Lines        2658     2658              
==========================================
+ Hits         2336     2340       +4     
+ Misses        322      318       -4     
Flag Coverage Δ
integration-tests 74.63% <ø> (+0.28%) ⬆️
unit-tests 65.01% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@fjglira

fjglira commented Sep 2, 2026

Copy link
Copy Markdown
Contributor Author

We need to wait until: #2294 is merged to be able to retest linter

fjglira and others added 8 commits September 2, 2026 13:50
…tion in the same job

Add tiered CRC E2E coverage with smoke, standard, and extended tiers on a
single OpenShift Local cluster. Introduce crc Ginkgo labels, crc-e2e-ci.sh
entry point, and sequential steps that reuse the operator deployment.

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Francisco Herrera <fjglira@gmail.com>
…clusion

Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Signed-off-by: Francisco Herrera <fjglira@gmail.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant