Skip to content

Add flaky test trend line to report chart - #185

Merged
shossain786 merged 2 commits into
seleniumboot:masterfrom
SumerManer-17:fix/report-trend-chart
Oct 21, 2026
Merged

shossain786 merged 2 commits into
seleniumboot:masterfrom
SumerManer-17:fix/report-trend-chart

Conversation

@SumerManer-17

Copy link
Copy Markdown
Contributor

Summary

  • Add a flaky-test trend line to the HTML report.
  • Include flakyTests in the report trend data.
  • Extend HtmlReportGeneratorTest to verify the flaky-test trend values.

Testing

  • mvn test "-Dtest=HtmlReportGeneratorTest" — passed.
  • mvn clean verify — four failures in CucumberQuarantineTest.
  • Verified that the same four failures also occur on the original upstream/master baseline.

The reported baseline failures are unrelated to the changes in this PR.

shossain786 added a commit that referenced this pull request Oct 21, 2026
…text init (#186)

checkCucumberQuarantine called SeleniumBootContext.getConfig(), which throws
when the framework is not initialised; the blanket catch swallowed it, so
quarantined scenarios ran. Guard with isInitialized(). Fixes the order-dependent
CucumberQuarantineTest failures that blocked #184/#185 CI.

Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
@shossain786
shossain786 merged commit 37f1330 into seleniumboot:master Oct 21, 2026
2 checks passed
@shossain786

Copy link
Copy Markdown
Contributor

Thanks @SumerManer-17, merged and nice work. Your note about the four CucumberQuarantineTest failures led us to a real bug (quarantine silently skipped before framework init), fixed in #186. If you'd like a follow-up, #165 still needs the flaky chart hidden when the history has no flaky data.

shossain786 added a commit that referenced this pull request Oct 21, 2026
Bump version across pom, README, docs-site; cut the 3.9.0 changelog and add missing entries (#188, #185, #186, #171, deps).

Co-authored-by: Claude Sonnet 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants