Skip to content

Validate actual browser reports and grouped observation cases - #21

Merged
PerchAnton merged 1 commit into
mainfrom
keytrail/strict-browser-report
Nov 4, 2026
Merged

PerchAnton merged 1 commit into
mainfrom
keytrail/strict-browser-report

Conversation

@PerchAnton

Copy link
Copy Markdown
Owner

A successful 175-test browser run was rejected by inspectReport() because three grouped-locator regression titles were missing from its strict engine-case list. Add the three exact titles and validate every actual browser JSON report in Linux and macOS CI before package consumers.

Validation:

  • Reproduced UNRECOGNIZED_ENGINE_CASE against the original Linux report from run 41316315577 (175 passed, no skips/flakes).
  • The same unmodified report now passes: 175 cases, 161 journeys and 14 engine checks.
  • Changing one title to an unknown case still fails; unit coverage also rejects retries and unexpected engine attachments.
  • Build, 44 unit tests and 26 script tests pass.

The 100 ms threshold and zero retries remain unchanged. No final 100-round run or release is part of this change. Historical release evidence does not qualify this revision.

@PerchAnton
PerchAnton merged commit 09e1dad into main Nov 4, 2026
6 of 8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant