[POC TEST] Canary Report - canary-poc-1778655746254

[raissanjay]

Canary Report - POC Test Cycle canary-poc-1778655746254

Stable baseline: v0.48.3
Canary version: v0.49.0-rc.1
Sample window: 2026-05-13T07:02:26Z -> 2026-05-13T07:02:36Z

---

Volume

Cohort	Sessions	Users
stable	5	5
canary	5	5

---

Summary - rate metrics

Metric	Stable	Canary	Delta	Status
Errors / session	0.000	0.400	+inf	FAIL
Sessions with errors	0.0%	40.0%	+40.0 pp	OK
cards_rendered fired	100.0%	100.0%	+0.0 pp	OK
target_missing fired	0.0%	0.0%	+0.0 pp	OK
fetch_fail fired	0.0%	0.0%	+0.0 pp	OK

---

Assertions - per-session pass rates

Check	Stable	Canary	Delta	Status
Container present	100.0%	100.0%	+0.0 pp	OK
Container has children	100.0%	100.0%	+0.0 pp	OK
All cards visible	100.0%	100.0%	+0.0 pp	OK
Filter panel match	100.0%	60.0%	-40.0 pp	FAIL
Paginator match	100.0%	100.0%	+0.0 pp	OK
Sort match	100.0%	100.0%	+0.0 pp	OK
Search match	100.0%	100.0%	+0.0 pp	OK
Loader cleared	100.0%	100.0%	+0.0 pp	OK
No error UI shown	100.0%	100.0%	+0.0 pp	OK

---

Top issues - canary cohort

Issue #1 - Cannot read property 'cards' of undefined

Field	Value
Source	main.js:1234
Canary occurrences	2
Stable occurrences	0
Affected canary users	2
Affected pages	/creativecloud.html (1), /summit/sessions.html (1)

---

Verdict

REVIEW BEFORE PROMOTION - 2 threshold breaches detected.

Threshold breaches

• Errors / session: stable=0, canary=0.400 - FAIL (errors only in canary)
• Filter panel match: -40.0 pp (threshold: >= -2 pp) - FAIL

Sample size

• 5 canary sessions / 5 distinct users
• 5 stable sessions / 5 distinct users

Review the data above and form a verdict.

cc @sanrai