Skip to content

docs(testing): log the macOS RC e2e passes from v1.10.0-rc.3 to v2.0.0-rc.13 - #991

Merged
EtienneLescot merged 2 commits into
mainfrom
docs/e2e-v2.0.0-rc.13-macos
Oct 3, 2026
Merged

EtienneLescot merged 2 commits into
mainfrom
docs/e2e-v2.0.0-rc.13-macos

Conversation

@EtienneLescot

@EtienneLescot EtienneLescot commented Oct 3, 2026 •

Copy link
Copy Markdown
Collaborator

Brings the results log up to date with every macOS release-candidate pass run from Claude sessions on the Mac mini M1. Seven rows, each placed at its date.

Row Build Verdict Why it was missing
2026-08-22 v1.10.0-rc.3, notarized DMG Partial, no defect (caption anchoring measured on exported frames) Written in #486, dropped by a merge of main into that branch; #486 was then closed as "already logged", which was true only of the 2026-08-23 window-capture slice
2026-09-05 v1.11.0-rc.1, notarized CI DMG Partial: 1 blocker (#616, fixed by #618), 4 minor Written on claude/e2e-results-v1-11-0-rc1, never opened as a PR
2026-09-07 (x2) v1.11.0-rc.1 local retest with #618, and its correction STT works; a system-audio defect retracted Same branch
2026-10-01 v2.0.0-rc.8, notarized DMG Partial: 1 should-fix (#965), 4 minor (#966 to #969), all fixed since Only the Windows rc.8 row was logged
2026-10-02 v2.0.0-rc.12, notarized DMG Partial: 1 minor regression, not filed Never logged
2026-10-03 v2.0.0-rc.13, notarized DMG Partial, no defect This session

Worth a look: the rc.12 pass found the preview lagging 1.8 to 3.2 s of source inside a 4x speed region (0.6 to 1.8 s on rc.8, same project), suspected e358d771 / b519f236. No issue was filed, and the rc.13 pass did not re-measure it.

Left out on purpose: a v2.0.0-rc.1 macOS pass whose report says it was driven by another tool (ZCode), not a Claude session, and a 2026-08-21 pass on a dev build of main (not a release candidate).

All rows come from the session transcripts and the reports written at the time; text written for this PR uses no em dashes.

Summary by CodeRabbit

  • Documentation
    • Added manual E2E test records covering macOS caption placement and window capture, Windows validation after v1.10.0, AV1 clip switching, and subsequent release-candidate runs.
    • Added v2.0.0 results for macOS release candidates 8, 12, and 13, and updated the Windows rc.13 results with revised defect and pass details.
    • Corrected the results log to retract an earlier report of a synthetic-tone system-audio defect.

@coderabbitai

coderabbitai Bot commented Oct 3, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

Navigate logical layers of code changes, visualize relationships, and explore their blast radius.

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: d128cc42-1ca7-490f-b40b-615371f13b9f
📥 Commits

Reviewing files that changed from the base of the PR and between 3d9d332 and b0ba3b2.

📒 Files selected for processing (1)
  • technical-documentation/testing/manual-e2e-checklist.md

Included review availability: This review used your included allowance. Your plan provides up to 8 included reviews per hour; 5 remain after this review.


📝 Walkthrough

Walkthrough

The manual E2E checklist adds and updates results for macOS and Windows builds, AV1 playback, and system-audio testing. It records observed defects, fixes, regressions, corrections, and unrun checks.

Changes

Manual E2E results

Layer / File(s) Summary
Update manual E2E release records
technical-documentation/testing/manual-e2e-checklist.md
The results log adds and revises macOS and Windows test records, AV1 playback findings, and release-candidate results. It expands caption-placement measurements and retracts a reported synthetic-tone system-audio defect after a browser and YouTube capture passed.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~3 minutes

Change: Other

Merge Risk: ⚪ Minimal · up to b0ba3

The PR adds scoped manual test results and records unrun checks; no demonstrated release-process or product issue remains to block merging.

Architecture Summary

Architecture risk: 🔵 Low · up to 3d9d3

The change affects 1 system.

Changed systems: technical-documentation

Architecture concerns
No architecture-level concerns identified.

Review details

Systems and components

  • observed — technical-documentation (service) was modified; 1 changed file maps to changed impact.

Before / after behavior

  • observed — Modified behavior in technical-documentation/testing/manual-e2e-checklist.md: Adds a macOS rc.13 results row describing the scoped checks and outcomes, including HUD exclusion across an editor round trip, camera-off handling without a camera, editor shutdown, localized UI, caption restoration, playback, unreadable-media reporting, and export. It also notes limitations and observations outside the tested scope.
🚥 Pre-merge checks | ✅ 5
✅ Passed checks (5 passed)
Check name Status Explanation
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Title check ✅ Passed The title clearly describes the main change: logging macOS release-candidate E2E results through v2.0.0-rc.13.
Description check ✅ Passed The description gives a detailed summary, explains the added results and their provenance, and identifies untested areas and a known measurement gap. It does not use the template headings or state the…
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autopilot · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

…ults log

Adds the rows for v1.10.0-rc.3 (lost in a merge of #486), v1.11.0-rc.1 and its retest (written on a branch never opened as a PR), v2.0.0-rc.8 and v2.0.0-rc.12, and notes that the rc.13 row did not re-measure the 4x preview lag rc.12 found.
@EtienneLescot EtienneLescot changed the title docs(testing): log the v2.0.0-rc.13 macOS e2e pass docs(testing): log the macOS RC e2e passes from v1.10.0-rc.3 to v2.0.0-rc.13 Oct 3, 2026
@EtienneLescot
EtienneLescot merged commit 40d062f into main Oct 3, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant