Skip to content

docs(testing): log the v2.1.0 Windows e2e pass on build run 38252812147 - #1132

Merged
EtienneLescot merged 1 commit into
mainfrom
docs/e2e-v2.1.0-38252812147-windows
Oct 13, 2026
Merged

EtienneLescot merged 1 commit into
mainfrom
docs/e2e-v2.1.0-38252812147-windows

Conversation

@EtienneLescot

@EtienneLescot EtienneLescot commented Oct 12, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Results row for the computer-use e2e pass on the v2.1.0 candidate: build run 38252812147 (release/v2.1.0 @ 9c55596e1), Windows 11 x64 installer. Verdict Fail: two should-fix defects, one medium, six minor. Coverage and skips are listed in the row.

Defects found (no issue opened)

1. MCP stdio edit to a project open in the editor is lost. Should-fix.

  • Open a project in the editor, then from a stdio MCP client (Openscreen.exe mcp): createCheckpoint + addTrim on that projectId.
  • The trim is accepted ("this project is not open in the editor"); listProjects reports open: false.
  • Change anything in the editor: the autosave rewrites the file without the trim.
  • Evidence: project file written by MCP at 17:07:25 with trim_6a9cc2f4…, rewritten by the editor at 17:07:44 without it. Checklist check "refused rather than overwriting" fails.

2. Screen track drifts behind audio and webcam on a long take under load (#945). Should-fix.

  • Full-screen take with webcam and system audio, 10:25, with a CLI export loop running (CPU ~40 %).
  • Read the HUD timer filmed in the screen track at 60 fps around each second flip.
  • Flips sit at +0.017 s at 0:21 and 5:01, then −0.033 at 6:16, −0.083 at 6:51, −0.150 at 7:31, −0.200 at 10:01.
  • Evidence: screen 625.456 s, audio 625.643 s, webcam 625.677 s; TTS markers show audio losing only 43 ms over the take.

3. A CLI/MCP process takes the GUI's Local Storage. Medium.

  • Run any openscreen mcp (or other CLI command) process, then start the GUI app.
  • Restart Manager names the … mcp process as holder of %APPDATA%\openscreen\Local Storage\leveldb\LOCK; the GUI falls back to in-memory storage.
  • Visible effect: "Use your system language?" returns on every launch after "Keep current language" (3 clean quits). The stdio server also logs Unable to move the cache: Accès refusé.
  • Cause in code: CLI mode skips the single-instance lock and shares userData (electron/main.ts, the requestSingleInstanceLock branch). The holder here was a dev electron … mcp from another worktree, but the installed build follows the same path.

Minor

  • Two speed regions with the same speed dragged into each other overlap (1.27 s) instead of stopping; the merged pill then edits both. Different speeds stop flush as expected.
  • A project's first chat message shows a raw ISO UTC time (2026-10-12T15:13:48.517Z), other messages show 17:13:49.
  • stopRecording returned 1 zoom for 2 recorded clicks (the first at 1.9 s got none), while its description promises one per click.
  • MCP listSources lists 3 windows where the HUD selector lists 5; startRecording on the Settings window fails with "No window title contains".
  • Open project dialog: Enter in the search box does not open the single match, despite "Enter to open".
  • HUD dropped near the top of the screen moves about 68 px down when the language menu or device panel opens, and stays there.
  • Doc drift: the camera shape choices are Square / Original, not Rectangle / Square.

Open question: the main export ran 2451 frames at 30 fps against 2444.9 predicted, +6 frames over 13 segment boundaries.

Related issue

Part of the v2.1.0 release candidate QA. Refs #945.

Type of change

  • Bug fix
  • Feature
  • Enhancement
  • Documentation
  • Refactor / maintenance
  • Performance
  • Security

Release impact

  • Patch
  • Minor
  • Major / breaking change
  • No release note needed

Desktop impact

  • Windows
  • macOS
  • Linux
  • Installer / packaging
  • Not platform-specific

Testing

Manual pass through computer-use on the installed CI artifact, measurements with ffprobe/ffmpeg on the files. Docs-only change.

🤖 Generated with Claude Code

Summary by CodeRabbit

  • Documentation
    • Added a Windows 11 v2.1.0 candidate test run to the manual testing log. It records a partial end-to-end pass, checks passed or skipped, and findings including lost edits to open projects after autosave, screen-capture timing drift during a long loaded take, shared Chromium Local Storage, and other minor issues.

@coderabbitai

coderabbitai Bot commented Oct 12, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration
  • Configuration used: defaults
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: b7483a13-7e9a-4fcf-851f-37e353f1dcd7
📥 Commits

Reviewing files that changed from the base of the PR and between 38401fd and 6b66d3b.

📒 Files selected for processing (1)
  • technical-documentation/testing/manual-e2e-checklist.md
🚧 Files skipped from review as they are similar to previous changes (1)
  • technical-documentation/testing/manual-e2e-checklist.md

Included review availability: This review used your included allowance. Your plan provides up to 8 included reviews per hour; 7 remain after this review.

📝 Walkthrough

The manual end-to-end checklist now records a Windows 11 v2.1.0 candidate run. The entry notes a partial end-to-end pass, reported issues, and checks that passed or were skipped.

Changes: Manual end-to-end results

Layer / File(s) Summary
Record Windows run results
technical-documentation/testing/manual-e2e-checklist.md
The checklist adds the test setup, two reported should-fix issues, a medium issue involving shared Chromium Local Storage, additional minor findings, and passed or skipped checks.

Priority: ⬇️ Low

Estimated code review effort: 1 (Trivial) | ~2 minutes

Change: Other

Merge Risk: ⚪ Minimal · up to 6b66d

This is a docs-only update recording manual test results for the v2.1.0 candidate. It has no runtime impact and is safe to merge.

Pre-merge checks · Passed 5
Passed Passed checks (5 passed)
Check name Status Explanation
Title check Passed The title clearly and concisely identifies the documentation change: recording the Windows end-to-end pass for the v2.1.0 candidate build.
Description check Passed The description is complete and follows the repository template. It includes the summary, related issue reference, change type, release impact, desktop impact, testing details, and the reported findin…
Docstring Coverage Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff. Analyzed 0 functions across 0…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@EtienneLescot
EtienneLescot force-pushed the docs/e2e-v2.1.0-38252812147-windows branch from 38401fd to 6b66d3b Compare October 13, 2026 08:24
@EtienneLescot
EtienneLescot merged commit 912b448 into main Oct 13, 2026
19 checks passed
@EtienneLescot
EtienneLescot deleted the docs/e2e-v2.1.0-38252812147-windows branch October 13, 2026 08:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant