Repository navigation
test(console): fold three single-case browser files into their homes - #2736
Conversation
Create Agent mode defaults and the Pod quota denied read move into console-create-agent-provisioning-400; the missing-binding Deploy gate moves into console-agent-saves. Each case keeps its own fixture and setup. checks-browser-2 drops the three removed files.
|
🦞👀 Pull request received. I will update this pull request when review starts. ClawSweeper review completeClawSweeper finished reviewing this revision. The review result is being finalized. |
freeqaz-openai
left a comment
There was a problem hiding this comment.
Free's clanker here. I checked the actual base Console Browser 2 results (artifact 12098193551) and this PR's Console Browser 2 artifact (ID 12098143997). Both ran 323 tests with no failures or skips. All 80 cases in the five affected files match across the move; that comparison also rejects a changed quota assertion or a missing test replaced by a duplicate. The three moved test bodies are unchanged.
The concrete saving is 19 file runs down to 16, removing three normal Chromium launches. Tests keep separate browser contexts and app fixtures, but no longer get the three extra browser-process resets. I wouldn't claim a wall-clock speedup from this pair of runs. The comparison is for GitHub's tested merge 77396d46, not a claim that every later main revision was tested.
|
Codex review: needs maintainer review before merge. What this changesThis PR moves execution-mode, quota-access, and Secret-gate tests into two existing browser test files and removes their former suite entries. Review scores
ProductKind: Test only · Worth it: Yes · Fix scope: Complete Merge readiness✅ Ready for maintainer review Keep this PR open: it preserves the regression cases while removing three separate browser-file runs, and I found no introduced defect. Priority: P3 Before mergeNone. FindingsNone. Agent review detailsHow this fits togetherThe Console Browser 2 manifest selects browser test files; each file shares a Chromium process while its tests retain separate browser contexts and application fixtures. flowchart LR
A[Console Browser 2 manifest] --> B[CI test runner]
B --> C[Two destination test files]
C --> D[Shared Chromium per file]
D --> E[Separate browser contexts]
E --> F[Console and application fixtures]
Technical reviewBest possible solution: Land the focused consolidation with its existing regression coverage and browser-context isolation preserved. Do we have a high-confidence way to reproduce the issue? No product bug is claimed; source inspection confirms the separate-file overhead addressed by this PR. Is this the best way to solve the issue? The move reuses the existing file-level browser owner, preserves each test's setup and assertions, and removes the replaced registrations without adding another abstraction. AGENTS.md: found and applied where relevant. Codex review notes: model internal, reasoning medium; reviewed against 3d33ba8b51a0. Provenance checked
TestingProof path: in-process harness. SecurityNone. EvidenceWhat I checked:
Review metrics
LabelsLabel changes:
Label justifications:
Rating scale6/6 🦀 challenger crab · 5/6 🦞 diamond lobster · 4/6 🐚 platinum hermit · 3/6 🦐 gold shrimp · 2/6 🦪 silver shellfish · 1/6 🧂 unranked krab. Overall follows the weaker of proof and patch quality; ✨ marks media proof (a screenshot, video, or linked artifact) that directly shows the changed behavior. WorkflowClawSweeper edits this one comment on every review. Comment Reviewed October 17, 2026, 7:11 AM ET / 11:11 UTC. |
freeqaz-openai
left a comment
There was a problem hiding this comment.
Free’s clanker here. Approved at 5b55cf1a. I compared the moved test bodies with current main: the assertions are preserved, the three old suite entries are gone, and the separately maintained focus test stays in place. The before-and-after browser results show the same 323 passing tests. The measurable improvement is three fewer Chromium launches, not a promised wall-clock speedup.
CI Required and Console Browser 2 passed. I read ClawSweeper’s complete review of this head; its “Before merge” and “Findings” sections are both empty.
Review follow-up: the oldest of the five runs is #2736's own merge commit.
* test(ci): refresh file durations Recompute every row from the five green main runs after #2736 (c085982 and the four before it). provisioning-400 grew from 12.2 s to 35.3 s once #2736 folded cases into it, ci-openshell from 0.1 s to 7.3 s, and the shared lanes run faster overall, so 145 of 209 rows moved. Add rows for the three shared browser files that had none (agents-list-return, agent-deploy-focus, refocus-focus). credential-source-api gets no row: it is not in checks-baseline-1's parallelFiles, so it runs alone and its row would not be read. * test(ci): name the durations window from #2736 on Review follow-up: the oldest of the five runs is #2736's own merge commit.
Problem
Three browser test files added on 10-16/17 each hold one or two cases on a surface that an existing file already covers. Each costs its own Chromium launch, its own Console Browser 2 slot and its own suite entry.
Change
console-create-agent-mode-defaults.test.mjs(test: pin conditions from the 10-17 night fixes #2703) moves intoconsole-create-agent-provisioning-400.test.mjs, next to the other Create Agent execution-mode cases.console-create-agent-quota-access.test.mjs(test: pin conditions from the 10-17 morning fixes #2732) moves intoconsole-create-agent-provisioning-400.test.mjs. The existing Pod quota loop is inconsole-agents-2.test.mjs, which open PRs fix: preserve native plugin permissions across Harness selection #2409 and fix: preserve native plugin permissions across Harness selection and admission #2258 edit, so it is not used here.console-agent-unsaved-secret-gate.test.mjs(test: pin conditions from the 10-17 morning fixes #2732) moves intoconsole-agent-saves.test.mjs, after the other unsaved channel Secret gate cases. That file already defines the sameUNSAVED_SECRETS_GATEandenvBinding.checks-browser-2.jsondrops the three files.Each moved test is copied verbatim and keeps its own fixture and setup (Sandbox Driver, default Presets, routed Installation answers, viewport). No test is renamed.
Left alone, because their home files are being edited elsewhere:
console-agent-deploy-focus.test.mjs: its home,console-agent-draft-guards, is edited by feat: add per-agent sandbox network policies and denial review #2599 and feat: assign configured OpenClaw roles to Agent users #906.console-agents-list-return.test.mjs: being edited in another branch.console-refocus-focus.test.mjs: its home,console-retained-revalidation, is edited by feat: assign configured OpenClaw roles to Agent users #906 and another branch.Verification
node scripts/ci/run-tests.mjs audit: no issues. eslint and prettier are clean on the touched files.console-create-agent-provisioning-400passed 20/20 (36 tests each, 38-40 s per run) andconsole-agent-savespassed 20/20 (44 tests each, 44-49 s per run).console-create-agent-provisioning-400went from 29 s to 36 s and ends at 76 s, beforeconsole-agents-2(79 s), which still sets the lane.Risks
Test-only. In Console Browser 2,
console-create-agent-provisioning-400grew by 6 s in CI and still ends beforeconsole-agents-2. An internal review approved the change, with no changes requested. Itsfile-durations.jsonrow (12.2 s) was already stale before this change, and it is not refreshed here.