Skip to content

docs: audit real-paper Electron journey - #54

Draft
dkritarth wants to merge 6 commits into
masterfrom
codex/issue-26-real-paper-audit
Draft

docs: audit real-paper Electron journey#54
dkritarth wants to merge 6 commits into
masterfrom
codex/issue-26-real-paper-audit

Conversation

@dkritarth

@dkritarth dkritarth commented Aug 22, 2026

Copy link
Copy Markdown
Owner

Closes #26

User outcome

Vellum now has evidence-backed current truth for the real Electron journey at a21d596: the unmodified app fails before ingest, and every reachable result or blocked downstream step is recorded without claiming unit tests as product proof.

Scope

Non-goals: this PR fixes no product defect, changes no runtime code, and does not claim reader, Ask, or persistence behavior works.

Acceptance criteria

Automated verification

  • Reproducible baselines recorded before any temporary audit bypass.
  • Focused test: npx vitest run core/acp/stdio-client.test.ts — 18/18 passed.
  • npm test — final run 147/147 across 24 files. Initial run was 146/147 due one ACP disposal timing failure; focused and full reruns passed.
  • npm run typecheck — passed.
  • npm run build — passed and reproduced [S0-AUDIT] Electron dev boot cannot load preload bridge #51 by emitting out/preload/preload.mjs while main expects index.js.
  • git diff --check master...HEAD — passed.

Existing jsdom canvas-not-implemented stderr remains test noise and is not treated as live PDF proof.

Live Electron verification

  1. Created detached worktree at exact a21d596; confirmed isolated data/ absent and normal checkout data untouched.
  2. Launched unmodified Electron production/dev output; observed bridge: … and missing-preload console errors ([S0-AUDIT] Electron dev boot cannot load preload bridge #51).
  3. Used a detached-worktree-only preload-path bypass to expose the shell; observed bridge: pong and valid empty reader.
  4. Clicked Create through the real renderer; visible and accessibility text remained unchanged ([S0-AUDIT] Create control cannot start paper ingest #53).
  5. Clicked Library; observed blank renderer/undefined bridge without bypass and Could not load your library. plus native-binding error with preload bypass ([S0-AUDIT] Electron dev boot cannot load preload bridge #51/[S0-AUDIT] Bundled better-sqlite3 cannot load native binding in Electron #52).
  6. Restarted isolated Electron repeatedly; boot and DB failures reproduced. No paper/chat state could be created.

Exact action transcript: docs/verification/issue-26/interaction-journal.json.

Visual and console evidence

  • docs/verification/issue-26/01-preload-failure.png — unmodified app, bridge: ….
  • docs/verification/issue-26/02-empty-state.png — empty reader after preload-only bypass, bridge: pong.
  • docs/verification/issue-26/main-console.txt — preload and native-binding errors.
  • docs/verification/issue-26/controller-console.txt — semantic Create click completed with createChanged: false.
  • docs/verification/issue-26/last-renderer-console.json — captured post-load renderer window had no page errors after bypass.

Real-paper / ACP evidence

Planned paper: arXiv 1706.03762v7, Attention Is All You Need. Title, authors, version, length, and factual grounding targets are sourced from the official arXiv record in the audit report.

The paper was not ingested. Signed-in Codex Ask was not reached. Prior issue #25's ACP smoke is not substituted for paper-grounded Electron evidence.

Limitations and follow-ups

PR remains draft while the two unchecked acceptance criteria remain unmet.

Independent review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[S0-02] Audit complete real-paper Electron journey and record every failure

1 participant