Skip to content

Synchronize 3D architecture stories with audio (v1.20.0) - #42

Merged
tomqwu merged 6 commits into
mainfrom
codex/3d-narration-sync
Sep 9, 2026
Merged

tomqwu merged 6 commits into
mainfrom
codex/3d-narration-sync

Conversation

@tomqwu

@tomqwu tomqwu commented Sep 9, 2026 •

Copy link
Copy Markdown
Owner

Playing an architecture explanation previously paused its 3D story. All four scenarios now use the recording as their single clock: the spoken section, component highlights, arrows and captions advance together. Story controls seek, pause, replay and change the same audio; inspection pauses it and Explore without audio restores the original walkthrough.

The 24 visual sections use exact caption anchors and grouped focus where the recording discusses multiple components. Denial never invokes a tool, and the failed-proof story stays on hold while narration describes a conditional passing alternative. Reduced motion retains static highlights, and changed captions fall back to a static overview. Narration can begin before model loading finishes; paused scenes redraw only when the view changes, and resuming clears the previous inspection highlight.

Validation: Chromium and WebKit with actual MP3s across all 24 sections, native playback boundaries, packet movement, pause/seek/speed/replay, final stop, early playback during model loading, inspection, responsive controls and invalid-caption fallback; existing 3D checks including idle rendering and camera interaction; all 109 presenter notes and 16 pages; all nine 2D diagrams and 78 cues; site/publication checks; release packaging tests. CI includes the new audio-story regression suite.

v1.20.0 updates the shared release record and narration bundle. Accepted recordings and PDF editions remain unchanged. Original renderer/style snapshots preserve the existing silent film's input hashes; the film was not regenerated.

@tomqwu
tomqwu merged commit de5f0ee into main Sep 9, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant