Repository navigation
Add Timeline Origin Selector option - #4
Open
michaelwasserman wants to merge 1 commit into
Open
michaelwasserman wants to merge 1 commit into
michaelwasserman wants to merge 1 commit into
Conversation
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
DO NOT MERGE YET, THIS IS UNVERIFIED AND NEEDS MORE INVESTIGATION
Adds an Options dropdown allowing users to switch the timeline origin for event timestamps between session start (onstart) and audio start (audiostart), dynamically updating transcript markers across the timeline.
AFAICT, using
onstartas the origin alignsspeechStartTimeandspeechEndTimemuch closer to the acoustic spikes thanaudiostart, due to renderer dispatch lag.Chromium should potentially also backdate
audiostart.timeStamp(related to crbug.com/564526939)audiostart.timeStampas the baseline, Under DOM Event rules,audiostartis created whenAudioStarted()runs on the renderer main thread, after buffering and IPC, causing all stream-relative timestamps (speechStartTime) to be misplaced ~150–250ms to the right of actual audio spikes.reillyg@) noted:audiostart(e.g.event.captureStartTime), orsessionAudioTimeOriginattribute onSpeechRecognitioninDOMHighResTimeStampcoordinates.Perhaps the W3C Web Speech API Spec should clarify session start (onstart) and audio start (audiostart) relation to document time, or indicate that those event timestamps should be carried over from their backend initiation?
speechStartTimeandspeechEndTime(in seconds) along the session audio timeline (t = 0.0s at the first audio frame consumed).audiostart.timeStamp. While the original explainer suggested adding offsets toaudiostart.timeStampto calculate absolute times, neither the explainer nor the spec accounts for the ~150–250ms capture & IPC pipeline latency.performance.timeOrigin/performance.now()), or align it with aMediaStreamTrack. e.g. maybe offering an explicit way to query the document-relative time origin of the session audio timeline (e.g.SpeechRecognition.sessionAudioTimeOriginor clarifyingaudiostartsemantics).