Skip to content

Add local voice dictation to message composer#2742

Open
JoelCarriere wants to merge 1 commit into
block:mainfrom
JoelCarriere:feature/composer-voice-dictation
Open

Add local voice dictation to message composer#2742
JoelCarriere wants to merge 1 commit into
block:mainfrom
JoelCarriere:feature/composer-voice-dictation

Conversation

@JoelCarriere

@JoelCarriere JoelCarriere commented Jul 24, 2026

Copy link
Copy Markdown

Summary

  • add a microphone control to channel, DM, and thread message composers
  • transcribe microphone audio with Buzz's existing local Parakeet STT model
  • insert finalized speech at the current editor selection before sending through the normal message and ACP flow
  • keep composer dictation on an isolated native PCM/STT path so microphone audio never enters the huddle relay
  • expose accessible starting, recording, and finishing states and prevent sending until the final utterance has flushed
  • share the low-level PCM capture plumbing with huddles without changing their push-to-talk behavior

Why

ACP agents consume the text Buzz sends them, but the desktop composer had no voice-to-text input. Buzz already ships an on-device speech model for huddles, so composer dictation can reuse that local capability without adding a cloud transcription dependency or another API key.

User impact

Users can dictate a draft, review or edit the resulting text, and then send it to people or connected agents through the existing message path. The first use may briefly wait for the local speech model download, and macOS will request microphone permission.

Validation

  • pnpm -C desktop test — 3,487 passed
  • pnpm -C desktop typecheck
  • pnpm -C desktop build
  • pnpm -C desktop check
  • cargo fmt --manifest-path desktop/src-tauri/Cargo.toml --all -- --check
  • cargo check --manifest-path desktop/src-tauri/Cargo.toml
  • focused dictation Rust tests — 2 passed
  • pre-push desktop Tauri suite — 1,628 passed, 14 ignored
  • Playwright dictation flow covering start, transcript insertion, stop/finalization, and send gating
  • rendered desktop composer screenshot

Manual validation

  • Confirmed physical-microphone transcription and the macOS permission prompt in the native Buzz Dev build

@JoelCarriere

Copy link
Copy Markdown
Author

Screenshot

Composer microphone control

Voice dictation microphone beside the Send button

Signed-off-by: Joel Carriere <104279162+JoelCarriere@users.noreply.github.com>
@JoelCarriere
JoelCarriere force-pushed the feature/composer-voice-dictation branch from fff2d04 to c82d762 Compare July 24, 2026 18:40
@JoelCarriere
JoelCarriere marked this pull request as ready for review July 24, 2026 18:43
@JoelCarriere
JoelCarriere requested a review from a team as a code owner July 24, 2026 18:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant