Skip to content

Re-enable short Whisper filler prompts for um/uh retention - #59

Merged
wassgha merged 1 commit into
mainfrom
cursor/safer-verbatim-prompt-f275
Aug 2, 2026
Merged

wassgha merged 1 commit into
mainfrom
cursor/safer-verbatim-prompt-f275

Conversation

@wassgha

@wassgha wassgha commented Aug 2, 2026

Copy link
Copy Markdown
Owner

Summary

Stock Whisper cleans disfluencies, so Remove fillers often has nothing to cut. This restores <|startofprev|> filler prompting for Whisper Base/Small, but with the safer short prompts we learned we need:

  • Short language-specific prompts (Um, uh, hmm, er, ah. and DE/FR/ES/ZH equivalents)
  • Hard length cap (≤32 chars) — the long OpenAI-style prompt previously truncated multi-speaker / long-form ASR
  • No I'm … openers (those seeded "I'm sorry" hallucination loops)

Parakeet is unchanged (no Whisper prompt path).

Changes

  • keepFillers flag on Whisper models + whisperFillerPrompt(model, language)
  • Worker uses the resolved short prompt via existing buildPromptedDecoderIds
  • Regression test now requires short prompts (instead of forbidding all prompts)

Test plan

  • npx tsx tests/models-test.ts
  • npx tsx tests/vad-regression-test.ts
  • npx tsx tests/fillers-test.ts
  • Manual: transcribe a clip with audible um/uh on Whisper Base and confirm fillers appear so Remove fillers is enabled
  • Manual: multi-speaker clip still keeps both speakers (no second-speaker drop)
Open in Web Open in Cursor 

Stock Whisper drops disfluencies, so Remove fillers often has nothing to
cut. Restore <|startofprev|> conditioning with short, language-specific
prompts (no long OpenAI-style text, no "I'm" openers) so fillers stay in
the transcript without truncating multi-speaker clips.

Co-authored-by: Wassim Gharbi <wassgha@gmail.com>
@wassgha
wassgha marked this pull request as ready for review August 2, 2026 21:20
@wassgha
wassgha merged commit 0d13336 into main Aug 2, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants