Skip to content

Default dictation to verified Cohere Vulkan, paste and Atreyu visuals - #13098

Draft
ryanrhughes wants to merge 2 commits into
quattrofrom
voxtype-cohere-vulkan
Draft

ryanrhughes wants to merge 2 commits into
quattrofrom
voxtype-cohere-vulkan

Conversation

@ryanrhughes

Copy link
Copy Markdown
Collaborator

New Voxtype installs should paste dictation, provide clear recording feedback, and prefer local Cohere when the machine can actually transcribe with Vulkan. This adds those defaults while preserving existing configuration choices.

  • Install and verify the Cohere Q4_K_M model, then require a successful spoken Vulkan probe before selecting it. Keep local Whisper available when hardware, downloads, inference, or helper startup fail. Add reversible omarchy voxtype cohere enable|disable commands with recording-state guards.
  • Default new configurations to clipboard paste and a first-party shell visualizer. Adapt Atreyu's Mirrored spectrum for recording and Bumper for transcription, including its bottom-edge glow, theme colors, and fades. The overlay follows the focused monitor, takes no input, respects --no-osd, and stops rendering when idle or disconnected. Atreyu's MIT notice is included.
  • Use Voxtype 1.0.1's existing API client with a loopback helper; no Voxtype fork is needed. The helper segments long recordings to avoid Cohere's missing-passage behavior.

Depends on omacom/omarchy-pkgs#617. Keep this draft until that helper package is reviewed and available in the intended channel; existing users are not silently migrated.

Validation:

  • Isolated setup tests pass for fresh installs, preservation of existing settings, absent Vulkan/package, failed download/checksum/probe/service, rollback, recording begun during setup, startup fallback, and removal of cloud credentials for local inference.
  • Plugin manifest validation and shell syntax checks pass. The helper package builds and passes its real speech probe on Intel Arc B390; the running Voxtype client also transcribes through it successfully.
  • Live screenshots and short recordings inspected for Mirrored Spectrum, the moving transcription bumper, fade to idle, suppression, and unchanged keyboard focus. Only the existing Omarchy shell process renders the overlay.
  • The full CLI suite stops at vscode generated theme references current theme file; the identical failure reproduces on unchanged base commit 28ceaae7.

Implementation and operating details are in docs/dictation.md. Hardware inference has been verified on Intel Arc B390; other GPUs still require rollout testing, with setup/startup fallback retained.

# - clipboard: Copies text to clipboard (requires wl-copy)
mode = "type"
mode = "paste"

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
paste_keys = "super+v"

@jandrusk

jandrusk commented Oct 8, 2026

Copy link
Copy Markdown

A couple of things to sort out before this comes out of draft:

  • Qt 6.12 palette. Fix shell palette collision with Qt 6.12 #14553 (merged today) requires import qs.Commons as Commons and Commons.Color.* everywhere, because Qt 6.12's QtQuick Color type shadows the bare singleton. The new voxtype QML still uses bare Color.: about 9 refs in VoiceNode.qml, 4 in Service.qml, and 1 each in SpectrumVisualizer.qml and BumperVisualizer.qml. On a Qt 6.12 build the visualizer colors would come out undefined.
  • Overlap with Add selectable Voxtype and Superwhisper dictation #14552. DHH's selectable Voxtype/Superwhisper dictation PR rewrites bin/omarchy-voxtype-install, bin/omarchy-voxtype-remove and default/voxtype/config.toml too, so whichever lands second will need to be reconciled (especially the paste and Cohere defaults in config.toml).
  • Add local Cohere Vulkan helper for Voxtype omarchy-pkgs#617 is still a draft, so the dependency noted in the description is still open.

@chessing234 chessing234 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please roll back when restarting Voxtype fails after the Cohere backend has started. The installer says the existing Whisper fallback is retained, but the new client drop-in and backend unit are already on disk when systemctl --user restart voxtype.service fails. I reproduced this in the setup fixture by failing just that restart. Restore the previous unit and drop-in, reload systemd, and restart Voxtype with the restored configuration.

@chessing234

chessing234 commented Nov 8, 2026 •

Copy link
Copy Markdown
Contributor

Could you review the rollback in #18126? It is based directly on this branch. The regression fails the Voxtype restart after Cohere starts, then verifies that the previous unit, drop-in, and running configuration are restored.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants