Repository navigation
Add local Cohere Vulkan helper for Voxtype - #617
Draft
ryanrhughes wants to merge 2 commits into
Draft
ryanrhughes wants to merge 2 commits into
ryanrhughes wants to merge 2 commits into
Conversation
This was referenced Sep 24, 2026
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Voxtype's packaged Cohere backend uses ONNX and does not offer Vulkan. Add a small persistent
transcribe-cpphelper that lets the existing Voxtype API client transcribe locally on Vulkan without a Voxtype fork or conflicting ggml libraries in one process.The package includes reviewed Rust source, a locked dependency graph, pinned Vulkan/SPIR-V headers, and a synthetic speech probe. The portable x86_64 build rejects silent CPU fallback and software Vulkan renderers. It binds only loopback and logs timings without logging speech. Model weights are downloaded and verified by the paired Omarchy installer, not bundled here.
Cohere recordings are partitioned at quiet boundaries into segments of at most 35 seconds. This fixes the missing middle passages observed on roughly one-minute inputs. On nine excerpts totaling 302 seconds, three runs each, caption WER dropped from 18.30% to 1.86%; the three long clips took median 1.65–1.81 seconds on Intel Arc B390. Caption agreement is an approximate measure, not a general accuracy claim.
Validation:
makepkg --cleanbuild --nodepsbuild, including Rust segmentation tests; runtime shared libraries resolved.cargo fmt --check, release Clippy with warnings denied, HTTP validation cases, and the actual Voxtype 1.0.1 client passed on the source build.Draft companion to omacom/omarchy#13098. This recipe is edge-only; review and package availability are required before rollout. No repository publication or release has been performed. Other GPU vendors and architectures still need validation.