A macOS menu-bar teacher. Hold Control + Option, ask out loud, and it looks at your screen, talks back, and points at the next control to use.
Specialized for video editing, UI design, and Blender. The Xcode target is still named StudioMate — same app.
Live: here-app-three.vercel.app
You need a Cloudflare Worker in front of Anthropic, AssemblyAI, and ElevenLabs. Keys stay on the Worker; the app only stores the Worker URL.
cd worker
npm install
npx wrangler login
npx wrangler deploy
npx wrangler secret put ANTHROPIC_API_KEY
npx wrangler secret put ASSEMBLYAI_API_KEY
npx wrangler secret put ELEVENLABS_API_KEYVoice ID is already in worker/wrangler.toml. For local Worker dev, put those three keys in worker/.dev.vars and run npx wrangler dev.
Then set WorkerBaseURL in StudioMate/Info.plist to the deployed URL (or http://localhost:8787). If you leave the placeholder, the menu panel will say so and chat/voice will not work.
open StudioMate.xcodeprojSelect the StudioMate scheme, set your signing team, Cmd+R. Prefer Xcode over xcodebuild so TCC permissions stick.
First run asks for microphone, accessibility, screen recording, and screen content. Screenshots happen after you release the hotkey (and once during the first-run pointing demo), not continuously.
npm install
npm run devMIT. Substantial derivative of farzaa/clicky — see LICENSE and NOTICE.md.