Control your smart home with hand gestures. No buttons, no voice, no phone — just a wave.
HouSign watches your camera in the background, detects hand gestures using MediaPipe, and fires actions in Home Assistant the moment it recognizes what you're doing.
- Runs quietly in the system tray — starts with Windows, stays out of your way
- Uses your webcam to track hand gestures in real time
- Sends commands to Home Assistant via WebSocket (lights, media players, scenes, scripts — anything)
- Supports an activation gesture (like a wake word, but for your hands) so it only listens when you want it to
- Plays sound feedback so you know when it picked up your gesture
- Comes with a clean settings UI to configure everything without touching JSON
Download HouSign-Setup.exe from Releases. Direct link - HouSign-Setup.exe, run it, enter your Home Assistant URL and token, done.
The installer handles everything — shortcuts, autostart option, default config.
git clone https://github.com/SmolinskiP/HouSign
cd HouSign
python -m venv venv
venv\Scripts\python.exe -m pip install -r requirements.txt
python ha_gestures/app.pyRequires Python 3.11.
On first run, open Settings from the tray menu and fill in:
- Home Assistant URL — e.g.
http://homeassistant.local:8123/ - Long-Lived Access Token — create one in HA under Profile → Security → Long-Lived Access Tokens
By default, HouSign uses an activation mode — it won't fire commands until you make a specific pose (like an open palm held for ~600ms). This prevents accidental triggers while you're just moving around. You can disable it and go always-listening if you prefer.
Each binding connects a gesture to a Home Assistant action:
| Field | Example |
|---|---|
| Gesture | open_palm |
| Mode | one_hand |
| Action type | service |
| Domain | light |
| Service | turn_off |
| Entity | light.living_room |
Execution modes:
- instant — fires once, immediately ends the session
- hold & repeat — keeps firing while you hold the gesture (great for dimming)
The tray icon shows the current runtime state and lets you open settings, start a preview, reload config, or quit.
- Windows 10/11 (64-bit)
- Webcam
- Home Assistant instance reachable on your local network
- MediaPipe — hand tracking
- Flet — settings UI
- pystray — system tray
- PyAudio — sound feedback
- PyInstaller — Windows packaging
If HouSign saves you a few trips to the light switch, consider buying me a coffee ☕
MIT — do whatever you want with it.