An intelligent, multimodal agent that "sees" an Android screen using ADB and "thinks" to autonomously perform tasks on a mobile device.
The system follows a See-Think-Act loop:
- Observer: Captures a screenshot via ADB.
- Brain: Sends the image + goal to an AI model
- Executor: Translates AI decisions into physical taps and swipes.
core/: The logic engine (Analyzer, Generator, Agent).utils/: Helper utilities for logging and APK manipulation.data/: Storage for APKs, screenshots, and execution logs.
- Python 3.10+
- ADB (Android Debug Bridge) installed and in your PATH.
- Apktool (for the Analyzer module).
- Clone the repository.
- Install dependencies:
pip install -r requirements.txt
- Create a .env file in the root:
GEMINI_API_KEY=your_api_key_here ANDROID_DEVICE_ID=your_device_serial