Welcome to Tono, an innovative language learning app that combines advanced YOLO11 object detection with interactive Chinese language learning features. Transform your iOS device into an intelligent language learning tool that helps you learn Chinese vocabulary naturally through real-world object detection.
- Real-Time Object Detection & Translation: Instantly detect objects and see their Chinese translations
- Interactive Learning: Tap on detected objects to:
- View Chinese translations with pinyin
- Hear native pronunciations
- Practice your own pronunciation
- Save items to your personal collection
- Spaced Repetition: Smart review system helps you remember vocabulary effectively
- Multiple AI Models: Choose from various YOLO11 models for optimal performance:
- YOLO11n (fastest)
- YOLO11s (balanced speed/accuracy)
- YOLO11m (balanced)
- YOLO11l (accurate)
- YOLO11x (most accurate)
- AR Integration: Place 3D Chinese labels in your environment for immersive learning
- Offline Support: Core features work without internet connection
- Xcode: Latest version from the Mac App Store
- iOS Device: iPhone or iPad running iOS 16.0 or later
- Apple Developer Account: Free account for testing (Sign up here)
-
Clone the Repository:
git clone git@github.com:Audacity88/Tono.git
-
Open the Project:
- Open
Tono.xcodeprojin Xcode - Select your development team in project settings
- Open
-
Add YOLO11 Models: Download and add the required YOLO11 models to the
Tono/Modelsdirectory:- yolo11n.mlpackage (recommended default)
- yolo11s.mlpackage
- yolo11m.mlpackage
- yolo11l.mlpackage
- yolo11x.mlpackage
You can create these models using the ultralytics package:
from ultralytics import YOLO # Export models to CoreML format for size in ("n", "s", "m", "l", "x"): model = YOLO(f"yolo11{size}.pt") model.export(format="coreml", int8=True, nms=True)
-
Run the App:
- Connect your iOS device
- Select it as the run target in Xcode
- Build and run the project
-
Getting Started:
- Allow camera access when prompted
- Choose your preferred YOLO model (we recommend starting with YOLO11n)
- Point your camera at objects to begin learning
-
Learning Features:
- Tap detected objects to see translations and hear pronunciations
- Use the AR mode to place persistent labels in your environment
- Review saved items in the Collection tab
- Practice pronunciation and take quizzes in the Practice tab
-
Settings & Customization:
- Adjust detection confidence thresholds
- Customize learning preferences
- Configure pronunciation settings
- Manage AR features
This project is licensed under the AGPL-3.0 License - see the LICENSE file for details.
- Issues: Submit bug reports and feature requests via GitHub Issues
- Email: For business inquiries, contact support@tonoapp.com
Built with ❤️ using Ultralytics YOLO