MemoryLens - AR Face Recognition Assistant

MemoryLens is a real-time augmented reality face recognition application designed to help dementia patients recognize visitors during video calls. The app overlays information cards with names, relationships, and contextual notes directly on video call windows.

✨ Features

• 🎯 Real-time Face Recognition - Identifies faces during Zoom, WhatsApp, Google Meet, and other video calls
• 💳 Modern Card UI - Displays clean, professional information cards with names, relationships, and context
• 🔒 Privacy-First - All processing happens locally on your device
• 📸 Unknown Face Detection - Automatically captures and saves unknown faces for later identification
• ✏️ Connection Manager - Easy-to-use interface to add, edit, and delete connections
• 🎨 Professional Design - Sleek, modern overlay with rounded corners and smooth animations

🚀 Quick Start

Option 1: Use the Pre-built Executable (Recommended)

1. Download Memory Lens.exe from the Releases page
2. Run the executable
3. Click "Add New Person" to add your first connection
4. Click "Start Overlay" when you're on a video call

Option 2: Run from Source

Prerequisites

• Python 3.8 or higher
• Visual Studio Build Tools (for Windows)

Installation

1. Clone the repository

   git clone https://github.com/Yashkush06/MemoryLens.git
   cd MemoryLens

2. Install dependencies

   pip install -r requirements.txt

   If dlib fails to install on Windows:

   • Install Visual Studio Build Tools with "Desktop development with C++"
   • Run: pip install cmake
   • Run: pip install dlib
   • Run: pip install face_recognition

3. Run the application

   python overlay_app.py

📖 How to Use

1. Launch MemoryLens - Run the executable or Python script
2. Add Connections:
   • Click "Add New Person"
   • Enter their name, relationship, and context notes
   • Upload a clear photo of their face
   • Click "Save Connection"
3. Edit Connections:
   • Click "Edit Connections" to manage existing entries
   • Edit details or delete connections as needed
4. Start Recognition:
   • Open a video call (Zoom, WhatsApp, Meet, etc.)
   • Click "Start Overlay" in MemoryLens
   • Information cards will appear next to recognized faces

🎨 Screenshots

Dashboard

The main control panel where you can add connections, edit existing ones, and start the overlay

Overlay in Action

Real-time face recognition with information cards displayed during video calls

🛠️ Building from Source

To create your own executable:

python -m PyInstaller overlay_app.spec

The executable will be in the dist folder.

📋 Supported Video Call Platforms

• Zoom
• WhatsApp
• Google Meet
• Microsoft Teams (any window with "Meet" in the title)

🔧 Technical Details

• Face Recognition: Uses face_recognition library (based on dlib)
• GUI Framework: Tkinter
• Screen Capture: MSS (Multi-Screen Screenshot)
• Overlay: Transparent window with real-time canvas rendering

🤝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

📄 License

This project is open source and available under the MIT License.

🙏 Acknowledgments

• Built with face_recognition by Adam Geitgey
• Designed to help dementia patients and their families stay connected

⚠️ Privacy Notice

MemoryLens processes all data locally on your device. No images or personal information are sent to external servers. All face recognition happens on your computer to ensure maximum privacy and security.

---

Made with ❤️ for those who need a little help remembering