CortexLearn listens to a learner over WebRTC, transcribes with Whisper, and adapts the learning path using a knowledge graph of concepts and mastery — a spoken, personalized tutor.
Part of my . Built on the "" model.
# 1. Clone
git clone https://github.com/Kimosabey/cortex-learn.git
cd cortex-learn
# 2. Install
# (see docs/GETTING_STARTED.md for the full setup)
# 3. Run
docker compose up- Voice-first interaction
- Real-time transcription
- Knowledge-graph mastery model
- Adaptive, personalized pathing
%%{init: {'theme':'base','themeVariables':{'primaryColor':'#ffffff','lineColor':'#2563eb','mainBkg':'#ffffff'}}}%%
graph LR
A([Voice])
B([Whisper STT])
C([Adaptive Engine + KG])
D([Personalized Path])
A --> B
B --> C
C --> D
style A fill:#eff6ff,stroke:#2563eb,stroke-width:2px,color:#1e40af
style B fill:#eff6ff,stroke:#2563eb,stroke-width:2px,color:#1e40af
style C fill:#eff6ff,stroke:#2563eb,stroke-width:2px,color:#1e40af
style D fill:#eff6ff,stroke:#2563eb,stroke-width:2px,color:#1e40af
Modeling learner mastery well enough to adapt content in real time from spoken interaction.
See docs/ARCHITECTURE.md for the full HLD/LLD and design decisions.
| Layer | Technology | Role |
|---|---|---|
| WebRTC | WebRTC |
Real-time media transport |
| Whisper | Whisper |
Speech-to-text model |
| Knowledge Graph | Knowledge Graph |
Entity & relationship store |
- Architecture — high- and low-level design, decision log
- Getting Started — prerequisites, setup, environment
- Failure Scenarios — fault analysis and recovery
- Interview Q&A — deep-dive walkthrough
- Spaced-repetition scheduling
- Progress analytics
- Multi-subject graphs
Released under the MIT License.
Harshan Aiyappa Senior Full-Stack Hybrid AI Engineer Voice AI • Distributed Systems • Infrastructure