AI Learning Crawler 🕷️⚡

An AI-powered gamified LMS that crawls any URL or topic, generates structured summaries, and tests your knowledge with adaptive quizzes.

Features

• Universal Crawler — paste any URL (YouTube, arXiv, HuggingFace, blogs, forums) or enter a free-text topic
• AI Summarization — powered by Claude with web search; extracts key concepts, learning objectives, real-world applications, prerequisites, and a fun fact
• Gamified Quizzes — 5 AI-generated MCQs per topic with instant feedback and explanations
• XP & Levels — earn XP for crawling and quizzing; progress from Beginner → Expert
• Badges — unlock First Crawler, Quiz Ace, Deep Diver, Streak Master, XP Legend
• Streak Tracking — consecutive passing quiz streaks tracked in real time

Tech Stack

• Frontend: React 18 + Vite (port 5173)
• Backend: FastAPI proxy (port 8000) — handles CORS and injects Anthropic API key
• AI: Claude Sonnet via Anthropic API with web search tool

Getting Started

1. Backend (FastAPI proxy)

cd backend
pip install -r requirements.txt

# Create .env from example and add your Anthropic API key
cp .env.example .env
# Edit .env → set ANTHROPIC_API_KEY=sk-ant-...

uvicorn main:app --reload --port 8000

2. Frontend (React + Vite)

# In a new terminal, from project root
npm install
npm run dev

Open http://localhost:5173

Project Structure

ai-learning-crawler/
├── src/
│   ├── App.jsx          # Main app — crawler, summary, quiz, gamification
│   ├── main.jsx         # React entry point
│   └── index.css        # Base styles
├── backend/
│   ├── main.py          # FastAPI CORS proxy → Anthropic API
│   ├── requirements.txt # Python dependencies
│   └── .env.example     # API key template
├── index.html
├── vite.config.js
└── package.json

How It Works

Browser (localhost:5173)
        │
        ▼  POST /api/messages
FastAPI Proxy (localhost:8000)
        │  adds x-api-key header
        ▼
Anthropic API (api.anthropic.com)
        │  Claude + web search
        ▼
Structured JSON → React UI

1. Enter a URL or topic → Claude agent crawls with web search
2. Review the learning module (TL;DR, concepts, objectives, applications)
3. Take the 5-question quiz
4. Get instant answer review with explanations
5. Earn XP and badges, build your streak

Author

Jai Kumar Arjunan — Freelance AI Solutions Architect
GitHub: @jaikumararjunan