The open-source AI business manager. One AI, five channels, one memory.
RagLeap Core is the open-source engine behind RagLeap — a self-hosted RAG (retrieval-augmented generation) chat system that answers questions from your own documents, on your own server, with no vendor lock-in.
Quickstart · Docs · Website · Hosted Version
Not to be confused with
install.ragleap.com— that's a separate, paid, license-gated self-hosted product (Free tier with a license key, up to Enterprise).ragleap-core(this repo) is MIT-licensed, completely free, and never requires a license key. If you cloned this repo, you're in the right place for a genuinely free, open-source RAG engine.
Most open-source RAG projects give you a toolkit — you still have to build the app, wire up a UI, add memory, and connect every channel yourself. RagLeap Core gives you a working chat engine out of the box, and the full RagLeap platform turns it into an AI that actually operates a business.
| Without RagLeap | With RagLeap |
|---|---|
| ❌ A different bot for your website, WhatsApp, and Telegram — none of them share memory | ✅ One AI across every channel, with memory that persists between them |
| ❌ Your RAG chatbot forgets everything the moment a session ends | ✅ Persistent memory — facts and preferences carry across sessions and channels |
| ❌ You're a developer, so you can wire up LangChain — but your team can't manage it | ✅ A real dashboard for non-technical owners: settings, analytics, team, billing |
| ❌ Answering customer questions and running the business are two separate systems | ✅ Manager AI — an executive assistant that can see analytics, send emails, and manage settings by conversation |
| ❌ Adding a phone line means integrating Twilio, STT, and TTS yourself | ✅ Voice AI is built in — real inbound calls, answered and routed automatically |
| ❌ Automating a workflow means writing custom code per integration | ✅ n8n workflow automation triggered directly from any conversation |
This repo isn't a general-purpose RAG framework you assemble into something — it's the real, working engine that already powers a production AI business platform (see What's in the hosted version below). The code here is honest about being early, but it's extracted from something that already works in the real world, not built as a demo.
Open-source AI agent projects like OpenClaw took off for a specific reason: people wanted an assistant that runs on their own infrastructure, with their own keys, answering from the chat apps they already use — not a black box hosted by someone else. That same principle is what RagLeap Core is built on for business AI specifically.
Your keys, your infrastructure, your data. RagLeap Core never asks for a system API key. You bring your own Gemini key, you run your own PostgreSQL database, your documents never leave your server unless you choose the hosted version.
Chat is the interface, not a separate dashboard you have to learn. The same way OpenClaw meets people on WhatsApp, Telegram, and Slack, RagLeap's full platform meets business owners on the channels they already use — WhatsApp, Telegram, Discord, and real phone calls — not a new app they have to check.
A real, working system — not an abstract framework. This isn't a toolkit like LangChain where you assemble your own app from primitives. RagLeap Core is the actual chunking → embedding → retrieval → generation pipeline extracted from a production system that already answers real customer questions, at a company that already runs on it.
Built in public, honestly. This repo says clearly what's done and what isn't. No inflated claims, no vaporware Quickstart commands that don't work yet — the Roadmap reflects the real state of the code, updated as it progresses.
RagLeap Core is a document-grounded chat engine. Upload your documents, ask questions, get cited answers — self-hosted, on your own infrastructure, with your own API key.
WhatsApp, Telegram, and Discord bots are included in this repo too — single-tenant, .env-configured channel adapters that answer from the same document knowledge base. It is the foundation of RagLeap, a hosted AI business manager that adds Voice calling, multi-tenancy, a persistent memory system, and an executive-assistant layer on top of this same core engine.
If RagLeap (hosted) is the business, RagLeap Core is the engine room.
- ✅ You want a self-hosted RAG chatbot with full control over your data
- ✅ You want to understand exactly how document retrieval and citation works, not use a black box
- ✅ You're comfortable running your own server and your own AI provider key
- ✅ You want to contribute to or extend an open document-QA engine
- ✅ You'd rather see the code than trust a vendor's word on data privacy
| It's not... | It is... |
|---|---|
| A hosted product | Self-hosted software you run yourself |
| Multi-tenant, with persistent cross-session memory | Single-tenant — one bot, one document set, per deployment |
| A multi-tenant platform | WhatsApp/Telegram/Discord/Voice channel adapters included, single-tenant — multi-tenant routing lives in the hosted version |
| A no-code SaaS dashboard | A codebase you deploy and configure |
| Feature-complete with the hosted version | The foundational subset — see Roadmap |
| 📄 Document ingestion | Upload PDFs, text, and common document formats |
| 🔍 RAG retrieval | Vector search over your documents via pgvector |
| 💬 Chat with citations | Answers reference the source document, not a black box |
| 🔌 Bring your own AI key | OpenAI, Gemini, Anthropic, or any OpenAI-compatible endpoint |
| 🌐 Web chat widget | Embed a chat widget on any website |
| 🐳 Docker-based setup | One-command local deployment |
| 🕸️ Knowledge Graph (Neo4j) | Entity extraction and graph-boosted retrieval alongside vector search |
| 🌍 Language detection | Auto-detects document and query language, applied across every channel |
| 🔗 Integrations | Connect MySQL, PostgreSQL, MongoDB, REST APIs, Salesforce, HubSpot, Shopify, Google Sheets, Stripe |
| 🔀 Hybrid search | Combines dense (vector) and sparse (full-text) retrieval via Reciprocal Rank Fusion |
| ⚡ Streaming responses | Answers stream token-by-token instead of waiting for the full response |
| 🔁 Provider fallback | Automatically retries with a backup LLM provider if the primary fails |
| 💰 Token usage reporting | Real per-call token counts from the provider, plus context-size budget trimming |
RagLeap Core is the foundation layer of the full RagLeap platform. Here's how it fits into the bigger picture:
+-------------------------------------------------------------+
| RagLeap (Hosted Platform) |
| |
| [locked] Manager AI — private executive assistant |
| [locked] AI Employees — role-based persistent memory |
| [locked] n8n Workflow Automation |
| [locked] Persistent Memory (cross-channel, cross-session) |
| [locked] Multi-tenant Billing, Teams & Permissions |
| [locked] Audit History / Compliance logging |
| [locked] Embed Widget Control Center (white-label) |
| [locked] Managed hosting, backups, SLA, support |
| |
| built on top of |
+-------------------------------------------------------------+
|
+-------------------------------------------------------------+
| RagLeap Core (this repo, open) |
| |
| +----------------+ |
| | Web Chat UI | |
| +-------+--------+ |
| | |
| +-------v--------+ |
| | Chat API | |
| +-------+--------+ |
| | |
| +---------------------+---------------------+ |
| | | | | |
| +-----v----+ +---v-----+ +--v------+ +-v-------+ |
| | WhatsApp | |Telegram | | Discord | | Voice | |
| +----------+ +---------+ +---------+ +---------+ |
| | | | | |
| +---------------------+---------------------+ |
| | |
| +---------------------+---------------------+ |
| | | | |
| +-----v-----+ +------v------+ +------v------+ |
| | Document | | RAG | | AI Provider | |
| | Ingest | | Retrieve | | Adapter | |
| +-----+-----+ +------+------+ +------+------+ |
| | | | |
| +---------------------+---------------------+ |
| | |
| +-----------v-----------+ |
| | PostgreSQL + pgvector | |
| +-----------+-----------+ |
| | |
| +-----------v-----------+ |
| | Neo4j (Knowledge | |
| | Graph) | |
| +------------------------+ |
+-------------------------------------------------------------+
[locked] = commercial/hosted-only feature, not included in this repository. See below for the full breakdown.
ragleap-core/
├── core/ # RAG engine — chunking, embedding, retrieval, generation
│ ├── chunker.py
│ ├── embedding.py # Gemini embeddings (gemini-embedding-001, 3072-dim)
│ ├── retrieval.py # pgvector cosine search
│ ├── generation.py # 19-provider BYOK generation (Gemini, OpenAI, Anthropic, etc.)
│ ├── ingest.py # chunk -> embed -> store pipeline
│ ├── parsers.py # PDF/DOCX/TXT text extraction
│ └── api.py # FastAPI app — /health, /upload, /chat, /webhook/*
├── channels/ # Messaging + voice channel adapters
│ ├── whatsapp/ # Twilio + Gupshup
│ ├── telegram/
│ ├── discord/
│ └── voice/ # Twilio Media Streams, WebSocket server
├── db/
│ └── schema.sql # documents + chunks tables, pgvector index
├── examples/ # Runnable example scripts
├── .github/workflows/ # CI: compile check, Docker build, smoke tests
├── docker-compose.yml # app + db + voice services
└── Dockerfile
RagLeap Core covers document upload, retrieval, and web chat. The hosted platform builds a full AI business manager on top of it:
| Area | What it adds |
|---|---|
| Manager AI | A private executive assistant for the owner — sees documents, analytics, team permissions, and database connections; can send emails, generate reports, and manage settings by conversation, reachable via Web, WhatsApp, Telegram, or phone call |
| AI Employees | Specialized AI roles seeded per workspace, each with its own permanent memory, so support and sales conversations draw on different context automatically |
| Voice AI | Real inbound phone calls via Twilio — speech-to-text, RAG-grounded response, text-to-speech, with owner vs. customer call routing |
| Multi-channel bots (multi-tenant) | WhatsApp (Twilio or Gupshup), Telegram, and Discord — single-tenant versions are in this repo; the hosted version adds multi-tenancy, per-workspace routing, and shared config across channels |
| Persistent Memory | Facts and preferences that persist across sessions and channels, not just within a single conversation |
| Advanced AI Settings | Model selection (Gemini/OpenAI/Claude), temperature tuning, bring-your-own-key per provider, and automatic failover across a fallback key pool |
| Team Chat | Internal team messaging board per workspace, separate from customer-facing AI chat |
| n8n Workflows | Trigger no-code automations directly from a conversation, across every channel |
| 222+ Languages | This repo includes language detection (langdetect, ~55 languages) across all channels; the hosted platform extends this to 222+ languages with per-user persisted preferences |
| Integrations & Database Connectors | This repo includes 9 raw connectors (MySQL, PostgreSQL, MongoDB, REST API, Salesforce, HubSpot, Shopify, Google Sheets, Stripe) with on-demand sync; the hosted platform adds AI-suggested automations per channel and developer-level custom automation workflows on top |
| Analytics Dashboard | Per-provider usage breakdown (OpenAI, Gemini, Claude), query volume, token costs, and daily trends |
| Team & Billing | Multi-tenant workspaces, team member permissions, subscription plans, usage-based billing |
| Audit History | Full log of configuration changes — who changed what, and when |
| Embed Control Center | White-label widget builder — Bubble, Fixed Panel, or Full Page embeds for any website |
| Data Visibility Controls | Per-document and per-database Public/Private settings — control exactly what customer-facing bots see vs. what's reserved for Manager AI only |
| Observability & Hallucination Detection | Built-in monitoring layer that audits AI responses for accuracy and flags potential hallucinations |
| Cloud or Self-Hosted deployment | Run the full platform as managed cloud (subscription) or self-hosted on your own server (one-time license) |
| Managed hosting | Backups, uptime SLA, and support — zero infrastructure to maintain |
This is the standard open-core model — the same approach used by projects like n8n, Supabase, and Cal.com: the engine is free and open, the managed/extended product is commercial.
✅ Status: core pipeline verified working. Ingest -> embed -> retrieve -> generate runs end-to-end via Docker Compose, including a clean fresh-clone test. See the Roadmap for what's next (PDF/DOCX support, alternative BYOK providers).
Fastest way to try it — one command checks Docker, clones the repo, and sets up .env for you:
curl -fsSL https://raw.githubusercontent.com/antonyrag/ragleap-core/main/install.sh | bash(Windows users: run this in Git Bash, not Command Prompt or PowerShell.)
The script will pause after cloning and ask you to add your Gemini API key to .env — get a free one at aistudio.google.com/apikey, then re-run the same command.
Or, the manual way — better if you want to read the code before running anything:
git clone https://github.com/antonyrag/ragleap-core.git
cd ragleap-core
cp .env.example .env
# add your Gemini API key to .env
docker compose up --build -dRequirements: Docker, Docker Compose, an API key from OpenAI, Google Gemini, or Anthropic.
Try it in 30 seconds — with the stack running, see examples/ for two verified, runnable scripts:
examples/01_ingest_and_query.py— upload a document and ask a question via the APIexamples/02_test_channel_directly.py— test the WhatsApp/Telegram/Discord answering logic without real bot credentials
RagLeap Core is bring-your-own-key only there is no system-provided key for any provider. Set LLM_PROVIDER in .env to choose which one to use for the generation (chat) step. Embeddings currently always use Gemini (gemini-embedding-001), regardless of LLM_PROVIDER.
LLM_PROVIDER value |
Required env vars | Notes |
|---|---|---|
gemini (default) |
GEMINI_API_KEY |
Get a key at aistudio.google.com/apikey |
anthropic |
ANTHROPIC_API_KEY, ANTHROPIC_MODEL (optional) |
Get a key at console.anthropic.com |
openai |
OPENAI_API_KEY, OPENAI_MODEL |
|
mistral |
MISTRAL_API_KEY, MISTRAL_MODEL |
|
groq |
GROQ_API_KEY, GROQ_MODEL |
Free tier available |
together |
TOGETHER_API_KEY, TOGETHER_MODEL |
|
openrouter |
OPENROUTER_API_KEY, OPENROUTER_MODEL |
|
ollama |
OLLAMA_MODEL (no API key needed) |
Self-hosted; requires Ollama running locally |
deepseek |
DEEPSEEK_API_KEY, DEEPSEEK_MODEL |
|
xai |
XAI_API_KEY, XAI_MODEL |
|
cohere |
COHERE_API_KEY, COHERE_MODEL |
|
perplexity |
PERPLEXITY_API_KEY, PERPLEXITY_MODEL |
|
qwen |
QWEN_API_KEY, QWEN_MODEL |
|
moonshot |
MOONSHOT_API_KEY, MOONSHOT_MODEL |
|
zhipu |
ZHIPU_API_KEY, ZHIPU_MODEL |
|
yi |
YI_API_KEY, YI_MODEL |
|
baidu |
BAIDU_API_KEY, BAIDU_MODEL |
|
minimax |
MINIMAX_API_KEY, MINIMAX_MODEL |
|
custom |
CUSTOM_API_KEY, CUSTOM_MODEL, CUSTOM_BASE_URL |
Any OpenAI-compatible endpoint |
Example, switching to Groq in .env:
LLM_PROVIDER=groq
GROQ_API_KEY=your-groq-key
GROQ_MODEL=llama-3.3-70b-versatile
RagLeap Core includes a real-time voice channel: Twilio Media Streams connects via WebSocket, your speech is transcribed with OpenAI Whisper, answered by the core RAG pipeline, and spoken back with OpenAI TTS. The voice-activity detection and echo-suppression logic is carried over from a production system tuned against real call traffic.
Runs as a separate service on port 8765 (see docker-compose.yml), since
Twilio's real-time audio protocol needs a raw WebSocket server, not an
HTTP route.
Setup:
- Set
OPENAI_API_KEYin.env(used for both Whisper STT and TTS in v1) - Optionally set
VOICE_BOT_NAME,VOICE_GREETING,VOICE_TTS_VOICE - Point a Twilio phone number's
<Connect><Stream>TwiML atwss://your-domain.com:8765
Honest status: the WebSocket server, Twilio event protocol handling, and error handling are verified working. The full Whisper/TTS round-trip has not yet been live-tested end-to-end (requires OpenAI API credits). If you try it and hit issues, please open one — this is exactly the kind of real-world testing this project needs.
Known limitations, carried over from production and not yet fixed here:
- Only OpenAI Whisper (STT) and OpenAI TTS are supported in v1 — Deepgram and ElevenLabs (multi-language support) are good-first-issue candidates
- Non-English TTS quality varies since OpenAI's TTS voices are English-tuned
- Typical round-trip latency in production was 6-8 seconds
RagLeap Core builds a lightweight entity co-occurrence graph alongside its vector index. When you ingest a document, entities (product names, acronyms, proper nouns) are extracted and linked in Neo4j. When you ask a question, the same extraction runs on your query, and any documents linked to matching entities get a similarity boost in retrieval — on top of, not instead of, normal pgvector search.
Runs as a fourth Docker Compose service on ports 7475/7688 (remapped
from Neo4j's defaults to avoid colliding with another Neo4j instance on the
same host). If Neo4j is unreachable or NEO4J_PASSWORD is unset, the graph
degrades gracefully — retrieval falls back to pure vector search, ingestion
is unaffected.
Setup:
- Set
NEO4J_URI,NEO4J_USER, andNEO4J_PASSWORDin.env(matching theNEO4J_AUTHvalue indocker-compose.yml) - Optionally set
DOMAIN_TERMS— a comma-separated list of domain-specific terms to boost during extraction (e.g.DOMAIN_TERMS=API,SDK,RAG)
Honest status: entity extraction, document graph writes, entity-based document lookup, and graph-boosted chat retrieval are all verified working end-to-end, including in CI (fresh build, real ingest, real query, real graph lookup). The graph boost is currently a simple additive score bump, not a full weighted re-ranker — a richer hybrid ranking system is a good next step for anyone who wants to dig in.
Known limitations:
- Entity extraction is regex-based (CamelCase, acronyms, capitalized phrases, plus optional domain terms) — not a trained NER model, so it will miss some entities and occasionally include noise
search_related_entities()(multi-hop graph traversal) is implemented but not yet wired into the retrieval pipeline — good-first-issue candidate for anyone wanting a project
RagLeap Core auto-detects language during document ingestion (per chunk)
and during chat (per query), using the langdetect library plus
script-based heuristics for CJK, Hangul, and Kana text. Since every
channel (WhatsApp, Telegram, Discord, Voice, and the API directly)
routes through the same core chat pipeline, detection applies
consistently everywhere without per-channel wiring.
Setup: works out of the box with no configuration. Optionally set
DEFAULT_LANGUAGE (fallback when detection fails or text is too short),
LANGUAGE_DETECTION_CONFIDENCE_THRESHOLD (default 0.7), and
LANGUAGE_DETECTION_SUPPORTED_LANGUAGES (comma-separated allowlist,
blank = unrestricted).
Honest status: verified working end-to-end — document-level detection tested at high confidence (0.9999) on a real mixed-language document, and query-level detection confirmed working via both the API and CLI.
Known limitations:
langdetectcovers roughly 55 languages — noticeably fewer than the hosted platform's 222+, which layers additional detection and per-user language preferences on top- Short queries in closely-related languages can be misdetected (in testing, a short French query was detected as Italian) — this is an inherent limitation of statistical detection on short text, not specific to this port. A good-first-issue candidate for anyone wanting to improve short-query accuracy
- Detection is one-way only: RagLeap Core detects the query's language and surfaces it, but does not yet steer the AI's response language to match — that's a reasonable next step for a contributor
RagLeap Core connects to external databases and business tools, syncing per-user context to personalize RAG responses. Nine connectors are included: MySQL, PostgreSQL, MongoDB, generic REST APIs, Salesforce, HubSpot, Shopify, Google Sheets, and Stripe.
Every CRM/SaaS connector uses credentials you provide directly — a username/password, a private-app token, an admin API token, a service-account JSON file, or a secret key, depending on the service. None require registering an OAuth app; nothing here depends on RagLeap owning any third-party developer account.
Credentials are encrypted at rest (Fernet/AES-128) before being stored.
Setup:
- Generate an encryption key:
python3 -c "from cryptography.fernet import Fernet; print(Fernet.generate_key().decode())" - Set
ADDON_ENCRYPTION_KEYin.envto that value - Install the SDK for the connector(s) you want (each is optional — see
requirements.txt) - Create a data source:
POST /integrationswithname,source_type, and the relevant credential fields - Test it:
POST /integrations/{id}/test - Sync it:
POST /integrations/{id}/sync
Honest status: verified end-to-end against a real public API — connection testing, syncing, correct identifier-field matching, and credential encryption (checked as actual ciphertext in the database, not just assumed) all confirmed working.
Known limitations:
- 9 of the 18 source types listed in the hosted platform's UI have real connectors here. CSV Upload, Snowflake, BigQuery, WooCommerce, Airtable, Notion, Razorpay, Slack, and Gmail are good-first-issue candidates for anyone wanting to add one
- Sync is on-demand only (
POST /integrations/{id}/sync) — no scheduled background sync yet, though the schema trackssync_interval_minutesfor a future Celery-beat-equivalent - Synced context isn't automatically injected into chat responses yet — each channel adapter would need to know its own user's identifier first, which is a reasonable next contribution
Beyond the core RAG pipeline, /chat (and the underlying core.chat.ask())
support several controls aimed at production use: retrieval quality,
response latency, provider reliability, and cost.
Hybrid search (dense + sparse). By default, retrieval combines
pgvector cosine similarity with Postgres full-text search (tsvector/
GIN index), fused via Reciprocal Rank Fusion — catching both semantic
matches and exact keyword/identifier matches a pure embedding search can
miss. Pass hybrid=false to use dense-only retrieval instead (cheaper —
one query instead of two).
Streaming. POST /chat/stream streams the answer as it's generated
(text/plain, chunked transfer) instead of waiting for the full response.
Implemented natively per provider (Gemini, Anthropic, and OpenAI-compatible
each have different streaming APIs — all three are real, not one stubbed).
Provider fallback. Set LLM_FALLBACK_PROVIDERS (comma-separated) to
automatically retry with backup providers if the primary fails — a rate
limit, outage, or bad key on your primary provider doesn't have to mean a
failed request. Each fallback needs its own API key configured normally.
Streaming can only fall back before any text has been sent to the
caller — a mid-stream failure surfaces as an error rather than silently
switching providers and confusing the output.
Generation controls. temperature, system_prompt, and max_tokens
are all real per-call parameters (not just env-var defaults) — build your
own agent behavior on top of RagLeap's retrieval without forking the
library.
Token usage & context budget. Every blocking /chat call returns real
token usage (prompt_tokens, completion_tokens, total_tokens) pulled
directly from the provider's response — not an estimate. Retrieved
context is also trimmed to MAX_CONTEXT_CHARS (default 12000, roughly
4 characters per token for English text) before being sent, dropping the
lowest-ranked chunks first, so you're not paying for more context than
necessary. Set MAX_CONTEXT_CHARS=0 to disable trimming.
Honest status: hybrid search's RRF fusion math verified correct
against hand calculation. Streaming verified working end-to-end for the
default provider. Provider fallback verified with a real broken-primary
test — deliberately invalid API key, confirmed fallback to a working
secondary provider with a correct answer. Token usage and context
trimming verified with real numbers: a 3-chunk retrieval trimmed to 1
chunk under a tight budget reduced actual prompt_tokens by 38% on the
same live API.
Known limitations:
- Token usage reporting is not available for streaming responses — each provider's streaming API surfaces usage differently, and doing all three correctly is separate, not-yet-done work
MAX_CONTEXT_CHARSis a character-count approximation (~4 chars/token for English), not an exact per-provider tokenizer count- Hybrid search hasn't been benchmarked for actual ranking-quality improvement on a multi-document corpus with genuinely conflicting dense vs. sparse rankings — only correctness (fusion math, tokenization of unusual identifiers) has been verified so far
- Public repository created
- Core RAG engine extracted and cleaned from production codebase
- Standalone Docker Compose setup (no external Django project dependency)
- Document ingestion module (28+ formats, not just PDF/TXT/DOCX)
- Web chat widget
- Bring-your-own-API-key support (19 providers)
- WhatsApp, Telegram, Discord, and Voice channel adapters (single-tenant)
- Knowledge Graph (Neo4j), language detection, database/CRM integrations
- Contribution guide and good-first-issue labels
- Community Discord
See ROADMAP.md for the full phase-by-phase history.
RagLeap Core is working, tested, and open for contributions now. See CONTRIBUTING.md for how to get started, and check the good first issue label for scoped tasks.
Student, professor, or looking for a capstone/thesis project? See STUDENT_PROJECTS.md for scoped project ideas at starter, semester, and research-grade levels.
- GitHub Issues — bugs and feature requests
- GitHub Discussions — ideas and questions
- ragleap.com — the hosted product
MIT © 2026 RagLeap
"could not translate host name 'db'" error after a failed docker compose up:
If your first docker compose up attempt fails (e.g. a port conflict on 5433 or 8000), a retry can sometimes leave the database container attached to a stale, orphaned Docker network. Fix:
docker compose down
docker network prune -f
docker compose up --build -dPort 5433 or 8000 already in use:
Another instance of this project (or something else) is using the port. Either stop it, or change the host-side port mapping in docker-compose.yml (the "5433:5432" and "8000:8000" lines) to something free.