This is a RAG middleware service that serves upper-layer applications.
This project is a complete set of RAG middleware microservices, providing unified retrieval-augmented generation capability support for upper-layer business applications. All modules are decoupled and independently deployable, covering document parsing, vector embedding, data loading, vector storage, reranking, large model proxy, gateway routing and knowledge ontology management full-link capabilities.
The public version reproduces only core modules such as document parsing, embedding, and reranking; other production modules are not open-sourced due to confidentiality requirements.
| Module | Core Responsibility |
|---|---|
| rag-gateway | External traffic entry, gateway routing, auth, rate limit |
| rag-service | Full-link orchestration, unified business logic entry |
| rag-magicpdf | Complex PDF/document parsing, layout analysis |
| rag-loader | Text cleaning, chunk segmentation, preprocessing |
| embeding-service | Text vector embedding calculation |
| rag-faiss | Vector library storage, fast similarity retrieval |
| rag-rerank | Retrieval result secondary sorting & filtering |
| rag-llm-proxy | Unified LLM access, multi-model proxy management |
| rag-ontology | Knowledge graph, entity & relationship management |