RAG-native KV cache service for LLM inference. Integrates with vLLM via KVConnectorBase_V1; the current storage path uses server-managed io_uring with pinned-memory L1 and NVMe L2, while GDS/cuFile remains an optional compatibility backend.
source <venv>/bin/activate
pip install -e .- System design — architecture, components, data flows
- Development guide — server setup, tests, lint, benchmarks, vLLM integration
- Insights — research motivation, related work, roadmap
- Optimizations — performance records and benchmarks
- Contributing — branch conventions, commit format, PR process
DaseR is licensed under the Apache License 2.0.