LLMOps Handbook

This is the handbook for the LLM Operations team. It is a living document.

For the rendered version, visit our website: https://llmops-handbook.distantmagic.com/

Our Other Projects

• Paddler - Stateful load balancer custom-tailored for llama.cpp
• Resonance - Modern PHP framework for IO-intensive applications

License

Creative Commons Attribution Share Alike 4.0 International

Community

Discord: https://discord.gg/kysUzFqSCK