🦀 Ultra-minimalist, high-resilience LLM routing gateway in Rust. OpenAI-compatible with auto-retry, backoffs, circuit breakers, SIGHUP hot-reloads, and open telemetry. Ideal for free provider surfing.
rust lightweight embedded openwrt proxy gateway rate-limiting artificial-intelligence failover hot-reload high-availability circuit-breaker distributed-tracing edge-computing opentelemetry llm generative-ai openai-compatible zero-disk otelite
-
Updated
Sep 3, 2026 - Rust