production-ci

Here is 1 public repository matching this topic...

yutoTachibana / depth-lens

Cost-vs-accuracy CI for LLM ops. Pick the cheapest API tier, compare self-hosted vLLM vs cloud APIs on one Pareto, and grade free-form output with an LLM-as-judge - all on your own data with Wilson 95% CIs.

python benchmark evaluation-framework model-comparison cost-optimization gemini-api openai-api llm vllm llm-evaluation llm-as-judge anthropic-api inference-compute looped-transformer production-ci

Updated May 18, 2026
Python

Add this topic to your repo

To associate your repository with the production-ci topic, visit your repo's landing page and select "manage topics."

Learn more