Skip to content

Add dynamic LiteLLM model discovery#7

Merged
akhilsinghcodes merged 2 commits into
mainfrom
model_urls
Jun 12, 2026
Merged

Add dynamic LiteLLM model discovery#7
akhilsinghcodes merged 2 commits into
mainfrom
model_urls

Conversation

@akhilsinghcodes

Copy link
Copy Markdown
Owner

This PR switches the app from a static model list to dynamic LiteLLM model discovery.

What changed

  • Fetches available models from LITELLM_BASE_URL/v1/models
  • Falls back to models.json if the API response is unavailable
  • Caches the discovered model list on startup
  • Updates the backend route to serve the discovered models
  • Changes the frontend model picker to use the backend-provided list
  • Expands shared model pricing data to support the new discovery flow
  • Adds a refactor note document: LITELLM_MODELS_REFACTOR.md

Impact

  • Model selection stays in sync with the LiteLLM backend
  • Reduces manual maintenance of hardcoded model URLs/lists
  • Makes it easier to support new models without frontend changes

Akhil Singh added 2 commits June 12, 2026 01:33
Fetch available models from `LITELLM_BASE_URL/v1/models` with a
`models.json` fallback, cache the result on startup, and update the
frontend model picker to use the backend-provided list.
@akhilsinghcodes akhilsinghcodes merged commit 80deea7 into main Jun 12, 2026
1 check passed
@akhilsinghcodes akhilsinghcodes deleted the model_urls branch June 12, 2026 08:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant