Skip to content

Commit 12f58ef

Browse files
committed
docs: update litellm models configuration description
1 parent 28e0aa5 commit 12f58ef

1 file changed

Lines changed: 96 additions & 0 deletions

File tree

docs/admin/configuration/extensions/litellm-proxy/model-configuration.md

Lines changed: 96 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -144,6 +144,60 @@ Each model entry in the `model_list` array consists of three main sections:
144144

145145
</details>
146146

147+
- **`api_base`**: Backend provider API base URL. Required for Azure OpenAI.
148+
149+
<details>
150+
<summary><strong>Example: API Base URL</strong></summary>
151+
152+
```yaml
153+
model_list:
154+
- model_name: claude-sonnet-4-5-20250929
155+
litellm_params:
156+
model: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
157+
# ... additional configuration fields
158+
159+
- model_name: gpt-5-2025-08-07
160+
litellm_params:
161+
model: azure/gpt-5-2025-08-07
162+
// highlight-next-line
163+
api_base: https://custom-domain-name.openai.azure.com/
164+
# ... additional configuration fields
165+
166+
- model_name: gemini-3.1-pro
167+
litellm_params:
168+
model: vertex_ai/gemini-3.1-pro-preview
169+
# ... additional configuration fields
170+
```
171+
172+
</details>
173+
174+
- **`api_version`**: Backend provider API version. Applicable for Azure OpenAI.
175+
176+
<details>
177+
<summary><strong>Example: API Version</strong></summary>
178+
179+
```yaml
180+
model_list:
181+
- model_name: claude-sonnet-4-5-20250929
182+
litellm_params:
183+
model: bedrock/us.anthropic.claude-sonnet-4-5-20250929-v1:0
184+
# ... additional configuration fields
185+
186+
- model_name: gpt-5-2025-08-07
187+
litellm_params:
188+
model: azure/gpt-5-2025-08-07
189+
// highlight-next-line
190+
api_version: "2025-04-01-preview"
191+
# ... additional configuration fields
192+
193+
- model_name: gemini-3.1-pro
194+
litellm_params:
195+
model: vertex_ai/gemini-3.1-pro-preview
196+
# ... additional configuration fields
197+
```
198+
199+
</details>
200+
147201
- **`litellm_credential_name`**: Reference to authentication credentials configured in secrets
148202

149203
<details>
@@ -586,6 +640,26 @@ model_list:
586640

587641
### GPT-5 series
588642

643+
Generic configuration for GPT-5 Series models is the following.
644+
645+
```yaml
646+
- model_name: gpt-5-2025-08-07
647+
litellm_params:
648+
model: azure/gpt5_series/deployment-name
649+
api_base: https://api-base.openai.azure.com/
650+
litellm_credential_name: azure_openai_credential
651+
model_info:
652+
id: gpt-5-2025-08-07
653+
base_model: azure/gpt-5-2025-08-07
654+
label: "GPT-5 2025-08-07"
655+
```
656+
657+
The very new models may require a particular version of Azure API. For example, gpt-5.3-codex models require API version `2025-03-01-preview` or newer.
658+
Therefore, if your CLI client doesn't add compatible `api-version` to the request or CodeMie instance is configured to use older API version, the model may not work.
659+
To fix the issue, set `api_version` parameter to the `litellm_params` as shown [below](#gpt-53-codex-with-chat-compatibility-mode).
660+
661+
Otherwise, if client explicitly set `api-version` in request LiteLLM uses it instead of configured value.
662+
589663
#### GPT-5
590664

591665
<details>
@@ -788,6 +862,28 @@ model_list:
788862

789863
</details>
790864

865+
#### GPT-5.3 Codex with Chat Compatibility Mode
866+
867+
<details>
868+
<summary><strong>GPT-5.3 Codex</strong></summary>
869+
870+
```yaml
871+
# US Region
872+
- model_name: gpt-5.3-codex-2026-02-24
873+
litellm_params:
874+
model: azure/responses/gpt-5.3-codex-2026-02-24
875+
api_base: https://api-base-eastus2-0.openai.azure.com/
876+
litellm_credential_name: default_azure_openai_credential
877+
// highlight-next-line
878+
api_version: "2025-04-01-preview"
879+
model_info:
880+
id: gpt-5-3-codex-2026-02-24-eastus2-0
881+
base_model: azure/gpt-5.3-codex
882+
label: "GPT-5.3 Codex 2026-02-24"
883+
```
884+
885+
</details>
886+
791887
### GPT-5.4 series
792888

793889
#### GPT-5.4

0 commit comments

Comments
 (0)