Is your feature request related to a problem? Please describe.
Goal
Enable developers to use any AI model (--model <name>) and custom API endpoints/versions across all providers (gemini, ollama, groq, openai, anthropic), removing restrictions on default models or hardcoded /v1 endpoint paths.
Problem
Currently, providers default to specific hardcoded model names (e.g., gpt-4o, claude-3-5-sonnet-latest, llama-3.3-70b-versatile) and hardcode the /v1 or /openai/v1 API prefix. This limits users who want to:
- Use newly released models immediately without waiting for a WindMist update (e.g.,
o3-mini, claude-3-opus, qwen2.5:32b).
- Use custom or proprietary enterprise endpoints (such as Azure OpenAI or custom proxy servers that use different path structures instead of standard
/v1).
Describe the solution you'd like
Proposed Solution
- Dynamic Model CLI Flag: Ensure the CLI supports a
--model <model_name> override that overrides the default model in ~/.windmist/config.yaml.
- Flexible Base URL Handling: Allow
base_url in config.yaml to accept exact custom API routes without forcing /v1 when a user provides a full custom path.
- Model Validation: Add helpful error messages or fallback logic when a provider rejects an unsupported model string.
Describe alternatives you've considered
No response
Additional Context
Additional Context
This will make WindMist completely future-proof for all upcoming open-source and proprietary LLM releases across all 5 providers.
Is your feature request related to a problem? Please describe.
Goal
Enable developers to use any AI model (
--model <name>) and custom API endpoints/versions across all providers (gemini,ollama,groq,openai,anthropic), removing restrictions on default models or hardcoded/v1endpoint paths.Problem
Currently, providers default to specific hardcoded model names (e.g.,
gpt-4o,claude-3-5-sonnet-latest,llama-3.3-70b-versatile) and hardcode the/v1or/openai/v1API prefix. This limits users who want to:o3-mini,claude-3-opus,qwen2.5:32b)./v1).Describe the solution you'd like
Proposed Solution
--model <model_name>override that overrides the default model in~/.windmist/config.yaml.base_urlinconfig.yamlto accept exact custom API routes without forcing/v1when a user provides a full custom path.Describe alternatives you've considered
No response
Additional Context
Additional Context
This will make WindMist completely future-proof for all upcoming open-source and proprietary LLM releases across all 5 providers.