From d74b7d84b330f23e52491f612a417b8e36f41105 Mon Sep 17 00:00:00 2001 From: Ling-Sen Peng Date: Thu, 2 Jul 2026 14:38:43 -0700 Subject: [PATCH 1/5] docs: note HuggingFace vision (image input) via OpenAI-compatible router HuggingFace vision-capable models accept image input via the router endpoint (https://router.huggingface.co/v1), enabled by conductor-oss/conductor#1245. Support is model-dependent. Added to both provider docs. Co-Authored-By: Claude Opus 4.8 --- docs/ai-models.md | 2 ++ docs/providers.md | 2 ++ 2 files changed, 4 insertions(+) diff --git a/docs/ai-models.md b/docs/ai-models.md index 29cfd2f3..f6c2216f 100644 --- a/docs/ai-models.md +++ b/docs/ai-models.md @@ -143,6 +143,8 @@ agentspan server start **Models:** `hugging_face/meta-llama/Llama-3-70b-chat-hf`, `hugging_face/mistralai/Mistral-7B-Instruct-v0.2` +**Vision (image input):** vision-capable models (e.g. `hugging_face/meta-llama/Llama-3.2-11B-Vision-Instruct`) accept image input via Hugging Face's OpenAI-compatible router (`https://router.huggingface.co/v1`); support is model-dependent. See [conductor-oss/conductor#1245](https://github.com/conductor-oss/conductor/pull/1245). + --- ### Stability AI diff --git a/docs/providers.md b/docs/providers.md index 9ab84da6..8901ce97 100644 --- a/docs/providers.md +++ b/docs/providers.md @@ -149,6 +149,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `hugging_face/meta-llama/Llama-3-70b-chat-hf`, `hugging_face/mistralai/Mistral-7B-Instruct-v0.2` +**Vision (image input):** vision-capable models (e.g. `hugging_face/meta-llama/Llama-3.2-11B-Vision-Instruct`) accept image input via Hugging Face's OpenAI-compatible router (`https://router.huggingface.co/v1`); support is model-dependent. See [conductor-oss/conductor#1245](https://github.com/conductor-oss/conductor/pull/1245). + --- ### Stability AI From 4aed2bc72ad425b35d4cbd229edd9cd6cbb01475 Mon Sep 17 00:00:00 2001 From: Ling-Sen Peng Date: Thu, 2 Jul 2026 14:43:18 -0700 Subject: [PATCH 2/5] docs: note vision (image input) for Anthropic, Gemini, Grok, Perplexity Extend the vision-input provider notes beyond HuggingFace to the other newly media-enabled providers, each referencing its conductor-oss fix: Anthropic (#1238), Gemini (#1241), Grok/Perplexity (#1243). Support is model-dependent. Applied to both provider docs. Co-Authored-By: Claude Opus 4.8 --- docs/ai-models.md | 8 ++++++++ docs/providers.md | 8 ++++++++ 2 files changed, 16 insertions(+) diff --git a/docs/ai-models.md b/docs/ai-models.md index f6c2216f..fab8da11 100644 --- a/docs/ai-models.md +++ b/docs/ai-models.md @@ -46,6 +46,8 @@ agentspan server start **Models:** `anthropic/claude-opus-4-20250514`, `anthropic/claude-sonnet-4-20250514`, `anthropic/claude-3-5-sonnet-20241022`, `anthropic/claude-3-haiku-20240307` +**Vision (image input):** Claude models accept image input (e.g. `anthropic/claude-3-5-sonnet-20241022`); support is model-dependent. See [conductor-oss/conductor#1238](https://github.com/conductor-oss/conductor/pull/1238). + --- ### Google Gemini @@ -57,6 +59,8 @@ agentspan server start **Models:** `google_gemini/gemini-2.0-flash`, `google_gemini/gemini-1.5-pro`, `google_gemini/gemini-1.5-flash` +**Vision (image input):** Gemini models accept image input (e.g. `google_gemini/gemini-1.5-pro`); support is model-dependent. See [conductor-oss/conductor#1241](https://github.com/conductor-oss/conductor/pull/1241). + **Embeddings:** `google_gemini/text-embedding-004` **Image generation:** `google_gemini/imagen-3.0-generate-002` @@ -123,6 +127,8 @@ agentspan server start **Models:** `grok/grok-3`, `grok/grok-3-mini` +**Vision (image input):** vision-capable Grok models accept image input; support is model-dependent. See [conductor-oss/conductor#1243](https://github.com/conductor-oss/conductor/pull/1243). + --- ### Perplexity AI @@ -133,6 +139,8 @@ agentspan server start **Models:** `perplexity/sonar-pro`, `perplexity/sonar` +**Vision (image input):** vision-capable Perplexity models accept image input; support is model-dependent. See [conductor-oss/conductor#1243](https://github.com/conductor-oss/conductor/pull/1243). + --- ### Hugging Face diff --git a/docs/providers.md b/docs/providers.md index 8901ce97..f321eb7d 100644 --- a/docs/providers.md +++ b/docs/providers.md @@ -57,6 +57,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `anthropic/claude-opus-4-20250514`, `anthropic/claude-sonnet-4-6`, `anthropic/claude-3-5-sonnet-20241022`, `anthropic/claude-3-haiku-20240307` +**Vision (image input):** Claude models accept image input (e.g. `anthropic/claude-3-5-sonnet-20241022`); support is model-dependent. See [conductor-oss/conductor#1238](https://github.com/conductor-oss/conductor/pull/1238). + --- ### Google Gemini @@ -68,6 +70,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `google_gemini/gemini-2.0-flash`, `google_gemini/gemini-1.5-pro`, `google_gemini/gemini-1.5-flash` +**Vision (image input):** Gemini models accept image input (e.g. `google_gemini/gemini-1.5-pro`); support is model-dependent. See [conductor-oss/conductor#1241](https://github.com/conductor-oss/conductor/pull/1241). + **Embeddings:** `google_gemini/text-embedding-004` --- @@ -129,6 +133,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `grok/grok-3`, `grok/grok-3-mini` +**Vision (image input):** vision-capable Grok models accept image input; support is model-dependent. See [conductor-oss/conductor#1243](https://github.com/conductor-oss/conductor/pull/1243). + --- ### Perplexity AI @@ -139,6 +145,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `perplexity/sonar-pro`, `perplexity/sonar` +**Vision (image input):** vision-capable Perplexity models accept image input; support is model-dependent. See [conductor-oss/conductor#1243](https://github.com/conductor-oss/conductor/pull/1243). + --- ### Hugging Face From 03c13cd730ba1488e3bacf51f4c4e2beb4150916 Mon Sep 17 00:00:00 2001 From: Ling-Sen Peng Date: Thu, 2 Jul 2026 14:49:57 -0700 Subject: [PATCH 3/5] docs: note native vision (image input) for OpenAI, Azure, Mistral, Ollama, Bedrock Complete the per-provider vision-input coverage: these providers already forward media today (via OpenAIResponsesChatModel / Spring AI stock chat models), so note image input as natively supported (model-dependent), no PR reference needed. Every vision-capable provider in the docs now has a Vision (image input) note; Cohere/DeepSeek/StabilityAI are excluded (no vision chat models). Co-Authored-By: Claude Opus 4.8 --- docs/ai-models.md | 10 ++++++++++ docs/providers.md | 10 ++++++++++ 2 files changed, 20 insertions(+) diff --git a/docs/ai-models.md b/docs/ai-models.md index fab8da11..f4ca263a 100644 --- a/docs/ai-models.md +++ b/docs/ai-models.md @@ -32,6 +32,8 @@ agentspan server start **Models:** `openai/gpt-4o`, `anthropic/claude-sonnet-4-6`, `openai/gpt-4-turbo`, `openai/o1`, `openai/o1-mini`, `openai/o3-mini` +**Vision (image input):** GPT-4o models accept image input (e.g. `openai/gpt-4o`, `openai/gpt-4o-mini`); support is model-dependent. + **Embeddings:** `openai/text-embedding-3-small`, `openai/text-embedding-3-large` **Image generation:** `openai/dall-e-3` @@ -77,6 +79,8 @@ agentspan server start **Models:** `azure_openai/gpt-4o`, `azure_openai/gpt-4`, `azure_openai/gpt-3.5-turbo` +**Vision (image input):** vision-capable deployments accept image input (e.g. a `gpt-4o` deployment); support is model-dependent. + --- ### AWS Bedrock @@ -91,6 +95,8 @@ agentspan server start **Models:** `aws_bedrock/anthropic.claude-3-5-sonnet-20241022-v2:0`, `aws_bedrock/anthropic.claude-3-haiku-20240307-v1:0`, `aws_bedrock/meta.llama3-70b-instruct-v1:0`, `aws_bedrock/amazon.titan-text-express-v1` +**Vision (image input):** vision-capable models accept image input (e.g. `aws_bedrock/anthropic.claude-3-5-sonnet-20241022-v2:0`); support is model-dependent. + **Embeddings:** `aws_bedrock/amazon.titan-embed-text-v2:0` --- @@ -103,6 +109,8 @@ agentspan server start **Models:** `mistral/mistral-large-latest`, `mistral/mistral-medium-latest`, `mistral/mistral-small-latest`, `mistral/open-mixtral-8x7b` +**Vision (image input):** Pixtral models accept image input (e.g. `mistral/pixtral-12b-2409`); support is model-dependent. + **Embeddings:** `mistral/mistral-embed` --- @@ -185,6 +193,8 @@ Install Ollama: [ollama.com/download](https://ollama.com/download) **Models:** `ollama/llama3`, `ollama/mistral`, `ollama/phi3`, `ollama/codellama` +**Vision (image input):** vision-capable local models accept image input (e.g. `ollama/llava`, `ollama/llama3.2-vision`); support is model-dependent. + **Embeddings:** `ollama/nomic-embed-text` --- diff --git a/docs/providers.md b/docs/providers.md index f321eb7d..eb32edd5 100644 --- a/docs/providers.md +++ b/docs/providers.md @@ -45,6 +45,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `openai/gpt-4o`, `anthropic/claude-sonnet-4-6`, `openai/gpt-4-turbo`, `openai/o1`, `openai/o1-mini`, `openai/o3-mini` +**Vision (image input):** GPT-4o models accept image input (e.g. `openai/gpt-4o`, `openai/gpt-4o-mini`); support is model-dependent. + **Embeddings:** `openai/text-embedding-3-small`, `openai/text-embedding-3-large` --- @@ -86,6 +88,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `azure_openai/gpt-4o`, `azure_openai/gpt-4`, `azure_openai/gpt-3.5-turbo` +**Vision (image input):** vision-capable deployments accept image input (e.g. a `gpt-4o` deployment); support is model-dependent. + --- ### AWS Bedrock @@ -97,6 +101,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `aws_bedrock/anthropic.claude-3-5-sonnet-20241022-v2:0`, `aws_bedrock/anthropic.claude-3-haiku-20240307-v1:0`, `aws_bedrock/meta.llama3-70b-instruct-v1:0`, `aws_bedrock/amazon.titan-text-express-v1` +**Vision (image input):** vision-capable models accept image input (e.g. `aws_bedrock/anthropic.claude-3-5-sonnet-20241022-v2:0`); support is model-dependent. + **Embeddings:** `aws_bedrock/amazon.titan-embed-text-v2:0` --- @@ -109,6 +115,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `mistral/mistral-large-latest`, `mistral/mistral-medium-latest`, `mistral/mistral-small-latest`, `mistral/open-mixtral-8x7b` +**Vision (image input):** Pixtral models accept image input (e.g. `mistral/pixtral-12b-2409`); support is model-dependent. + **Embeddings:** `mistral/mistral-embed` --- @@ -191,6 +199,8 @@ No API key required. Ollama must be running and reachable. **Models:** `ollama/llama3`, `ollama/mistral`, `ollama/phi3`, `ollama/codellama` +**Vision (image input):** vision-capable local models accept image input (e.g. `ollama/llava`, `ollama/llama3.2-vision`); support is model-dependent. + **Embeddings:** `ollama/nomic-embed-text` Install Ollama: [ollama.com/download](https://ollama.com/download) From 8d5d8582989af1bcf30a88c46e7ee6ddc3f03f46 Mon Sep 17 00:00:00 2001 From: Ling-Sen Peng Date: Thu, 2 Jul 2026 15:22:57 -0700 Subject: [PATCH 4/5] docs: add Cohere vision (image input) note Correcting an earlier omission: Cohere IS vision-capable (e.g. command-a-vision-07-2025) and its v2 chat API accepts image_url content parts. Enabled in conductor-ai by conductor-oss/conductor#1246. Support is model-dependent. Added to both provider docs. Co-Authored-By: Claude Opus 4.8 --- docs/ai-models.md | 2 ++ docs/providers.md | 2 ++ 2 files changed, 4 insertions(+) diff --git a/docs/ai-models.md b/docs/ai-models.md index f4ca263a..c33da1b1 100644 --- a/docs/ai-models.md +++ b/docs/ai-models.md @@ -123,6 +123,8 @@ agentspan server start **Models:** `cohere/command-r-plus`, `cohere/command-r`, `cohere/command` +**Vision (image input):** vision-capable Cohere models accept image input (e.g. `cohere/command-a-vision-07-2025`); support is model-dependent. See [conductor-oss/conductor#1246](https://github.com/conductor-oss/conductor/pull/1246). + **Embeddings:** `cohere/embed-english-v3.0`, `cohere/embed-multilingual-v3.0` --- diff --git a/docs/providers.md b/docs/providers.md index eb32edd5..069d421b 100644 --- a/docs/providers.md +++ b/docs/providers.md @@ -129,6 +129,8 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") **Models:** `cohere/command-r-plus`, `cohere/command-r`, `cohere/command` +**Vision (image input):** vision-capable Cohere models accept image input (e.g. `cohere/command-a-vision-07-2025`); support is model-dependent. See [conductor-oss/conductor#1246](https://github.com/conductor-oss/conductor/pull/1246). + **Embeddings:** `cohere/embed-english-v3.0`, `cohere/embed-multilingual-v3.0` --- From 725ceeb7e7d12595f98d1726ea3125c872971a4e Mon Sep 17 00:00:00 2001 From: Ling-Sen Peng Date: Thu, 2 Jul 2026 15:27:20 -0700 Subject: [PATCH 5/5] =?UTF-8?q?docs:=20remove=20DeepSeek=20=E2=80=94=20not?= =?UTF-8?q?=20implemented=20in=20conductor-ai?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit DeepSeek is not a conductor-ai provider (no implementation, no registered alias), so `deepseek/deepseek-chat` would not resolve, and DeepSeek's API is text-only anyway. Remove the DeepSeek section and summary row from providers.md (ai-models.md never listed it). Re-add if/when a DeepSeek provider lands in conductor-ai. Co-Authored-By: Claude Opus 4.8 --- docs/providers.md | 11 ----------- 1 file changed, 11 deletions(-) diff --git a/docs/providers.md b/docs/providers.md index 069d421b..f41dccb5 100644 --- a/docs/providers.md +++ b/docs/providers.md @@ -181,16 +181,6 @@ agent = Agent(name="bot", model="google_gemini/gemini-2.0-flash") --- -### DeepSeek - -| Variable | Description | -|---|---| -| `DEEPSEEK_API_KEY` | API key from DeepSeek | - -**Models:** `deepseek/deepseek-chat` - ---- - ### Ollama (local) No API key required. Ollama must be running and reachable. @@ -224,5 +214,4 @@ Install Ollama: [ollama.com/download](https://ollama.com/download) | Perplexity | `PERPLEXITY_API_KEY` | `perplexity/` | | Hugging Face | `HUGGINGFACE_API_KEY` | `hugging_face/` | | Stability AI | `STABILITY_API_KEY` | `stabilityai/` | -| DeepSeek | `DEEPSEEK_API_KEY` | `deepseek/` | | Ollama | `OLLAMA_BASE_URL` | `ollama/` |