Skip to content

Add GPT4All local OpenAI-compatible provider #2612

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
webbrain-one merged 1 commit into from
Jul 27, 2026
Merged

Add GPT4All local OpenAI-compatible provider #2612

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions README.fr.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -102,7 +102,7 @@ compacte la conversation à mesure qu'elle se remplit. Il existe aussi un relais
**API cloud** — OpenAI, Anthropic Claude, Google Gemini, Azure OpenAI, AWS
Bedrock, Mistral, DeepSeek, xAI Grok, MiniMax, Kimi, Qwen, z.ai GLM, Groq,
Together, Cloudflare, Nvidia NIM, Hugging Face, Fireworks, OpenRouter et
d'autres. Les Paramètres embarquent **103 cartes de fournisseurs** avec URL de
d'autres. Les Paramètres embarquent **104 cartes de fournisseurs** avec URL de
base et modèle par défaut préremplis — voir le
[catalogue complet](docs/fr/providers-and-models.md#catalogue-étendu-de-fournisseurs).

Expand Down Expand Up @@ -195,7 +195,7 @@ WebBrain a le focus.
| [Architecture](docs/fr/architecture.md) | Vue d'ensemble, flux d'un tour, sous-systèmes |
| [Outils de l'agent](docs/fr/agent-tools.md) | Niveaux, modes et matrice complète |
| [Commandes slash](docs/fr/slash-commands.md) | Toutes les commandes et options |
| [Fournisseurs et modèles](docs/fr/providers-and-models.md) | Les 103 cartes, configuration locale, niveaux |
| [Fournisseurs et modèles](docs/fr/providers-and-models.md) | Les 104 cartes, configuration locale, niveaux |
| [Compétences](docs/fr/skills.md) | Compétences intégrées, import, outils de compétence |
| [Modèle de sécurité](docs/fr/security-model.md) | Permissions, identifiants, frontières de confiance |
| [Défense contre l'injection de prompt](docs/fr/prompt-injection-defense.md) | Couches de défense et limites connues |
Expand Down
4 changes: 2 additions & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -96,7 +96,7 @@ preview `ollama launch webbrain --model <model>` handoff. Details:
**Cloud APIs** — OpenAI, Anthropic Claude, Google Gemini, Azure OpenAI, AWS
Bedrock, Mistral, DeepSeek, xAI Grok, MiniMax, Kimi, Qwen, z.ai GLM, Groq,
Together, Cloudflare, Nvidia NIM, Hugging Face, Fireworks, OpenRouter, and more.
Settings ships **103 built-in provider cards** with base URLs and default models
Settings ships **104 built-in provider cards** with base URLs and default models
pre-filled — see the [full catalog](docs/providers-and-models.md#extended-provider-catalog).

## Features
Expand Down Expand Up @@ -179,7 +179,7 @@ Chrome side panel shortcuts work when the WebBrain side panel has focus.
| [Architecture](docs/architecture.md) | System overview, turn flow, subsystems |
| [Agent tools](docs/agent-tools.md) | Tiers, modes, and the full tool matrix |
| [Slash commands](docs/slash-commands.md) | Every command and flag |
| [Providers and models](docs/providers-and-models.md) | All 103 provider cards, local setup, tiers |
| [Providers and models](docs/providers-and-models.md) | All 104 provider cards, local setup, tiers |
| [Skills](docs/skills.md) | Bundled skills, importing, skill tools |
| [Security model](docs/security-model.md) | Permissions, credentials, trust boundaries |
| [Prompt-injection defense](docs/prompt-injection-defense.md) | Defense layers and known gaps |
Expand Down
4 changes: 2 additions & 2 deletions README.zh-CN.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -92,7 +92,7 @@ LM Studio（`:1234/v1`）、Jan（`:1337/v1`）和 LocalAI（`:8080/v1`）用法
**云端 API** —— OpenAI、Anthropic Claude、Google Gemini、Azure OpenAI、AWS Bedrock、
Mistral、DeepSeek、xAI Grok、MiniMax、Kimi、通义千问、z.ai GLM、Groq、Together、
Cloudflare、Nvidia NIM、Hugging Face、Fireworks、OpenRouter 等。设置中内置
**103 张提供商卡片**，已预填 base URL 和默认模型 —— 参见
**104 张提供商卡片**，已预填 base URL 和默认模型 —— 参见
[完整目录](docs/zh-CN/providers-and-models.md#扩展提供商目录)。

## 功能特性
Expand Down Expand Up @@ -168,7 +168,7 @@ Chrome 侧边面板快捷键在 WebBrain 侧边面板获得焦点时生效。
| [架构](docs/zh-CN/architecture.md) | 系统概览、轮次流程、子系统 |
| [智能体工具](docs/zh-CN/agent-tools.md) | 层级、模式与完整工具矩阵 |
| [斜杠命令](docs/zh-CN/slash-commands.md) | 所有命令与参数 |
| [提供商与模型](docs/zh-CN/providers-and-models.md) | 全部 103 张提供商卡片、本地配置、层级 |
| [提供商与模型](docs/zh-CN/providers-and-models.md) | 全部 104 张提供商卡片、本地配置、层级 |
| [技能](docs/zh-CN/skills.md) | 内置技能、导入、技能工具 |
| [安全模型](docs/zh-CN/security-model.md) | 权限、凭证、信任边界 |
| [提示注入防御](docs/zh-CN/prompt-injection-defense.md) | 防御层级与已知缺口 |
Expand Down
5 changes: 3 additions & 2 deletions docs/fr/providers-and-models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,7 @@ class BaseLLMProvider {
| `vllm` | `openai` | local | (modèle chargé) | Oui (activé par défaut) |
| `sglang` | `openai` | local | (modèle chargé) | Oui (activé par défaut) |
| `localai` | `openai` | local | (modèle chargé) | Oui (activé par défaut) |
| `gpt4all` | `openai` | local | (modèle chargé) | Oui (activé par défaut) |
| `azure_openai` | `azure_openai` | cloud | (déploiement) | Bascule manuelle |
| `aws_bedrock` | `aws_bedrock` | cloud | (ID de modèle) | Non |
| `openai` | `openai` | cloud | `gpt-5.6-terra` | Regex nom de modèle |
Expand All @@ -68,8 +69,8 @@ class BaseLLMProvider {

WebBrain ajoute 76 cartes désactivées par défaut depuis l’instantané du
catalogue OpenCode au commit
`62e4641235d7847dadc60da37cca8a023dd54fc1`. Avec les 27 cartes existantes,
les Paramètres proposent **103 fournisseurs intégrés**. La liste exacte des
`62e4641235d7847dadc60da37cca8a023dd54fc1`. Avec les 28 cartes existantes,
les Paramètres proposent **104 fournisseurs intégrés**. La liste exacte des
identifiants est :

`302ai`, `abacus`, `aihubmix`, `alibaba-coding-plan`,
Expand Down
5 changes: 3 additions & 2 deletions docs/providers-and-models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,7 @@ class BaseLLMProvider {
| `vllm` | `openai` | local | (loaded model) | Yes (default on) |
| `sglang` | `openai` | local | (loaded model) | Yes (default on) |
| `localai` | `openai` | local | (loaded model) | Yes (default on) |
| `gpt4all` | `openai` | local | (loaded model) | Yes (default on) |
| `azure_openai` | `azure_openai` | cloud | (deployment) | Manual toggle |
| `aws_bedrock` | `aws_bedrock` | cloud | (model id) | No |
| `openai` | `openai` | cloud | `gpt-5.6-terra` | Model-name regex |
Expand All @@ -68,8 +69,8 @@ class BaseLLMProvider {

WebBrain also ships 76 disabled-by-default provider cards sourced from the
OpenCode provider catalog snapshot at commit
`62e4641235d7847dadc60da37cca8a023dd54fc1`. Together with the 27 original
cards, Settings contains **103 built-in providers**.
`62e4641235d7847dadc60da37cca8a023dd54fc1`. Together with the 28 original
cards, Settings contains **104 built-in providers**.

| IDs |
|---|
Expand Down
3 changes: 2 additions & 1 deletion docs/zh-CN/providers-and-models.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -44,6 +44,7 @@ class BaseLLMProvider {
| `vllm` | `openai` | 本地 | （已加载模型） | 是（默认开启） |
| `sglang` | `openai` | 本地 | （已加载模型） | 是（默认开启） |
| `localai` | `openai` | 本地 | （已加载模型） | 是（默认开启） |
| `gpt4all` | `openai` | 本地 | （已加载模型） | 是（默认开启） |
| `azure_openai` | `azure_openai` | 云端 | （部署） | 手动开关 |
| `aws_bedrock` | `aws_bedrock` | 云端 | （模型 ID） | 否 |
| `openai` | `openai` | 云端 | `gpt-5.6-terra` | 模型名正则 |
Expand All @@ -68,7 +69,7 @@ class BaseLLMProvider {

WebBrain 从 OpenCode 提供商目录提交
`62e4641235d7847dadc60da37cca8a023dd54fc1` 的快照中新增了 76 张默认禁用的
提供商卡片。加上原有 27 张，设置中共有 **103 个内置提供商**。完整 ID
提供商卡片。加上原有 28 张，设置中共有 **104 个内置提供商**。完整 ID
列表如下：

`302ai`、`abacus`、`aihubmix`、`alibaba-coding-plan`、
Expand Down
1 change: 1 addition & 0 deletions src/chrome/icons/providers/SOURCES.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ Most brand marks come from [Lobe Icons](https://github.com/lobehub/lobe-icons)
| llamacpp | Jan app asset (brand mark used for llama.cpp) |
| jan | Jan official app icon |
| localai | LocalAI official logo (`mudler/LocalAI`) |
| gpt4all | Simple mark (not an official GPT4All brand asset) |
| sglang | SGLang official `logo_square` (`sgl-project/sglang`) |
| webbrain_cloud | WebBrain extension icon |
| 302ai, abacus, aihubmix, alibaba-coding-plan, alibaba-coding-plan-cn, azure-cognitive-services, bailing, baseten, berget, cerebras, chutes, clarifai, cloudferro-sherlock, cohere, cortecs, deepinfra, digitalocean, dinference, drun, evroc, fastrouter, friendli, google-vertex, google-vertex-anthropic, helicone, iflowcn, inception, inference, io-net, jiekou, kilo, kimi-for-coding, kuae-cloud-coding-plan, llama, lucidquery, meganova, minimax-cn-coding-plan, minimax-coding-plan, moark, modelscope, morph, nano-gpt, nebius, nova, novita-ai, ollama-cloud, opencode, opencode-go, ovhcloud, perplexity, perplexity-agent, poe, privatemode-ai, qihang-ai, qiniu-ai, requesty, scaleway, siliconflow, siliconflow-cn, stackit, stepfun, submodel, synthetic, tencent-coding-plan, upstage, v0, venice, vercel, vivgrid, vultr, wandb, xiaomi, zai-coding-plan, zenmux, zhipuai, zhipuai-coding-plan | OpenCode provider icon set at commit `62e4641235d7847dadc60da37cca8a023dd54fc1` (MIT); DInference SVG normalized with a `viewBox` |
Expand Down
4 changes: 4 additions & 0 deletions src/chrome/icons/providers/gpt4all.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
19 changes: 16 additions & 3 deletions src/chrome/src/providers/manager.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,7 +25,7 @@ import {
} from './context-windows.js';

const WEBBRAIN_CLOUD_PROVIDER_ID = 'webbrain_cloud';
const LOCAL_MODEL_LIST_PROVIDER_IDS = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai'];
const LOCAL_MODEL_LIST_PROVIDER_IDS = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai', 'gpt4all'];
const WEBBRAIN_CLOUD_CONTEXT_WINDOW = 1000000;
const WEBBRAIN_CLOUD_LEGACY_CONTEXT_WINDOW = 256000;
const WEBBRAIN_DEVICE_GUID_KEY = 'webbrainDeviceGuid';
Expand Down Expand Up @@ -263,6 +263,19 @@ export class ProviderManager {
supportsVision: true,
enabled: true,
},
gpt4all: {
type: 'openai',
category: 'local',
label: 'GPT4All (Local)',
providerName: 'gpt4all',
baseUrl: 'http://localhost:4891/v1',
model: '',
contextWindow: 16384,
apiKey: '',
supportsAskStreaming: true,
supportsVision: true,
enabled: true,
},
azure_openai: {
type: 'azure_openai',
category: 'cloud',
Expand Down Expand Up @@ -632,7 +645,7 @@ export class ProviderManager {

/**
* Provider category for filter UI. Returns one of:
* 'local' — runs on the user's machine (llama.cpp, ollama, lmstudio, jan, vllm, sglang, localai)
* 'local' — runs on the user's machine (llama.cpp, ollama, lmstudio, jan, vllm, sglang, localai, gpt4all)
* 'cloud' — first-party API endpoint (openai, anthropic, gemini, etc.)
* 'router' — multi-model gateways that fan out to many backends (openrouter, cloudflare, nvidia, groq)
* Reads `config.category` first; falls back to a per-id table so configs
Expand All @@ -641,7 +654,7 @@ export class ProviderManager {
static categoryFor(id, config) {
if (config && config.category) return config.category;
if (config?.type === 'llamacpp') return 'local';
if (['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai'].includes(id)) return 'local';
if (['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai', 'gpt4all'].includes(id)) return 'local';
if (ROUTER_PROVIDER_IDS.includes(id)) return 'router';
return 'cloud';
}
Expand Down
2 changes: 2 additions & 0 deletions src/chrome/src/ui/provider-icons.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ export const PROVIDER_ICON_FILES = {
vllm: 'vllm.svg',
sglang: 'sglang.png',
localai: 'localai.png',
gpt4all: 'gpt4all.svg',
azure_openai: 'azure_openai.svg',
aws_bedrock: 'aws_bedrock.svg',
openai: 'openai.svg',
Expand Down Expand Up @@ -83,6 +84,7 @@ export const PROVIDER_SHORT_LABELS = {
vllm: 'vLLM',
sglang: 'SGLang',
localai: 'LocalAI',
gpt4all: 'GPT4All',
azure_openai: 'Azure OpenAI',
aws_bedrock: 'AWS Bedrock',
openai: 'OpenAI',
Expand Down
12 changes: 11 additions & 1 deletion src/chrome/src/ui/settings.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2094,6 +2094,16 @@ function renderProviders() {
PROMPT_TIER_FIELD,
],
},
gpt4all: {
fields: [
{ key: 'baseUrl', labelKey: 'st.provider.field.server_url', type: 'text', placeholder: 'http://localhost:4891/v1' },
{ key: 'apiKey', labelKey: 'st.provider.field.api_key', type: 'password', placeholder: 'optional' },
{ key: 'model', labelKey: 'st.provider.field.model', type: 'text', placeholder: 'loaded model' },
CONTEXT_WINDOW_FIELD,
{ key: 'supportsVision', labelKey: 'st.provider.field.supports_vision', type: 'checkbox' },
PROMPT_TIER_FIELD,
],
},
azure_openai: {
fields: [
{ key: 'baseUrl', labelKey: 'st.provider.field.api_base_url', type: 'text', placeholder: 'https://{resource}.openai.azure.com' },
Expand Down Expand Up @@ -2417,7 +2427,7 @@ function renderProviders() {
</div>
`;
} else {
const localModelProviders = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai'];
const localModelProviders = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai', 'gpt4all'];
const canLoadModels = localModelProviders.includes(id) && field.key === 'model';
const listAttr = canLoadModels ? `list="models-${id}"` : '';
const datalistHTML = canLoadModels ? `<datalist id="models-${id}"></datalist>` : '';
Expand Down
2 changes: 1 addition & 1 deletion src/chrome/src/ui/sidepanel.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -204,7 +204,7 @@ const pinCoachmarkDismissed = (async function initPinCoachmark() {
const localModels = document.getElementById('ob-local-models');
const localModelList = document.getElementById('ob-local-model-list');
const totalSteps = steps.length;
const LOCAL_PROVIDER_ORDER = ['jan', 'lmstudio', 'ollama', 'llamacpp', 'vllm', 'sglang', 'localai'];
const LOCAL_PROVIDER_ORDER = ['jan', 'lmstudio', 'ollama', 'llamacpp', 'vllm', 'sglang', 'localai', 'gpt4all'];
let current = 0;
let localScanStarted = false;
let localModelChoices = [];
Expand Down
1 change: 1 addition & 0 deletions src/firefox/icons/providers/SOURCES.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ Most brand marks come from [Lobe Icons](https://github.com/lobehub/lobe-icons)
| llamacpp | Jan app asset (brand mark used for llama.cpp) |
| jan | Jan official app icon |
| localai | LocalAI official logo (`mudler/LocalAI`) |
| gpt4all | Simple mark (not an official GPT4All brand asset) |
| sglang | SGLang official `logo_square` (`sgl-project/sglang`) |
| webbrain_cloud | WebBrain extension icon |
| 302ai, abacus, aihubmix, alibaba-coding-plan, alibaba-coding-plan-cn, azure-cognitive-services, bailing, baseten, berget, cerebras, chutes, clarifai, cloudferro-sherlock, cohere, cortecs, deepinfra, digitalocean, dinference, drun, evroc, fastrouter, friendli, google-vertex, google-vertex-anthropic, helicone, iflowcn, inception, inference, io-net, jiekou, kilo, kimi-for-coding, kuae-cloud-coding-plan, llama, lucidquery, meganova, minimax-cn-coding-plan, minimax-coding-plan, moark, modelscope, morph, nano-gpt, nebius, nova, novita-ai, ollama-cloud, opencode, opencode-go, ovhcloud, perplexity, perplexity-agent, poe, privatemode-ai, qihang-ai, qiniu-ai, requesty, scaleway, siliconflow, siliconflow-cn, stackit, stepfun, submodel, synthetic, tencent-coding-plan, upstage, v0, venice, vercel, vivgrid, vultr, wandb, xiaomi, zai-coding-plan, zenmux, zhipuai, zhipuai-coding-plan | OpenCode provider icon set at commit `62e4641235d7847dadc60da37cca8a023dd54fc1` (MIT); DInference SVG normalized with a `viewBox` |
Expand Down
4 changes: 4 additions & 0 deletions src/firefox/icons/providers/gpt4all.svg
View file
Open in desktop
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
17 changes: 15 additions & 2 deletions src/firefox/src/providers/manager.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ import {
} from './context-windows.js';

const WEBBRAIN_CLOUD_PROVIDER_ID = 'webbrain_cloud';
const LOCAL_MODEL_LIST_PROVIDER_IDS = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai'];
const LOCAL_MODEL_LIST_PROVIDER_IDS = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai', 'gpt4all'];
const WEBBRAIN_CLOUD_CONTEXT_WINDOW = 1000000;
const WEBBRAIN_CLOUD_LEGACY_CONTEXT_WINDOW = 256000;
const WEBBRAIN_DEVICE_GUID_KEY = 'webbrainDeviceGuid';
Expand Down Expand Up @@ -250,6 +250,19 @@ export class ProviderManager {
supportsVision: true,
enabled: true,
},
gpt4all: {
type: 'openai',
category: 'local',
label: 'GPT4All (Local)',
providerName: 'gpt4all',
baseUrl: 'http://localhost:4891/v1',
model: '',
contextWindow: 16384,
apiKey: '',
supportsAskStreaming: true,
supportsVision: true,
enabled: true,
},
azure_openai: {
type: 'azure_openai',
category: 'cloud',
Expand Down Expand Up @@ -617,7 +630,7 @@ export class ProviderManager {
static categoryFor(id, config) {
if (config && config.category) return config.category;
if (config?.type === 'llamacpp') return 'local';
if (['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai'].includes(id)) return 'local';
if (['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai', 'gpt4all'].includes(id)) return 'local';
if (ROUTER_PROVIDER_IDS.includes(id)) return 'router';
return 'cloud';
}
Expand Down
2 changes: 2 additions & 0 deletions src/firefox/src/ui/provider-icons.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,7 @@ export const PROVIDER_ICON_FILES = {
vllm: 'vllm.svg',
sglang: 'sglang.png',
localai: 'localai.png',
gpt4all: 'gpt4all.svg',
azure_openai: 'azure_openai.svg',
aws_bedrock: 'aws_bedrock.svg',
openai: 'openai.svg',
Expand Down Expand Up @@ -83,6 +84,7 @@ export const PROVIDER_SHORT_LABELS = {
vllm: 'vLLM',
sglang: 'SGLang',
localai: 'LocalAI',
gpt4all: 'GPT4All',
azure_openai: 'Azure OpenAI',
aws_bedrock: 'AWS Bedrock',
openai: 'OpenAI',
Expand Down
12 changes: 11 additions & 1 deletion src/firefox/src/ui/settings.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2042,6 +2042,16 @@ function renderProviders() {
PROMPT_TIER_FIELD,
],
},
gpt4all: {
fields: [
{ key: 'baseUrl', labelKey: 'st.provider.field.server_url', type: 'text', placeholder: 'http://localhost:4891/v1' },
{ key: 'apiKey', labelKey: 'st.provider.field.api_key', type: 'password', placeholder: 'optional' },
{ key: 'model', labelKey: 'st.provider.field.model', type: 'text', placeholder: 'loaded model' },
CONTEXT_WINDOW_FIELD,
{ key: 'supportsVision', labelKey: 'st.provider.field.supports_vision', type: 'checkbox' },
PROMPT_TIER_FIELD,
],
},
azure_openai: {
fields: [
{ key: 'baseUrl', labelKey: 'st.provider.field.api_base_url', type: 'text', placeholder: 'https://{resource}.openai.azure.com' },
Expand Down Expand Up @@ -2361,7 +2371,7 @@ function renderProviders() {
</div>
`;
} else {
const localModelProviders = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai'];
const localModelProviders = ['llamacpp', 'ollama', 'lmstudio', 'jan', 'vllm', 'sglang', 'localai', 'gpt4all'];
const canLoadModels = localModelProviders.includes(id) && field.key === 'model';
const listAttr = canLoadModels ? `list="models-${id}"` : '';
const datalistHTML = canLoadModels ? `<datalist id="models-${id}"></datalist>` : '';
Expand Down
2 changes: 1 addition & 1 deletion src/firefox/src/ui/sidepanel.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -82,7 +82,7 @@ if (globalThis.browser?.storage?.onChanged) {
const localModels = document.getElementById('ob-local-models');
const localModelList = document.getElementById('ob-local-model-list');
const totalSteps = steps.length;
const LOCAL_PROVIDER_ORDER = ['jan', 'lmstudio', 'ollama', 'llamacpp', 'vllm', 'sglang', 'localai'];
const LOCAL_PROVIDER_ORDER = ['jan', 'lmstudio', 'ollama', 'llamacpp', 'vllm', 'sglang', 'localai', 'gpt4all'];
let current = 0;
let localScanStarted = false;
let localModelChoices = [];
Expand Down
Loading
Loading