Skip to content

LLM Configuration

Jump to bottom
Waili(瓦砾) edited this page May 27, 2026 · 7 revisions

⚙️ AionUi LLM Configuration Tutorial

This tutorial details how to configure various large language models in AionUi, including Gemini, OpenAI, Anthropic, ModelScope, OpenRouter, and other platforms — plus advanced features like multi-API key rotation.

English | 简体中文

🎯 Configuration Overview

AionUi supports 28+ LLM platforms, including official platforms, cloud providers, Chinese platforms, and international platforms. All platforms are configured through a single flow: Settings → Models → Add Model.

Platform Categories

Official Platforms

  • Gemini - API Key | ✅ Multi-Key Support | Image generation, tool calling
  • Gemini (Vertex AI) - API Key + Project ID | ✅ Multi-Key Support | Enterprise-grade AI services
  • OpenAI - API Key | ✅ Multi-Key Support | Function calling, image generation
  • Anthropic - API Key | ✅ Multi-Key Support | Claude series models

Cloud Providers

  • AWS Bedrock - Access Key / Profile | ❌ Multi-Key Support | AWS enterprise AI services
  • New API - API Key | ✅ Multi-Key Support | Unified multi-model gateway

Chinese Platforms

  • Dashscope (Qwen) - API Key | ✅ Multi-Key Support | Qwen series
  • Dashscope Coding Plan - API Key | ✅ Multi-Key Support | Dashscope coding subscription
  • Zhipu - API Key | ✅ Multi-Key Support | Zhipu AI
  • Moonshot (China) - API Key | ✅ Multi-Key Support | Moonshot (China)
  • Moonshot (Global) - API Key | ✅ Multi-Key Support | Moonshot (Global)
  • Qianfan - API Key | ✅ Multi-Key Support | Baidu Qianfan
  • Hunyuan - API Key | ✅ Multi-Key Support | Tencent Hunyuan
  • Lingyi - API Key | ✅ Multi-Key Support | Lingyi Wanwu
  • ModelScope - API Key | ✅ Multi-Key Support | ModelScope community
  • InfiniAI - API Key | ✅ Multi-Key Support | InfiniAI
  • Ctyun - API Key | ✅ Multi-Key Support | China Telecom Cloud
  • StepFun - API Key | ✅ Multi-Key Support | StepFun

International Platforms

  • DeepSeek - API Key | ✅ Multi-Key Support | DeepSeek models
  • MiniMax - API Key | ✅ Multi-Key Support | MiniMax AI
  • Novita - API Key | ✅ Multi-Key Support | Novita AI gateway
  • OpenRouter - API Key | ✅ Multi-Key Support | Multi-model aggregation gateway
  • PPIO - API Key | ✅ Multi-Key Support | PPIO inference gateway
  • SiliconFlow-CN - API Key | ✅ Multi-Key Support | SiliconFlow (China)
  • SiliconFlow - API Key | ✅ Multi-Key Support | SiliconFlow (Global)
  • xAI - API Key | ✅ Multi-Key Support | xAI Grok models
  • Ark - API Key | ✅ Multi-Key Support | Volcengine Ark
  • Poe - API Key | ✅ Multi-Key Support | Poe platform

Custom Platform

  • Custom - API Key | ✅ Multi-Key Support | OpenAI-compatible interface (supports Ollama, LM Studio, and other local models)

🔑 Configuration: Add Model

LLM configuration interface screenshot - showing model configuration and platform selection

Gemini Platform Configuration

  1. Get Gemini API Key

    • Visit Google AI Studio
    • Login with Google account
    • Create new API Key in "API Keys" page

  2. Configure in AionUi

    • Click the "Settings" icon in the left sidebar
    • Select "Model Settings"
    • Click "Add Model" button
    • Select platform: Gemini
    • Enter API Key
    • System will automatically fetch available model list

New API Platform Configuration

New API is a unified multi-model gateway that aggregates access to various LLM models.

  1. Get New API Key

    • Visit New API GitHub to learn about deployment
    • Or use an existing New API service
    • Get API Key

  2. Configure in AionUi

    • Select platform: New API
    • Enter Base URL (New API service address)
    • Enter API Key
    • Select models (supports multiple protocols: OpenAI, Gemini, Anthropic)
    • Optional: Configure protocol overrides for specific models (modelProtocols)

💡 Tip: New API supports configuring different protocols for different models, e.g., Gemini models use gemini protocol, Claude models use anthropic protocol.

AWS Bedrock Platform Configuration

AWS Bedrock is AWS's enterprise AI service platform, supporting multiple authentication methods.

  1. Prepare AWS Credentials

    • Method 1: Access Key
      • Create a user in AWS IAM and generate Access Key ID and Secret Access Key
      • Ensure the user has Bedrock access permissions
    • Method 2: Profile
      • Configure AWS CLI Profile locally (aws configure --profile <profile-name>)
      • Use the configured Profile name

  2. Configure in AionUi

    • Select platform: AWS Bedrock
    • Select authentication method: Access Key or Profile
    • If selecting Access Key:
      • Enter AWS Region (e.g., us-east-1)
      • Enter Access Key ID
      • Enter Secret Access Key
    • If selecting Profile:
      • Enter AWS Region
      • Enter Profile name (AWS CLI Profile configured locally)
    • System will automatically fetch available Claude model list

Supported AWS Regions:

  • us-east-1 - US East (N. Virginia)
  • us-west-2 - US West (Oregon)
  • eu-west-1 - Europe (Ireland)
  • eu-central-1 - Europe (Frankfurt)
  • ap-southeast-1 - Asia Pacific (Singapore)
  • ap-northeast-1 - Asia Pacific (Tokyo)
  • ap-southeast-2 - Asia Pacific (Sydney)
  • ca-central-1 - Canada (Central)

Gemini (Vertex AI) Platform Configuration

Vertex AI is Google Cloud's enterprise AI service platform.

  1. Get Vertex AI Credentials

    • Visit Google Cloud Console and create a project
    • Enable Vertex AI API in APIs & Services → Library
    • Note your Project ID (format like my-project-123456)
    • Generate a Vertex AI API Key

  2. Configure in AionUi

    • Select platform: Gemini (Vertex AI)
    • Enter your Google Cloud Project ID
    • Enter API Key
    • System will automatically fetch available Vertex AI model list

Custom Platform Configuration

Custom platform allows you to configure any model service that supports an OpenAI-compatible interface — typically locally deployed models or providers not included in the preset list.

  1. Get API Key

    • Visit the platform's API Key management page (or skip if using a local model)
    • Create an API Key and copy it

  2. Configure in AionUi

    • Select platform: Custom
    • Enter the platform's Base URL
    • Enter API Key (use any non-empty placeholder for local models without auth)
    • Enter the model names you want to use

Local Model Examples:

  • Ollama: http://localhost:11434/v1 (local deployment)
  • LM Studio: http://localhost:1234/v1 (local deployment)

💡 For platforms that already appear in the preset list (OpenAI, Anthropic, DeepSeek, xAI, Moonshot, Zhipu, Dashscope, SiliconFlow, Ark, Qianfan, Hunyuan, Lingyi, Poe, InfiniAI, Ctyun, StepFun, Novita, PPIO, MiniMax, OpenRouter, ModelScope), select them directly — the Base URL is filled in automatically and you only need to paste your API Key.

Preset Platform Quick Configuration

AionUi provides multiple preset platforms. After selection, Base URL is automatically filled. You only need to enter the API Key.

Chinese Platform Configuration Examples:

  1. Dashscope (Qwen)

  2. Zhipu (Zhipu AI)

  3. Moonshot

    • Visit Moonshot Console
    • Create API Key
    • In AionUi, select Moonshot (China) or Moonshot (Global), enter API Key

  4. ModelScope

    • Visit ModelScope
    • Login with Alibaba Cloud account, create access token
    • In AionUi, select ModelScope, enter API Key

International Platform Configuration Examples:

  1. OpenRouter

    • Visit OpenRouter
    • Register account and create API Key
    • In AionUi, select OpenRouter, enter API Key
    • Supports access to various open-source and commercial models

  2. DeepSeek

    • Visit DeepSeek Console
    • Create API Key
    • In AionUi, select DeepSeek, enter API Key

  3. SiliconFlow

💡 Tip: All preset platforms support multi-API key rotation. Simply enter multiple keys (comma or line break separated) in the API Key field.

🔄 Multi-API Key Rotation Configuration

Feature Description

AionUi supports automatic multi-API key rotation to improve service reliability and availability:

  • Automatic Rotation: Automatically switch to next key when current key encounters errors
  • Smart Blacklist: Failed keys are temporarily blacklisted for 90 seconds
  • Error Recovery: Blacklisted keys automatically recover after expiration
  • Load Balancing: Randomly select starting key to distribute request pressure

Configuration Method

  1. Enter Multiple Keys in API Key Field

    sk-xxx1,sk-xxx2,sk-xxx3

    Or use line breaks:

    sk-xxx1
sk-xxx2
sk-xxx3

  2. Supported Platforms

    • ✅ Gemini: Supports multi-key rotation
    • ✅ Gemini (Vertex AI): Supports multi-key rotation
    • ✅ OpenAI: Supports multi-key rotation
    • ✅ Anthropic: Supports multi-key rotation
    • ✅ Custom Platform: Supports multi-key rotation (using OpenAI-compatible interface)
    • ✅ New API: Supports multi-key rotation
    • ✅ All platforms using OpenAI-compatible interface: Supports multi-key rotation
      • ModelScope, OpenRouter, Dashscope, DeepSeek, MiniMax, SiliconFlow, Zhipu, Moonshot, xAI, Ark, Qianfan, Hunyuan, Lingyi, Poe, InfiniAI, Ctyun, StepFun, etc.
    • ❌ AWS Bedrock: Does not support multi-key rotation (uses AWS credential authentication)

Multi-API Key configuration screenshot - showing multiple key input format

Rotation Mechanism Details

  1. Error Detection

    • Detect errors like 401 (authentication failed), 429 (rate limit), 503 (service unavailable)
    • Automatically add current key to blacklist

  2. Automatic Switching

    • Randomly select next key from available key list
    • Update environment variables, reinitialize client

  3. Blacklist Management

    • Failed keys are blacklisted for 90 seconds
    • Blacklisted keys automatically recover after expiration
    • Avoid performance issues from frequent switching

❓ Common Questions

Q: How to know if configuration is successful?

A: Check methods:

  • Can see configured platforms and models in model list
  • Can select configured models in conversation interface
  • Can receive normal replies when sending messages

Q: Multi-API key rotation not working?

A: Check points:

  • Ensure key format is correct (comma or line break separated)
  • Check if platform supports multi-key (supported platforms: Gemini, Vertex AI, OpenAI, Anthropic, New API, and all platforms using OpenAI-compatible interface)
  • Check console logs to understand rotation status
  • Note: AWS Bedrock does not support multi-key rotation as it uses AWS credential authentication instead of API Key

Q: Model list empty or loading failed?

A: Possible reasons:

  • API key invalid or expired
  • Base URL configuration error
  • Network connection issues
  • Platform service temporarily unavailable

Q: How to switch between different models?

A: Switching methods:

  • Use the model selector at the bottom-left of the input box in any conversation
  • Each agent (built-in, Claude Code, Codex, Qwen Code, etc.) exposes its own list of available models
  • System will remember your selection preferences per conversation

Q: Configured models not visible in conversation?

A: Check configuration:

  • Ensure model supports function_calling capability
  • Re-save configuration and restart application

📚 Related Documentation

Need Help?

After configuration, you can enjoy multi-platform, multi-model AI experience!

🚀 AionUi Wiki

Welcome to the comprehensive AionUi documentation! Find everything you need to configure, use, and master AionUi.

🏠 Home

📚 Configuration & Usage Guides

Overview

Getting Started

Core Configuration

Support

🎯 Application Use Cases

Overview

Featured Use Cases

🌍 Language Switch

🔗 Quick Links

🤝 Community

Clone this wiki locally