Skip to content

[FEAT] Support "Hybrid" model selection #51

@NeonDaniel

Description

@NeonDaniel

Objective

Currently, Gemini, Ollama, and vLLM are selectable options for the LLM backend to use. A "Hybrid" option should allow for selecting a different backend per-Advisor and for the Orchestrator.

Initial Implementation Requirements

  • Update configuration to define a "Default Backend" for each persona
  • Add a "Hybrid" option to the selection UI
  • Persist Hybrid configuration to user profiles
  • Handle user profile config per-advisor at inference time

Other Considerations

  • BrainForge personas are determined at runtime; those personas will always need to call the BrainForge endpoint (not configurable to use others)

Metadata

Metadata

Type

No type
No fields configured for issues without a type.

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions