Skip to content

add multi-provider LLM support and dockerized this project.#26

Open
Manikumar-T wants to merge 5 commits into
sooryathejas:mainfrom
Manikumar-T:main
Open

add multi-provider LLM support and dockerized this project.#26
Manikumar-T wants to merge 5 commits into
sooryathejas:mainfrom
Manikumar-T:main

Conversation

@Manikumar-T

Copy link
Copy Markdown
  • Add LLMClient class with unified chat interface across providers
  • Support Ollama and OpenAI-compatible APIs (OpenAI, vLLM, LM Studio)
  • New environment variables:
    • LLM_PROVIDER: select "ollama" or "openai"
    • OPENAI_BASE_URL, OPENAI_MODEL, OPENAI_API_KEY for OpenAI-compatible
  • Add python-dotenv for automatic .env file loading
  • Update docker-compose.yml with new provider env vars
  • Update .env.example with provider configuration documentation

Manikumar-T and others added 5 commits April 28, 2026 08:21
- Add LLMClient class with unified chat interface across providers
- Support Ollama and OpenAI-compatible APIs (OpenAI, vLLM, LM Studio)
- New environment variables:
  - LLM_PROVIDER: select "ollama" or "openai"
  - OPENAI_BASE_URL, OPENAI_MODEL, OPENAI_API_KEY for OpenAI-compatible
- Add python-dotenv for automatic .env file loading
- Update docker-compose.yml with new provider env vars
- Update .env.example with provider configuration documentation

Backward compatible: defaults to Ollama when LLM_PROVIDER not set

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Added Open AI compatible  AI model provider and dockeriresd the
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants