Description:
To provide a seamless "out-of-the-box" experience and a reliable fallback when API credits are exhausted or internet is restricted, we should automate the setup of a local LLM provider.
Currently, Chacha relies on Anthropic or Gemini. Adding an automated Ollama installation and model pull during the initial setup will allow users to have a functioning assistant without needing an external API key immediately.
Proposed Workflow
Detection: During chacha setup run, the CLI should check if ollama is already installed in the user's $PATH.
Automated Install: If not found:
macOS/Linux: Trigger the official install script: curl -fsSL https://ollama.com/install.sh | sh.
Windows: Provide the download URL or use winget install ollama.
Model Provisioning: Once Ollama is confirmed, automatically run ollama pull gemma:2b.
Rationale: Gemma 2B is lightweight enough for most laptops while remaining highly capable for commit message generation and basic code explanations.
Configuration Update: * Update the auto-detection logic to include ollama as a fallback provider if no environment variables (CLAUDE_API_KEY or GEMINI_API_KEY) are found.
Description:
To provide a seamless "out-of-the-box" experience and a reliable fallback when API credits are exhausted or internet is restricted, we should automate the setup of a local LLM provider.
Currently, Chacha relies on Anthropic or Gemini. Adding an automated Ollama installation and model pull during the initial setup will allow users to have a functioning assistant without needing an external API key immediately.
Proposed Workflow
Detection: During chacha setup run, the CLI should check if ollama is already installed in the user's $PATH.
Automated Install: If not found:
macOS/Linux: Trigger the official install script: curl -fsSL https://ollama.com/install.sh | sh.
Windows: Provide the download URL or use winget install ollama.
Model Provisioning: Once Ollama is confirmed, automatically run ollama pull gemma:2b.
Rationale: Gemma 2B is lightweight enough for most laptops while remaining highly capable for commit message generation and basic code explanations.
Configuration Update: * Update the auto-detection logic to include ollama as a fallback provider if no environment variables (CLAUDE_API_KEY or GEMINI_API_KEY) are found.