Skip to content

Add local model support, health check, runner fallback, and hook fixes - #6

Merged
5uck1ess merged 2 commits into
mainfrom
feat/local-model-support
Apr 17, 2026
Merged

Add local model support, health check, runner fallback, and hook fixes#6
5uck1ess merged 2 commits into
mainfrom
feat/local-model-support

Conversation

@5uck1ess

Copy link
Copy Markdown
Owner

Changes

Local model support

  • Update all local configs (llamacpp, ollama, lmstudio, vllm) to gemma4-26b + qwen3.6-36b
  • Create ~/.pi/agent/models.json for llama-swap discovery with correct compat flags
  • Add /health command to ping local endpoints before running workflows
  • Add runner fallback chain (smart -> general -> fast) when a model fails
  • Fix silent step skips — runner now warns when model switch fails

Hook fixes

  • Change security-patterns from blocking writes to advisory warnings
  • Improve context-prune types (replace unsafe casts with named interface)
  • Enhance /status to show active model profile and local endpoint health

Docs

  • Update README with correct local model names and /health command
  • Update install.sh with local model setup instructions

All 306 tests pass.

@5uck1ess
5uck1ess merged commit 3594126 into main Apr 17, 2026
2 checks passed
@5uck1ess
5uck1ess deleted the feat/local-model-support branch April 17, 2026 15:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant