Skip to content

inference: expose opt-in qwen3.6 model policy#244

Merged
sheawinkler merged 1 commit into
mainfrom
sync/public-qwen36-opt-in-model-policy
May 30, 2026
Merged

inference: expose opt-in qwen3.6 model policy#244
sheawinkler merged 1 commit into
mainfrom
sync/public-qwen36-opt-in-model-policy

Conversation

@sheawinkler
Copy link
Copy Markdown
Owner

Summary

  • exposes explicit no-download Dream Mode model policy in /v1/inference/runtime-policy
  • recommends Mudler Qwen3.6 GGUF as the opt-in advanced GGUF target for llama.cpp-compatible runtimes
  • keeps Huihui abliterated GGUF metadata private-eval gated behind GO_DREAM_ALLOW_UNCENSORED_MODELS=true

Local verification

  • GOCACHE=/Volumes/wd_black/codex_go_cache GOMODCACHE=/Volumes/wd_black/codex_gomod_cache go test -count=1 ./... (services/gateway-go)
  • bash -n scripts/inference_runtime_policy.sh scripts/inference_backend_guard.sh scripts/benchmark_inference_backends.sh
  • python3 -m py_compile scripts/agent/contextlattice-dream
  • git diff --check

@sheawinkler sheawinkler merged commit d41cc79 into main May 30, 2026
1 check passed
@github-actions github-actions Bot added documentation Improvements or additions to documentation go Pull requests that update go code runtime Runtime, compose, gateway, and operational behavior labels May 30, 2026
@sheawinkler sheawinkler deleted the sync/public-qwen36-opt-in-model-policy branch May 30, 2026 21:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

documentation Improvements or additions to documentation go Pull requests that update go code runtime Runtime, compose, gateway, and operational behavior

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant