feat: add OpenShift deployment and numeric reasoning controls#5035
Open
gprocunier wants to merge 3 commits into
Open
feat: add OpenShift deployment and numeric reasoning controls#5035gprocunier wants to merge 3 commits into
gprocunier wants to merge 3 commits into
Conversation
Add restricted-SCC OpenShift images, Kustomize base/example overlays, rollout documentation, readiness probe auth exemption, and regression coverage for scoped CA handling.
gprocunier
marked this pull request as draft
July 18, 2026 23:57
Author
|
@pewdiepie-archdaemon from my testing, effort for thinkingmachine models like inkling will need the float slider if you want to use them properly. https://huggingface.co/thinkingmachines/Inkling
|
gprocunier
marked this pull request as ready for review
July 19, 2026 00:10
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.

Summary
Adds a production-oriented OpenShift deployment path for Odysseus and endpoint-scoped continuous reasoning controls for compatible local models.
0.00to0.99thinking-effort slider for endpoints with the float capability enabledchat_template_kwargson synchronous, asynchronous, streaming, and tool-call requestsWhy
Some model chat templates accept a continuous reasoning-effort value while OpenAI-compatible server schemas restrict the top-level
reasoning_effortfield to named levels. Passing an explicitly configured float throughchat_template_kwargslets the model template receive the intended value without model-name heuristics or changes to other providers.The control is capability driven and endpoint scoped. It is rendered only when
reasoning_effort_typeisfloat.Linked Issue
OpenShift deployment work is part of #5037.
Target Branch
dev.Type of Change
Checklist
dev.How to Test
Render the OpenShift base and example overlay:
Configure a compatible endpoint with a continuous effort value:
Confirm Admin > Added Models displays the slider and that chat and tool-call requests contain:
{"chat_template_kwargs":{"reasoning_effort":0.9}}Run the focused checks:
python -m pytest -q tests/test_model_routes.py tests/test_llm_core_*.py node --check static/js/admin.jsValidation
node --check static/js/admin.jspassedVisual Change
Admin > Added Models gains a compact thinking-effort slider only for endpoints configured with the float capability. Other endpoint rows are unchanged.