Skip to content

Make vLLM instruct thinking mode configurable - #464

Merged
ArtemVazh merged 3 commits into
mainfrom
configurable-vllm-thinking
Sep 1, 2026
Merged

ArtemVazh merged 3 commits into
mainfrom
configurable-vllm-thinking

Conversation

@ArtemVazh

Copy link
Copy Markdown
Collaborator

Summary

  • preserve the original change from Disable thinking mode in vLLM instruct chat #457 with its commit author intact
  • expose enable_thinking on WhiteboxModelvLLM
  • keep thinking disabled by default and forward the configured value through chat_template_kwargs

Attribution

The first commit is cherry-picked from #457 and retains dmndxld <dmndxld@gmail.com> as its author. The configurability change is a separate follow-up commit.

Supersedes #457.

Validation

  • Python compilation passed
  • isolated smoke checks covered both enable_thinking=False and enable_thinking=True
  • no test files are included in the commits

@ArtemVazh
ArtemVazh merged commit 5a2e7e0 into main Sep 1, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants