Skip to content

docs: recommended sampling = Qwen instruct profile (presence_penalty) - #32

Closed
marzukia wants to merge 2 commits into
mainfrom
docs/qwen-recommended-sampling
Closed

marzukia wants to merge 2 commits into
mainfrom
docs/qwen-recommended-sampling

Conversation

@marzukia

Copy link
Copy Markdown
Owner

Updates the Recommended sampling section to the official Qwen3.5-122B-A10B Instruct / non-thinking profile.

  • Old (thinking-ish): temp 0.6, top_p 0.95, top_k 20, repetition_penalty 1.05
  • New (Instruct, for tool-calling): temp 0.7, top_p 0.8, top_k 20, min_p 0.0, repetition_penalty 1.0, presence_penalty 1.5

Key change: presence_penalty (not repetition_penalty) is the model card's recommended anti-repetition lever, set between 0 and 2, higher risks language mixing. Also documents the never-greedy-decode warning and the thinking-mode profile. Source: the official Qwen/Qwen3.5-122B-A10B model card.

marzukia and others added 2 commits July 15, 2026 10:12
Replace the old thinking-mode defaults (temp 0.6, top_p 0.95, rep_penalty
1.05) with the official Qwen3.5-122B-A10B Instruct/non-thinking profile:
temp 0.7, top_p 0.8, top_k 20, min_p 0.0, repetition_penalty 1.0,
presence_penalty 1.5. presence_penalty is the actual anti-repetition
lever per the model card; repetition_penalty stays at 1.0. Adds the
greedy-decode warning and the thinking-mode profile.
@marzukia marzukia closed this Jul 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant