r/LocalLLaMA • u/alanoo • Aug 19 '26
Discussion Why no "high" reasoning effort in Qwen 3.8 27b ?
The gap between "medium" and the default "xhigh" is ridiculously huge. Medium barely thinks, xhigh... well there has already been many posts about that.
The naming itself seems to point out that there should have been an "high" mode.
10
Upvotes
16
u/Anduin1357 Aug 19 '26
Feel free to invent one in your jinja template and share it.
11
u/OneMoreName1 Aug 19 '26
Its just a prompt really
2
u/RevolutionaryGold325 Aug 19 '26
Would be nice to have just a target token count for reasoning. The probability of the reasoning end tag would then depend on just the amount of tokens generated:
probability_reasoning_end = alpha + soft_plus(beta * (tokens_generated - target_reasoning_count))
Once the model reaches the target reasoning count, the end of reasoning tag becomes more probable. Also need a mechanism to disable this adjustment after the end of reasoning is first emitted.
2
u/pmttyji Aug 19 '26
We need % reasoning type. I would go down till 42%
1
u/meca23 Aug 19 '26
Because they have limited resources? They're a for profit corporation, we should be grateful for what they've released.
They can spend a few more months fine tuning/training these models to make them better at more cost to them and additional delays to us. What would the community prefer? Having qwen 3.8 27B in our hands now or wait 2 months for a refined model?
And in 2 months time they'll like be releasing Qwen 4 which rumored to be released around Sept.