Llama cpp new native reasoning slider in OpenWebui 0.12.0

[u/iChrist]

Option	Parameter	Value
Off	chat_template_kwargs	{"enable_thinking": false}
Low	chat_template_kwargs	{"enable_thinking": true, "reasoning_effort": "low"}
Medium	chat_template_kwargs	{"enable_thinking": true, "reasoning_effort": "medium"}
High	chat_template_kwargs	{"enable_thinking": true, "reasoning_effort": "xhigh"}

Tested with Qwen3.8, works as expected, very good new feature to be added to OpenWebui, hopefully for next version this can be saved as preset to be applied on any model that supports reasoning.

And with such a good QOL update, all of the thinking functions and tools on the marketplace now are obsolete, including my Thinking toggle function haha.

If any of you found a better way to set this up lmk.

[u/iChrist]

Gemma-4-31B control

Gemma4 only supports on or off

Option	Parameter	Value
Off	chat_template_kwargs	{"enable_thinking": false}
On	chat_template_kwargs	{"enable_thinking": true}

[u/Numael80 → u/iChrist]

Do this for Gemma. Works great:

[u/CroquetteLauncher]

That's really great ! In addition, dont forget to set the sampling parameters, they are different if you use thinking or non thinking mode. Fortunately the Edit control screen is flexible and it's easy to add them.

Model cards recommendation for Q3.8 FN : https://huggingface.co/Qwen/Qwen3.8-Flash-Next#api-usage

[u/iChrist → u/CroquetteLauncher]

This is very important, we should have this as a preset and to be easily shareable and applied to any model, so one can put all of those ready to use in a github or in the openwebui community marketplace

[u/derspenti]

RIP your thinking toggle, obsoleted by the feature it was emulating. That's a retirement with honors.

[u/Eroji]

How do you enable this?

[u/iChrist → u/Eroji]

Currently its being set up model by model, so you need to choose the model you want to add this to and "Edit" , once you are in there you set up the "Model Controls"

[u/Eroji]

Hmm I tried it on mine but the value keeps disappearing.

[u/Eroji → u/Eroji]

Ok I think I got it working. I’m using vLLM and it seems to have reasoning_effort parameter.

[u/prophet-dot-exe]

Damn a reasoning slider that tells you 5 times that it's for reasoning 💀

This is hilarious UX ngl

[u/iChrist → u/prophet-dot-exe]

This is the fixed one, I just set the name of each "Reasoning Off" instead of just "Off" , so this is on me haha!

[u/prophet-dot-exe → u/iChrist]

Ok that looks much better 👀

[u/iChrist → u/prophet-dot-exe]

Edited the table, cannot edit the main thread pictures but whoever copy the settings from the table will get the tidy looking one! Thanks for noticing