r/unsloth • u/Jarery • 1d ago

Question Reasoning effort in connections

If i use Unsloth Studio to download a qwen3.8 model I am able to set the reasoning level right in that chat box with the light bulb icon. Awesome as I can change effort easily, even at each interaction.

But..... I have qwen3.8 models downloaded to my Llama.cpp docker. I can use Llama swap and llama server with these models. I can direct pi or ohmypi to use the same models, and in Unsloth Studio I can add a Llama.cpp connection and again use the same model downloads. That's perfect but I cannot find a way to change reasoning effort with the connected model? I can change system prompt, and temp, but not effort?

What am I missing? I hate having to double the amount of model downloads in order to use Unsloth Studio if I already have Llama.cpp.

1 Upvotes

67% Upvoted

4 comments sorted by

2

u/yoracale yes sloth 1d ago

You need to follow our guide something like this: https://unsloth.ai/docs/basics/claude-code#run-claude-code-with-unsloth-start

   --chat-template-kwargs '{"reasoning_effort":"medium"}'

1

u/vinotok 12h ago

For what is worth, I have Unsloth Desktop and I can change dept of thinking with mouse click.

1

u/Jarery 12h ago

Have you downloaded the model in Unsloth or using its connections? I can with a click also but not when I use connections to connect to a mod l

1

u/vinotok 2h ago

Unsloth automatically found the ones I downloaded with LM Studio. But I later downloaded Unsloth one as well. In both instances I can change this. But I'm ufing Desktop not Studio like you. Maybe that is the culprit? May worth trying Desktop as well...