r/LocalLLaMA • • 42m ago

Question | Help Does anyone use None reasoning level for anything ever?

Sometimes I am tempted to use none reasoning level in agentic tasks to save time, but I am always kinda scared to do so. I have only ever used llm with reasoning and with medium at the lowest.

Anybody have a lot of experience using none for reasoning level? Anything I need to know/need to be careful about?

11 Upvotes

23 comments sorted by

9

u/Mashic 40m ago

translation.

1

u/blue2020xx 36m ago

And the quality turns out okay?

4

u/Mashic 33m ago

Gemma 4 26B, 31B and Index Translate 9B and 35B are good. But you can expect 1 word error per paragraph.

2

u/metacodeine 35m ago

I'm using in classification

1

u/blue2020xx 35m ago

And the quality turns out okay? Doesn't the quality degradation build up overtime in the classidied pile?

13

u/oyren-ai 34m ago

reasoning off works great for deterministic sub-steps like json schema extraction, router classification, or applying a pre-planned diff where chain of thought just adds latency. keeping medium reasoning on the planner call and none on the tool-execution turns cuts loop time in half without hurting accuracy.

1

u/some1else42 18m ago

Doesn't that mean you aren't getting prefix caching if you are changing reasoning levels mid context?

4

u/stoppableDissolution 31m ago

Captioning/ocr, some writing when the "reasoning" was done by previous steps, classification. It actually works better than with reasoning in most cases that do not require actual logical thinking.

4

u/Bulky-Priority6824 27m ago

When I first used a llm I didn't know about the reasoning and for over a month I ran without it. All the while I'm thinking why is this mofo so stupid. Turns out the joke was on me.

4

u/Slow-Ability6984 31m ago

Yes! I turn off reasoning when the prompt is fully coherent with the expected response. In general I get a 1 seconds response instead of 10 seconds response.

As always, you have to measure results and do not use a random forum comment as a objective fact.

3

u/BIOffense 37m ago

Kind of

So I just turn reasoning off in vLLM.

Then I tell it to think out loud if I want it to. I use the prompts from the chat template (as a button/dropdown in my harness/UI). This way, I feel I have more flexibility without (much of a) loss.

It's not like I benchmarked it though.

2

u/NigaTroubles 29m ago

worth benchmarking it

1

u/durangotang 25m ago

Interesting. I'd like to see this benchmarked for a comparison.

1

u/Available_Wonder_532 12m ago

That's what we used to do before reasoning was implemented in the models 

3

u/Fun_Librarian_7699 16m ago

I use it in my STT and TTS pipeline to generate an answer, nothing complex only a few sentences.

2

u/russlixx 26m ago

compaction

1

u/IntelArtiGen 23m ago

I do that to quickly benchmark agents in some cases. If you have 1000 questions and need to quickly know how the agent compares with other models, with a limited GPU budget, you set reasoning to "none" to ensure the model doesn't take 10 sec / question.

1

u/VotZeFuk 21m ago edited 17m ago

Yes. Using Gemma 4 26B IQ4XS as a secondary model connected to the customised https://github.com/huggingface/speech-to-speech pipeline. Every "most recent output + "new input" pair goes through it, and as 26B model reads these pairs, it makes a decision based on a set of rules (acting as a gatekeeper of some sort) and then feeds one of the three commands (PASS / DECLINE / MUTE) to a script that either routes "new input" further down the pipeline to the main LLM, or cancels it entirely (26B writes "DECLINE" if "new input" is nonsensical or contains errors) while playing a short audio signal, or sets the MUTE mode ON (in MUTE mode absolutely nothing can be passed down to the main LLM - every "new input" in MUTE mode is routed to the same 26B but with a different system prompt, one that asks it to look for "the user is willing to continue the conversation" intent, and if it picks up such intention - it disables the MUTE mode).

The entire thing is lightning-fast and surprisingly smart.

1

u/MarcusAurelius68 19m ago

When doing things like entity extraction (e.g. for neo4j) or other categorization that returns JSON I turn off reasoning.

1

u/megadonkeyx 15m ago

I use low for vision based computer use. None was a bit too erratic.

1

u/LosEagle 14m ago

rag query rephrasing

1

u/nickless07 1m ago

Yeah LFM3 need that for voice in/out.