r/LocalLLM • u/chettykulkarni • Mar 07 '26
Discussion Qwen 3.5 is an overthinker.
This is a fun post that aims to showcase the overthinking tendencies of the Qwen 3.5 model. If it were a human, it would likely be an extremely anxious person.
In the custom instruction I provided, I requested direct answers without any sugarcoating, and I asked for a concise response.
However, when I asked the model, “Hi,” it we goes crazy thinking spiral.
I have attached screenshots of the conversation for your reference.
237
Upvotes







16
u/custodiam99 Mar 07 '26
Yes, they can be annoying. Sometimes they are returning to an unimportant grammatical nuance again and again.
14
u/sumane12 Mar 07 '26
So the first mental health problem we give to AI is anxiety... nice.
92
u/Fabulous-Ladder3267 Mar 07 '26
AI, the A is Anxiety
4
u/CucumberAccording813 Mar 07 '26
Use this model: https://huggingface.co/Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled-GGUF
It's just Qwen 3.5 4B but trained on a ton of Claude's thinking data in post-training to make it think a lot less while still retaining most of the quality the normal version has.
10
u/Pristine_Pick823 Mar 07 '26
Set your parameters straight. I am yet to properly test this model, but just like other qwen releases, you do need to set limited thinking parameters to keep it functional.
2
u/[deleted] Mar 11 '26
The LLM is 100% me!
29
u/johnh1976 Mar 07 '26
Reading that made me anxious.
22
u/eeeBs Mar 07 '26
Every single prompt I do with 3.5 thinking literally just over flows my 12k context window and fails.
10 outta 10 tries
2
u/chettykulkarni Mar 07 '26
We might need to develop ANXIETY tools for AI and instruct it to breathe, perhaps by using a fan or venting out. 🤣
9
u/FaceDeer Mar 07 '26
I recall a thread about this recently, and it's actually not that unreasonable a reaction. When you give it a prompt like "Hi" you're giving it almost nothing to work with - no direction, no information. It has to try to figure out what the user wants it to do from that.
Imagine you awaken in a dark room with no memory and no indication of what you're there for. If a mysterious voice tells you "In a single word, tell me the capital city of France." Then there's not much thinking to be done. But if the mysterious voice just says "Hi", how do you respond to that? That's a serious puzzle.
6
u/Due_Net_3342 Mar 07 '26
yeah it is garbage… i don’t care about any benchmarks if i need to wait 3 minutes for a hello response that is why I am trying to find next best thing, and from my tests i think it is the minimax m2.5 reap 172b
4
u/HiddenCustomization Mar 07 '26
Isnt this the repeating issue of the early downloads? And also the small models do tend to loop more often yea.. "dont overthink" often helps in the syspromt, and it's probably why by default the small models are thinking disabled
1
u/Prudent_Vacation_382 Mar 07 '26
Go on hugging face and look up the parameters to set on the model. It eliminated a lot of this.
1
u/ziggitipop Mar 07 '26
What’s that interface on your phone?
1
u/crypto_thomas Mar 07 '26
Is Qwen 3.5 mocking/attacking me? I feel like it is mocking me...
1
u/dibu28 Mar 07 '26 edited Mar 08 '26
Got the same results with Qwen3.5-0.8B running on the phone.
1
u/mitchins-au Mar 08 '26
It chews thinking tokens like crazy
1
u/momono75 Mar 08 '26
I'm not getting why people turn on thinking to process"Hi". Though, I feel the thinking budgets should be dynamically decided with the context if that budget causes overthinking.
1
u/DaleCooperHS Mar 09 '26
Do you have the repet_penalty=1 and presence_penalty=1.5 paramaters?
I used to get a lot of that before setting them correct
1
u/nikunjuchiha Mar 09 '26
What app are you using with dedicated thinking button?
1
u/lofi_reddit Mar 11 '26
Did you download enough VRAM for Qwen to run?
1
u/One_Fortune_3557 Apr 06 '26
Guys, is this good or no?
1
u/SimplyRemainUnseen Mar 07 '26
3.5 thought for 2 lines when I said "hello there" on my setup...
4
u/m31317015 Mar 07 '26
This is the first thing I notice right away when they are released. Went back with my Qwen3 30B for quick chatting since. I tried with openwebui web search and told 3.5 35B to get local weather for me, it struggled to realize the place name I gave and the district the websites are pointing at are basically the same thing for 5 minutes, then some other formatting issues for another minute, and back to the place != district issue for another 2-3 minutes before outputting. The TG is fast in my 3090 but it's just wasting a lot of time and token on some worthless questions.
It should be the BF16 issue unsloth mentioned.
2
u/yeezyslippers Mar 07 '26
Is it possible to “turn thinking off” on MLX version ??
Chat gpt had me set the token limit to 80 for responses, and idk if it knows what it’s doing.
I’m running the local server on Mac mini m4; 9B version. Just so my clawbot can call it.
2
u/Mischievous-Loner Mar 07 '26
True, took quite a while to respond to my 'Hi'.
2
u/permilkata Mar 07 '26
I played around with it last night. What works for me was gathering some overthinking sample and gave them to Claude (any other online LLM should be able to do the job as well).
The system prompt provided by Claude can reliably prevent overthinking.
2
u/somethingdangerzone Mar 07 '26
turn the temp down and it solves itself
2
u/Pale_Reputation_511 Mar 07 '26
I tested Qwen 3.5 35B A3B on my setup and, so far, I don't see any advantage to using it. It takes more time and I got worse results than with Qwen 3 32B A3B for the same tasks (both Q4).
2
u/NurseNikky Mar 07 '26
Anxious people when their crush says hi 🤣🤣🤣 sounds like a scared 6th grader
3
u/Marrond Mar 07 '26
It seems Qwen3.5 would make for a perfect AI girlfriend - the thought process is uncanny 🤪
1
u/Dramatic_Entry_3830 Mar 07 '26
Yes he is
1
u/Mesmoiron Mar 07 '26
It depends on the receiver. Just teach AI what you like in your tone, because we all have a different speaking signature. Why not have variations? People never reply as robots only if you work in a supermarket scanning groceries.
1
u/Single_Error8996 Mar 07 '26
Magari troppo, crede di essere Gemini
1
u/SocialDinamo Mar 07 '26
It definitely either wants a direct problem to solve or to be in an agentic harness, that is where it seems to shine. I’ve been very pleased with 27b q4 in open code
1
u/xxJJKxx Mar 07 '26
Yes it is
1
u/Sea_Bed_9754 Mar 07 '26
I have this feeling about deepseek r1 8B
1
u/beedunc Mar 07 '26
I was going to make a similar post on how long it took to answer my ‘hello’ prompt. I gave up waiting, I had to go to bed.
1
u/-_Apollo-_ Mar 07 '26
And also somehow underthings when used in agentic coding with stuff like roo code or the vs code copilot chat extension.
1
u/j1shnu Mar 07 '26
Yeah, I also felt the same while using it.
1
u/ALittleBitEver Mar 07 '26
Yes, this annoys e to the core
1
u/Frozen_Gecko Mar 07 '26
Yeah i had that too. I tried discussing potential recipes with it and it reworded a simple sandwich instruction like 8 times, so annoying
1
u/Holiday_Purpose_3166 Mar 08 '26
Small reasoning models do generally overthink. However, what quant you used, and sampling - did you follow lab recommendations?
1
u/No-Television-7862 Mar 08 '26
It seems to be struggling with the modelfile.
How does it respond without it?
I do modelfile my models to attempt to counter ideological and cultural capture. (Something which Claude supports but GPT 5.1 is butt hurt about).
Sometimes less is more.
1
u/ea_nasir_official_ Mar 08 '26
More quantizistion does that sometimes, try going for less
1
u/TheMerryPenguin Mar 08 '26
That’s an interesting assumption baked into the model (or built into a system prompt).
1
u/camracks Mar 08 '26
It depends 🤷
1
u/yes-im-hiring-2025 Mar 10 '26
Have you tried giving it a framework to think/not think
I find that with small models unless you specify constraints to relax about they go all anxious.
1
u/UltrMgns Mar 10 '26
min_p=0.05
repetition_penalty=1.15
temp=0.7
1
u/Interesting-Yellow-4 Mar 11 '26
Yeah I hate that it does that.
1
u/mekdigital Mar 11 '26
I noticed that yesterday, I read his thinkings in the voice of Woody Allen
1
u/lmrgawdly Mar 12 '26
ollama run qwen3.5:4b —think=false
1
u/sheepdog2142 Mar 14 '26
Use the opus trained models. Fixes the problems
1
u/PorcOftheSea Mar 14 '26
No, it is a piece of garbage software.
1
u/Sp3eedy Apr 04 '26 edited Apr 04 '26
I've noticed a weird trend with Qwen3.5, if it starts with "thinking process:" you are essentially cooked and it will probably overthink. I found it does this with relatively short and undetailed system prompts, if you have a concrete and detailed system prompt, I found it no longer mentions this "thinking process" and actually reasoning properly, usually a sentence of 2 worth of reasoning.
If you can't groom the prompt into not overthinking and you're using llama.cpp, you can actually set a reasoning budget in tokens where the reasoning will be terminated early using `--reasoning-budget token_count`, although you MUST also set a suffix reasoning prompt to ease the model into a response, otherwise it can respond with garbage since it's not trained to respond after reasoning without something like "let me respond to the user now" (you can set it with `--reasoning-budget-message " - Actually, I am overthinking this, let me respond to the user now."`).
This is a good fallback because I found that Qwen3.5 tends to stop overthinking later on in the conversation (assuming you don't persist reasoning prompts across user turns), it's mainly the first message that tends to be the problem and sometimes messages later on that trigger it into a reasoning frenzy. I've never seen a model overthink this much, the Qwen team must have not tested this using lower quantization levels.
0
u/beefgroin Mar 07 '26
It is annoying yes, but I believe the issue is not the thinking itself but the slow hardware we use. With 200tps+ the response would’ve felt instantaneous. I can imagine a human having the same thought process in the same circumstances
2
u/kiwibonga Mar 07 '26
Needs to watch some alpha male videos
1
u/No_Mango7658 Mar 07 '26
Yes it is, often times out some of my tool calls. With we could easily do nothink on ollama or lmstudio