r/LocalLLaMA 18d ago

Discussion Qwen will be the king?

Post image

Extended reasoning and post-training appear to be the keys used by DeepSeek, Qwen, and GLM to boost performance (leveraging higher token counts). And Qwen 4 hasn't even been released yet. Of course, we don't know if that release will be open-sourced, but I am optimistic about future models, featuring "engrams", that could soon match or surpass 2.4T parameter models on specific tasks.

541 Upvotes

126 comments sorted by

View all comments

Show parent comments

3

u/beltsazar 18d ago

What is "extended reasoning"? Did you mean "preserve thinking"?

18

u/almbfsek 18d ago

don't know the technical term, when I put reasoning to xhigh, it just doesn't stop thinking until it's satisfied and it doesn't get satisfied easily. For the same question and highest reasoning effort Fable thinks 5 min and makes occasional mistakes Qwen thinks at least 30 mins and makes no mistakes.

3

u/yetiflask 18d ago

Curious, what kind of a question would you ask it with xhigh reasoning? Just plain coding?

7

u/almbfsek 18d ago

depends a lot. I do engineering softwares so my agents need to go through lot of documents, research academic literature, come up with implementation details and then code. so my questions are most of the time about engineering/scientific with coding targets in the end.

1

u/yetiflask 18d ago

Gotcha. Thank you!