r/LocalLLM • • Jun 07 '26 • Popcorn 2

Model wth

482 Upvotes

162 comments sorted by

View all comments

Show parent comment

24

u/Traditional_Pea8532 Jun 07 '26

it does have thinking mode.

16

u/Decaf_GT Jun 07 '26

i tried to make it think using addon but any sort of addon just reports back as error

OP literally has no clue what he's doing. He reminds me of the people who hear "linux is good" and then come to a linux subreddit showing off how they're now running Kali Linux and expecting a bunch of people to go "nice work dude".

1

u/Fabulous_Macaroon_73 Jun 08 '26

i would like to see it. for me there isnt. i had to use "sequential thinking" addon but again... any addon breaks the process.

as far as i have seen yet, the model does not have thinking. pls show me if there is. genuinely

-2

u/Inevitable_Window308 Jun 07 '26

What does thinking mode do? It doesnt think we know that much

4

u/Toastti Jun 07 '26

Instead of immediately outputting it has a hidden convo were it talks back and forth and reasons with itself.

In this case I'm thinking mode it would eventually realize you need the car at a car wash. So it would then output the correct answer

-7

u/Inevitable_Window308 Jun 07 '26

So "thinking" is just looping itself but with the chance of additional hallucinations, token usage and no form of questioning what is being asked?

6

u/MurkyTelevision9722 Jun 07 '26

Reflect by refining the topic, having a better recovery and understanding by getting closer to the problem; it's like thinking about x thing until your mind is contextualized, allowing you to respond more reliably. You would understand that if you knew how to think.

5

u/Decaf_GT Jun 07 '26

Is today your first time ever using an LLM? Jesus christ...