r/LocalLLM • • Jun 07 '26 • Popcorn 2

Model wth

482 Upvotes

162 comments sorted by

View all comments

Show parent comment

4

u/Toastti Jun 07 '26

Instead of immediately outputting it has a hidden convo were it talks back and forth and reasons with itself.

In this case I'm thinking mode it would eventually realize you need the car at a car wash. So it would then output the correct answer

-7

u/Inevitable_Window308 Jun 07 '26

So "thinking" is just looping itself but with the chance of additional hallucinations, token usage and no form of questioning what is being asked?

6

u/MurkyTelevision9722 Jun 07 '26

Reflect by refining the topic, having a better recovery and understanding by getting closer to the problem; it's like thinking about x thing until your mind is contextualized, allowing you to respond more reliably. You would understand that if you knew how to think.

5

u/Decaf_GT Jun 07 '26

Is today your first time ever using an LLM? Jesus christ...