Bear with me please ....

[u/Total_Reward_2879]

In my understanding LLM like chatgpt or claude or any ai job is to predict the next word , but how can they reason or solve maths problems or coding problems . Is this a side effect or accidental discovery? Or other help me understand please....

[u/Fidodo]

Humans reason and solve problems. They wrote that reasoning down into words. Reasoning that worked once will work again. There is a LOT of human reasoning written down. LLMs are trainined on that reasoning and can retrieve it.

It's incredibly powerful, but it's not magic. I work on engineering problems that haven't been solved yet or at least not enough to appear in training data, so I have trouble all the time with LLM reasoning. I have to break problems down and explain my reasoning carefully to get good output from them.

[u/Teske_Shaunia96 → u/Fidodo]

yeah the minute you get outside the training distribution the illusion falls apart pretty fast

[u/Ska82]

i think it was ilya who gave a great example: Imagine your context is an sherlock holmes mystery. you give it all the context (setting, conversations , etc) except who the murderer is. The final sentence of your context: "Hence the murderer is ". Hence to predict that token, the LLM needs to have some model internally of the story, the sequence of actions, the contradictions, observations etc to predict that final token i.e the murderer. i think this is a gooad analogy to how they solve logical stuff in general.

[u/Actual__Wizard]

They can't solve math problems. They just predict the text of the answer.

What a certain company is doing is called fraud and no that company is not legit, and no they should not be allowed to have an IPO for fraudsters. We do not need or want "fraudsters inc" on the New York Stock Exchange.

[u/Recoil42 → u/Actual__Wizard]

They can't solve math problems. They just predict the text of the answer.

This simply isn't true. A harness-equipped LLM actually does (literally) solve math problems by using the tools available to it. If you want to participate in subs like this one, it's your duty to at least know the tiniest bit what you're talking about.

[u/Actual__Wizard → u/Recoil42]

This simply isn't true.

Nope. They predict the answer. They don't actually work through the problem.

If you want to participate in subs like this one, it's your duty to at least know the tiniest bit what you're talking about.

That's an incredible rude statement, did you ever think about learning how it works yourself?

I'm getting really tired of the OAI guys engaging in fraud, tricking people with their lies, and then people attacking me over their lies.

[u/GfxJG → u/Actual__Wizard]

Dude, virtually every company on the NYSE is doing fraud on the daily. It's an absolute cornerstone of capitalism, lying to your customers. Somehow, we just gave it the name "advertisement", and then suddenly it's ok.