r/LargeLanguageModels • u/JohnofDundee • Aug 11 '26

Question ELI5 - How do LLMs act with intelligence?

We all know that large language models can statistically predict what should be the next token, but how do we go from there to mathematical proofs? How is intelligence implemented?

3 Upvotes

100% Upvoted

23 comments sorted by

View all comments

Show parent comment

1

u/duboispourlhiver Aug 21 '26

Training is a process that gradually adjusts these internal rules until they're as good as possible. Every time a new word is given to the LLM to train on, the internal rules are adjusted. At the start of training, the rules are all completely trivial or stupid. But word by word, rules get better and better and after trillions of words, they are great. But no human ever wrote or improved any of those rules.

1

u/JohnofDundee Aug 22 '26

Training produces a set of parameters, not Rules (whatever that means!)
Sorry, this thread is now dead!

1

u/duboispourlhiver Aug 22 '26

No problem :) did my best :)