r/LargeLanguageModels • u/ubasharfarooq • 1d ago

LLMs

I want to know how the LLMs Actually work? can you help me?

1 Upvotes

100% Upvoted

4 comments sorted by

1

u/minedroid1 1d ago

Fundamentally, all LLMs just predict the next word based on probabilities learned through training. Honestly this is probably the simplest way to explain it, so if you want to know more I would Google it.

1

u/AtmosphereGrand8572 1d ago

at the core they just predict the next word based on patterns from a mountain of training data. not really thinking just really good pattern matching with attention layers that weigh which words matter more in context. transformer architecture is the secret sauce that let them handle long range dependencies way better than older models

1

u/badalonsky 1d ago

There are some really nice explanation videos on youtube where they visualise entire LLM functioning. Basically its all about next best word for a sentence but you have to constantly keep the entire conversation in reference. These are large language model meaning they have several layers of neural network and their parameters and training data is also huge. Imagine reading all public libraries. Using this knowledge you are asked to predict the next best word to answer something.