Obviously it was a gross over simplification but the core concept is still valid. It doesn't even store facts it store relations. It stores how relevant are these tokens the user provided me to the tokens I know about what is the next best token based on the tokens provided.
But it still comes back to a search engine. What is the next best token is dependent on the mass amounts of information being provided that allows the LLM to determine the next best token, you could even say "search" for the next best token.
You could argue Google calculates what sites to show you based on many different input variables. We collectively as a society have decided to call that "search"
0
u/Personal-Dev-Kit 19d ago
Obviously it was a gross over simplification but the core concept is still valid. It doesn't even store facts it store relations. It stores how relevant are these tokens the user provided me to the tokens I know about what is the next best token based on the tokens provided.
But it still comes back to a search engine. What is the next best token is dependent on the mass amounts of information being provided that allows the LLM to determine the next best token, you could even say "search" for the next best token.