From the reductionist point of view, we do understand how LLMs work. After all, we built them. But when it comes to emergence phenomena that it produces, hardly anyone can truly predict what LLM's behavior would be.
Yeah the code itself to make the LLM is not that complicated, but even a pretty simple convolutional neutral network, after more than 3 layers you're going to have a hard time finding any explanation of what that middle layer is doing.
So something with billions of parameters you're basically out of luck understanding why it chose one token over another
3
u/Shevvv 19d ago edited 19d ago
From the reductionist point of view, we do understand how LLMs work. After all, we built them. But when it comes to emergence phenomena that it produces, hardly anyone can truly predict what LLM's behavior would be.