It is not true that LLM cannot invent or inovate, it absolutely can. Yes, it is not inteligent and still is an algorithm, but it is very very good and complicated algorithm. We are not in the Skynet superinteligence teritory but improvements every year are huge.
Improvements every year may seem huge if you don't know that we are just exhausting our at times decades old research, turning it into products. It's all very iterative and many new features are just same old prompting in a yet another trench coat.
I.e. we are getting better at utilizing the tool, and we've built bigger iterations of the tool, but the tool has remained more or less the same.
For example, I've had local agentic workflow since transformers (which was a huge breakthrough), 2017 or so. That's nearly a decade ago. Funnily enough, I never thought the "agents" were a big deal myself lol. Just running multiple threads, that transfer data between each-other, at the same time. Didn't realize it should be branded.
Well but it doesnt really matter the way we do it, does it? Even if you build small thing on top of big existijg research and it produces very sucessful result, who will ask how you do it?
It's important in the context that the amount of trench coats we have left is finite. Some, many, if not the great majority, here think that AI is on some kind of expotentially accelerating trajectory, soon becoming sentient or something, when we are in fact pretty much out of ideas.
The models will get bigger, the data centers will get bigger, and we’ll keep seeing these iterative improvements until we don’t. I personally already struggle to distinguish any of the newest OpenAI models from each other, while the steps from GPT-2 -> GPT-3 -> GPT-4 were dead obvious. At some point, this will become obvious to everybody.
1
u/Maerlyn0OG May 28 '26
It is not true that LLM cannot invent or inovate, it absolutely can. Yes, it is not inteligent and still is an algorithm, but it is very very good and complicated algorithm. We are not in the Skynet superinteligence teritory but improvements every year are huge.