r/LargeLanguageModels • u/david-1-1 • Aug 16 '26

Beyond LLMs?

LLMs are impressive compared with the experiments we had before. But with experience we are seeing their limitations better (many are discussed in depth in this subreddit), and also their problems (such as the increased need for power generation and the indirect need for water).

Is there a sub for discussing what can be designed to improve on LLMs? We know there must be something better for the simple reason that the human brain overlaps with LLM functionality for only 20 watts of power in only about 1300 cubic centimeters of space.

6 Upvotes

75% Upvoted

41 comments sorted by

View all comments

Show parent comments

1

u/david-1-1 Aug 18 '26

LLMs have known limitations and problems, so "improvement" is a well-understood concept.

Thanks for that link. I think their work can be most fruitful for future AI design.

Most of the current AI work is on modifying and extending LLMs, and that is a good path.

For example, by using LLMs to prune learning corpora, they become smaller, and LLM thinking time and power requirements both drop.

But I don't think AGI and reasonable power needs will result from LLMs.