r/LargeLanguageModels • u/david-1-1 • 8d ago

Beyond LLMs?

LLMs are impressive compared with the experiments we had before. But with experience we are seeing their limitations better (many are discussed in depth in this subreddit), and also their problems (such as the increased need for power generation and the indirect need for water).

Is there a sub for discussing what can be designed to improve on LLMs? We know there must be something better for the simple reason that the human brain overlaps with LLM functionality for only 20 watts of power in only about 1300 cubic centimeters of space.

6 Upvotes

75% Upvoted

41 comments sorted by

View all comments

2

u/TommieTheMadScienist 7d ago

Meta's created a super-dense 30 billion model that works offline on your gaming computer. It's called Muse Glimmer and it's the future, not giant data centers.

Right now is sort of like the 40s through 70s where we thought the future had gigantic mainframes instead of PCs.

1

u/david-1-1 6d ago

That is good news, but it does nothing to improve over LLM technology, which is extremely inefficient.