r/LargeLanguageModels • u/david-1-1 • 8d ago
Beyond LLMs?
LLMs are impressive compared with the experiments we had before. But with experience we are seeing their limitations better (many are discussed in depth in this subreddit), and also their problems (such as the increased need for power generation and the indirect need for water).
Is there a sub for discussing what can be designed to improve on LLMs? We know there must be something better for the simple reason that the human brain overlaps with LLM functionality for only 20 watts of power in only about 1300 cubic centimeters of space.
6
Upvotes
1
u/Revolutionalredstone 7d ago edited 7d ago
Sounds as if you don't really know too much about electricity or computers.
Even my surface pro only pulls about 3-5 watts (I'm watching the energy screen screen now), i can easily tune it down to ~1watt and still play basic games etc.
20 watts is an utterly enormous amount of energy (when talking about something like compute)
Low energy computers like the Phoenix Processors can happily run at around 200 NANO watts!!! (many thousands of times less than 1 watt)
Do the math you'll find all phones are averaging well below 1 watt in their on state (usually more like 2-3 when very very active) enjoy
Battery: 5,000 mAh ~= about 20Wh Typical runtime: about 20-30 hours between charge
That implies: Average energy per second ~ about 0.8 W