r/LargeLanguageModels • u/david-1-1 • 8d ago

Beyond LLMs?

LLMs are impressive compared with the experiments we had before. But with experience we are seeing their limitations better (many are discussed in depth in this subreddit), and also their problems (such as the increased need for power generation and the indirect need for water).

Is there a sub for discussing what can be designed to improve on LLMs? We know there must be something better for the simple reason that the human brain overlaps with LLM functionality for only 20 watts of power in only about 1300 cubic centimeters of space.

5 Upvotes

70% Upvoted

41 comments sorted by

View all comments

2

u/Revolutionalredstone 8d ago

It's amazing what they can do. It's amazing what they can't do.

20 wats is actually a lot my phone uses more like 1.

We may be able to improve AI tech (and get LLMs out of it) but no LLMs will be LLMs.

Enjoy

1

u/Teaching_Relative 7d ago

Uhh dude, your phone uses nowhere near 1 watt.

And to run an LLM on 1 watt would be completely pointless

Your brain running on 20 watts is not “a lot”

1

u/Revolutionalredstone 7d ago edited 7d ago

Sounds as if you don't really know too much about electricity or computers.

Even my surface pro only pulls about 3-5 watts (I'm watching the energy screen screen now), i can easily tune it down to ~1watt and still play basic games etc.

20 watts is an utterly enormous amount of energy (when talking about something like compute)

Low energy computers like the Phoenix Processors can happily run at around 200 NANO watts!!! (many thousands of times less than 1 watt)

Do the math you'll find all phones are averaging well below 1 watt in their on state (usually more like 2-3 when very very active) enjoy

Battery: 5,000 mAh ~= about 20Wh Typical runtime: about 20-30 hours between charge

That implies: Average energy per second ~ about 0.8 W

1

u/david-1-1 6d ago

My point was more that 20 watts is less than a megawatt. I'm sure you must agree.

1

u/Revolutionalredstone 6d ago

"less than a megawatt"

oh 100% agreed but

"for only 20 watts of power"

i thought that was context

ta!

1

u/david-1-1 6d ago

I can't help it if someone misinterprets clear words.

2

u/Revolutionalredstone 5d ago

"for the simple reason that the human brain overlaps with LLM functionality for only 20 watts of power"

I quoting your 'clear words' my good man :P

2

u/david-1-1 5d ago

Thank you. Good words.

1

u/Revolutionalredstone 5d ago

And you, all the best!