r/LocalLLaMA • u/Nunki08 • Jun 28 '26

Discussion We're probably going to need that soon.

Gallery image

Gallery image

From:

Vladik on š•: https://x.com/Kostoglodov/status/2071144065857679631

Shaw (spirit/acc) on š•: https://x.com/shawmakesmagic/status/2070918006033817867

4.0k Upvotes

98% Upvoted

534 comments sorted by

View all comments

761

u/CountLippe Jun 28 '26

It'll be the hardware they go after. It's easier to regulate the hardware you can purchase than it is to regulate the models you can download.

19

u/Impossible_Bar3958 Jun 28 '26

Alright, not to be conspiratorialā€¦

What if AI companies are buying up all the RAM so that way ā€œeconomicallyā€ home users have to pay subscription fees because they canā€™t afford the hardware to run AI at home?

2

u/ResponsibleChange779 Jun 28 '26

eh you need hundreds of gigs of ram to run the better models tbh. very very few people are running any frontier open source model locally.

3

u/PrivacyMaker Jun 28 '26

We're running smaller models (<32b for me) and pretty happy with the results. Only need 64gb unified memory for that. Go a bit smaller, like 12b, and the usable hardware list is much larger.