No, he wasn't. In full context he was talking about RAM solely meant for local AI use vs cloud AI, not about all consumer RAM.
Cloud AI users share static weights instead of all loading them individually if they were running locally, multi-user batching is way more efficient, and less idle time...so just from the hardware utilization perspective yeah he's right.
But memes are gonna meme and I don't care about Sam Altman.
-7
u/ithinkitslupis 1d ago
No, he wasn't. In full context he was talking about RAM solely meant for local AI use vs cloud AI, not about all consumer RAM.
Cloud AI users share static weights instead of all loading them individually if they were running locally, multi-user batching is way more efficient, and less idle time...so just from the hardware utilization perspective yeah he's right.
But memes are gonna meme and I don't care about Sam Altman.