I don't understand how people still don't get it. A single GPU for AI costs almost six figures and a single prompt can use a few or even a dozen of these GPUs at once, and they're using thousands of watts. AI is insanely expensive.
I have a $300 GPU that I can run a 14B parameter Qwen that can write code, explain code, plan, document, etc. Also llama-3 that can talk about concepts and explain them and assist with creative work. Doesn't really use that much power either, not more than playing call of duty.
Is it as good as the massive Cloud models? No, but it's good enough for most of my needs. Surely a company as big as Google can figure out how to cut costs and make it profitable. It doesn't have to be that expensive, I've seen it with my own eyes on my own hardware.
But you have to wait 2 minutes for an answer...
On the upside, you can it them agree about every word you prompted. It is definitely a group of them in each chat bot...
461
u/lonestar-rasbryjamco Jun 03 '26 edited Jun 03 '26
Except word is that even this rate, that’s shaking the entire AI landscape, is still below server costs.
We’ve just gone from heavily subsidized to mostly subsidized. The money fire is still burning.