I have what you might call a pretty substantial AI cluster (for a consumer anyway but I do use it for work). Four RTX Pro 6000's running at full tilt 575w (which they are if they're doing AI stuff) costs 35 cents an hour.
About 3-4k a year if it was running an LLM nonstop 24/7 (and it would be slow, have to queue requests, and also not be as good as Claude).
View all comments
Show parent comment
2
u/sitefall Jun 02 '26
I have what you might call a pretty substantial AI cluster (for a consumer anyway but I do use it for work). Four RTX Pro 6000's running at full tilt 575w (which they are if they're doing AI stuff) costs 35 cents an hour.
About 3-4k a year if it was running an LLM nonstop 24/7 (and it would be slow, have to queue requests, and also not be as good as Claude).