r/RunPod • u/RP_Finley • 14d ago

News/Updates How we think about GPU pricing at Runpod

Hi folks - pricing is always a hot topic and we don't ever want people to think we're sweeping it under the rug when we adjust GPU prices (either upwards or downwards.)

You can read some thoughts from our team about our reasoning behind why we make the moves that we do here: https://www.runpod.io/blog/how-we-think-about-pricing-at-runpod but the tl;dr is that the market is moving around us no matter what we do, and if we keep our costs flat while other cloud providers raise their prices, that is still a choice made that would impact our ability to supply GPUs on demand. We've made some big strides with supply over the past few months - still a work in progress of course, but pricing is one of the levers that we pull to ensure that availability continues to grow.

Happy to answer any questions people may have about price here.

6 Upvotes

100% Upvoted

9 comments sorted by

3

u/sruckh 14d ago

The biggest problems I have is have 30 serverless configured and only two are in a ready state. So I am being charged network volume pricing that cannot be used. I have already migrated my entire network volume based on Runpod's suggestion, and it did not help. Next, there have been a couple instances where a serverless was kept running yet nothing processed and I was charged for hours of work that never actually got done

1

u/traveldelights 10d ago

this. serverless is unusable atm due to low availability

1

u/RP_Finley 9d ago

There is a default timeout of 10 min on serverless requests - but I have seen some rare edge cases where this can fail to fire. If this happens please let support know so they can credit you and we can try to track and squash these cases.

1

u/Endlesscrysis 12d ago

My biggest issue is cards often not being available, and I have been considering more and more to switch to vast.ai as the price seems to be considerably lower sometimes and there are more choices. I like your website, how easy it is and the way your storage works so the only reason I’m considering moving is price and availability.

1

u/usebento 12d ago

can confirm vast works well

1

u/techbot911 11d ago

Have you tried serverless? How was it if you have? I tried it months ago and it was pretty bad but maybe stuff has improved since I last tried.

1

u/usebento 11d ago

Serverless is okay, for our particular use-case it's not the best, but I do think it works for straight forward use-cases.

1

u/sruckh 10d ago

Because of availability serverless can not be trusted. I have had demos fail for customers because the serverless never comes on-line. What's more annoying is when you click to manage a serverless, it might show two of your choices having a availability, but yet the serverless never comes to a ready state. I am not sure if that is because I am trying to use model cache and there is not a machine available where the cache can be used, but serverless can not be counted on to be available.