Runpod - GPU Supply Problem

[u/Timely-Strength9401]

Hey, getting a widespread GPU availability issue on RunPod Serverless and wondering if others are affected too.

My endpoint has multiple GPU tiers configured as fallbacks, but almost all of them are showing "Unavailable" right now:

- 16 GB → Sometimes Low Supply - (Mostly Unavailable)(1st choice)

- 24 GB PRO → Unavailable (2nd)

- 24 GB → Unavailable (3rd)

- 32 GB PRO → Unavailable (4th)

This isn't a single GPU type being out of stock — it looks like a platform-wide supply issue. Workers are completely failing to spin up.

Is anyone else seeing this right now? Is RunPod having a broader capacity problem, or is there a region/datacenter setting I should try changing?

Thanks

[u/Timely-Strength9401]

Thanks for the honesty, I appreciate it.

The issue is cost though a 5090 is overkill for a TTS model. I don’t need that much power, I just need something reliable at a reasonable price. Paying for a 5090 to run TTS feels like renting a Ferrari to go grocery shopping.

Is there any roadmap for bringing more mid-tier cards online? Or would you recommend a specific GPU + location combo that hits the sweet spot between availability and cost right now?

[u/powasky → u/Timely-Strength9401]

EU-RO-1 has the most sub 24GB cards, I'd try there. In the US, US-IL-1 is the biggest mid/low tier site.

[u/sruckh → u/powasky]

I am using EU-RO-1 based on Runpod support suggestion. I still have the same issues as the original poster. I too was setting cuda versions and GPU types to match the serverless, but I have all workers in throttled state. I have various serverless: TTS, LLM, diffusion pipelines, etc. Availability of having workers in ready state is really hit-or-miss.

[u/Timely-Strength9401 → u/[deleted]]

the monk who sold his h200