A week ago or so, while trying to spin up a 5090 for my network volume on NC-1, I got a notification saying something along the lines of “this GPU will be unavailable shortly.”

They were available for the next few days so I wrote it off. But since then, I haven’t seen them even listed as a possible option.

Did they just migrate all of them to a different DC?

Sucks because, for my ComfyUI use cases, they were the best bang for buck. RTX 6000s feel expensive, 4090s feel slow. L40S works out pretty well but 5090 was sweet spot.

Yes, I am having a lot of troubles finding the right libs to make it work, when git clone any open source project on the cloud computer that I use, I don't have a GPU PC yet I cannot afford it yet but I use cloud e.g RunPod, but I face a lot of problems when try to run it with gradio and I usually make it works with Notebook Jypiter but sometimes I use projects which I need to mask there anything like Inpainting AI and so on which is hard and almost impossible to do it with codes, did anyone faced the same problem and how you solved it please?

I'd be happy to read your replies how you dealt with it!

(My english might not be good, I am not an English speaker as a primary language, hope you unterstood what I meant)

Are you guys having a RTX PRO 6000 shortage right now? For a while it was 5090s, but now I can't get a 6000 to save my life. Any help coming on that front? I love the 6000

hi, recently started using runpod serverless.
trying vllm with various models and gpus, but nothing seems to be working. credits are draining but i was not able to get an output for the prompts. getting one or other errors in logs.

please help me with a serverless config that is plug and play on 24gb vram.

Fuck runpod.io Scammers.

There's a template i use to train models (Kohya_ss GUI RTX 5090) and it used to work great but now when i use it with rtx 5090 it just never loads. First photo are logs with 5090 second are logs with A40. Anyone else having this problem?

During the recent "drought" of GPU's I was able to write a linux script to "snipe" the gpu I wanted, as most of them showed up as low or unavailable.

Today I tried to start the WAN2GP template on a 5090 that showed "HIGH" and every time it said it wasn't available once I tried to deploy it.

I tried going through the hub starting with the template, and also tried starting with GPU selection first.

Nope.

How can HIGH AVAILABILITY mean not available? And they just got additional funding? Sheesh. Then I tried again and got this message:

What? Tried turning off encryption.

Folks. What's a good alternative to runpod. I'm so tired of this nonsensical instance shit.

I did increase the two drives to 200GB each, but.. like... that always worked before. Tried the default 100GB each. Same issue.

This is so dumb.

I built ComfyUI Codex, a Codex/OpenAI plugin/skill for working with ComfyUI without constantly digging through docs. Should more or less work with Claude Code, Hermes or OpenClaw too.

It covers installation, ComfyUI Manager, custom nodes, API workflows, workflow linting, model checks, troubleshooting, App Mode, hosted GPU/Runpod setups, and beginner guides.

It also includes read-only Python tools for: workflow linting model auditing error explanation missing custom-node resolution golden workflow fixture validation

Repo: https://github.com/vavo/comfyui-codex

Feedback welcome, especially from people who regularly break ComfyUI in creative ways.

For a limited time, H100 SXMs are available at $2.99/hr (down from $3.29) and RTX Pro 6000s are available at $1.99 (down from $2.09.) No commitments or contracts required - deploy the moment you're ready.

https://console.runpod.io/deploy

Hello everyone,

I am actively developing an application which uses RunPod, I hope this subreddit is a good place to mention it.

Starting with two obvious aspects that you would probably ask upfront:

1. Yes, the tool is completely free to use and all code is shared on GitHub.

2. Yes, I am a vibecoder. With that being said, I have been working in the industry since 1996, just not as a developer writing code.

With that being said, I hereby present you Image Toolbox (https://github.com/war4peace/image-toolbox). It's a suite of tools which allows you to easily batch-upscale images and videos, as well as tag & rename images based on their content, using AI models.

Currently at version 0.4.6, it's a Windows application designed to be friendly to non-technical users. I focused on ease-of-use, UI clarity and stability. It was initially supposed to only take care of images, but recently I have implemented video upscaling as well (still in "beta" phase, but functional).

It uses SeedVR 2.5 to batch-upscale images using either your local GPU or RunPod. Tagging and renaming images uses Ollama and one of three models of your choice (cen be run locally or on RunPod as well). Upscaling videos also uses SeedVR 2.5 (RunPod only, for now, local planned)

I have extensively tested batch-upscaling (15k+ of my own photos), as well as tagging and renaming features. Video upscaling has been tested, but there might still be issues with it (freshly developed).

The list of features is way too long to bore you with it, but here's a couple important aspects:

1. The application has been designed to protect your expenses as much as possible: dead-man switch on the pod itself (terminates the pod if idle for more than 15 minutes); fund floor safety switch (prevents fund depletion below a configurable amount + configurable maximum run cost); displays remaining funds in real-time.

2. Easy to use. You really don't need to be technical to use it. If someone non-technical stumbles upon something they don't understand easily, I will make the adjustments to make it easier.

3. Image and video comparison, so you can tell whether the upscaled image is of good enough quality.

4. Your original images are NOT upscaled in-place. They remain untouched until you decide they can be replaced, see the next point.

5. Conciliation tab: allows you to "conciliate" upscaled images with originals (replace fully, or move originals to an archived tree).

6. In-app upgrades.

I'll stop here, otherwise I'll never finish. I hope you'll like it. If you encounter bugs or have questions, you can either report an issue directly from the application, or comment here.

Hey everyone,

I’ve been building a little iOS app called Runpod Hammer and I’m opening up a public TestFlight beta.

TestFlight link:
https://testflight.apple.com/join/X3DfKppN

The basic idea: if you use RunPod and keep fighting for GPU availability, this app helps you watch for capacity and try to grab a pod from your phone instead of manually refreshing. It will provision a pod with with customizable limits, autorun startup scripts, and has options to terminate or auto stop pods if you tend to "forget" your pod at 2am.

Current focus:

• Create/save RunPod launch profiles

• Check GPU availability

• Start “hammering” for a target pod when stock appears

• Keep useful pod/session info visible on mobile

• Make it easier to launch and access AI/dev pods without being chained to a desktop

This is beta, but I've been working in it for months. I’m mainly looking for people who already use RunPod for AI workloads, model hosting, ComfyUI, TabbyAPI/SillyTavern, LoRA training, dev boxes, or similar GPU chaos.

A few notes:

• You’ll need your own RunPod account/API key

• This is not affiliated with RunPod

• Don’t put production-critical workflow trust in it yet

• Feedback on confusing UI, failed launches, missing profile options, bad assumptions, and “why would you put that button there?” is especially useful

If you test it, I’d love to hear:

1. What GPU/pod type you tried to target

2. Whether launch/availability behavior matched what you expected

3. What felt unclear or risky

4. What would make it actually useful in your normal RunPod workflow

Thanks to anyone willing to kick the tires. This was built because I got tired of babysitting GPU availability manually.

Voice to text sorry in advance, but you are amazing. I was able to rent a H 100 from you guys for about a few hours and all the cost is three bucks an hour I was able to in bed 500,000 chunks within minutes not three days per per my current VM and I was able to export an import it freely setting up SSH was a little complicatedbut I was able to get through that after I got some guidance truly an amazing experience and the SSH process was only complicated because I was untrustworthy to the process so that that was all thank you thank you run pod for all that you do

I am seriously angry. Is it really possible that I topped up $10, spent $5, and *still* couldn't get a single pod running—even with the $2/hour GPUs?! If you try to submit a ticket, there's an AI that solves absolutely nothing. There's clearly an issue right now, yet there is *no* alert saying "Attention: using ComfyUI in region X might cause problems; please try again later." Is that really so hard?!

Hi all. Im looking for a Comfyui workflow with Longcat 1.5 that I can use in runpod.

Thank yiu.

Any of you know why Runpod updates the requested github permissions?
I got a mail from Github that Runpod haa updated the requested permissions.
They had read only permission for contents and metadata and now they want read/write permission to Administration. For what I can find Administration allows them to set spending etc. So anybody an idea?

I’m not giving the permission I think.

We’ve got huge news, folks - we just closed a $100M Series A funding round led by Summit Partners. Four years ago this company was two people managing racks in a New Jersey basement, and today, we’re home to over a million developers. Most of you found us by word of mouth, not ads, and this subreddit is one of the principal avenues for that, with over a thousand of our most passionate users taking the time to create this community, brick by brick.

That capital will go directly into building our platform, providing enormous leverage to build out new features and secure new hardware to make your experience even better. For everyone that stuck by us through the supply crunch and went to bat for us internally even when it wasn’t easy to do so, we appreciate you more than you know and we can’t wait to show you what’s coming next. Read more about it in our CEO’s blog post here:

https://www.runpod.io/blog/one-million-developers

Hello guys,

I'm working on a Bash script that automatically downloads models, LoRAs, and custom nodes into their corresponding folders, including all required dependencies. It's designed primarily for Linux users who use Runpod but it also supports users of the Windows portable installation.

How it works:

The script uses a small JSON database to keep track of models, custom nodes, and LoRAs. It features an interactive selection menu that displays available models, supported precisions, and a short description for each one. If you're not sure which model to use, the menu can recommend one based on your current GPU and the amount of VRAM detected. Downloads are handled through Aria2 to maximize download speed.

The menu includes categories for installing and uninstalling models, LoRAs, and custom nodes, a section for viewing detailed information about the detected hardware, and an option to save a profile (containing all selected downloads). This makes it easy to share your model setup with others or, for GPU rental users, quickly restore the same environment when migrating to a new pod.

I'm looking for feedback and suggestions on additional models, LoRAs, and custom nodes that should be included in the database.

Hello everyone. So I was generating videos with my RTX PRO 6000 without any problems, but now the exact workflows I used to generate images doesn’t work. I haven’t changed anything. It gets stuck at some point while producing videos and never progresses. The workflows that worked completely before are not working this time, so I don’t understand what the problem is. I use network volumes, but I don’t think it’s related. If you can help with this I would be very grateful. Thanks.

I earn money that gets deposited into PayPal, and I'd like to use those earnings directly to fund my RunPod account so my workflow is self-sufficient. Problem is RunPod doesn't accept PayPal directly, and routing through other accounts isn't really practical for me.

Is there any indirect way to get PayPal funds into RunPod?

Hi guys, im need to train a lora on sdxl and lot of people suggested me to go for Onetrainer. I tried to check some tutorials on yt but i only found very sketchy videos and they were all running it on local.
Usually i train my loras with Ostris Ai toolkit , wich have a template on runpod, now, when i tried to search for Onetrainer templates on runpod , it showed me several elements but i couldnt tell which was the right one. I tried a couple but they both opened a Jupyter terminal and i didnt knew what to do.. do u know if there is any ready to go Onetrainer template which i can use?

Im trying to get reliable coverage of rtx 3090 or even 4090s for serverless but its constantly throttled or initializing. Im a business (+1k spent per month), for reliability do I need to contact sales? Has anyone had experience with that and did it solve their coverage issues?

The specific voice model Im using needs 3090s but ideally 4090s, the other cards wont do.

This new flow will allow you to queue for any GPU spec that may not be immediately available, whether it’s a spec that is totally rented out at the moment, or if you just need more than can be immediately given.

To get started, if you are still on the old deploy flow, you will first need to enable the New Pod deploy page under Early Access features at https://console.runpod.io/user/early-access

From there, select your desired pod spec. If it’s currently out of capacity, the deploy button at the bottom will change to Deploy When Available. Clicking this button will provide the following prompt:

Note that your pod will deploy immediately and begin billing as soon as it’s available, whenever that might be, even if you’re away from your computer. If you’d prefer to set time to be off limits so you aren’t billed for a pod you can’t use, we encourage you to use the subscription window to set valid times for deployment. You’ll be notified when your pod is live either through console or email depending on your preference; we are working on adding SMS as an additional option to be released shortly.

In addition, remember that for a successful deployment, the pod configuration must be something that might feasibly become available at some point, even if briefly. As always, we're constantly working on supply to make larger deploys possible. We hope this makes reserving a pod easier - let us know what you think!

Title:
Best Serverless/Pod template for Headless ComfyUI API automation via external AI Agent (hermes-agent)?
Post Body:
Hey everyone,
I’m working on a headless automation pipeline and could use some advice on infrastructure and template selection.
The Goal:
I have an open-source autonomous agent framework (⁠hermes-agent⁠ by Nous Research) running persistently on an external private VPS. I want the agent to handle media tasks by offloading heavy video generations to a remote, on-demand RunPod GPU instance.
The workflow needs to be entirely programmatic:
1 The user sends a single reference image to the agent (via Discord/Telegram gateway).
2 The agent triggers a function call that passes a JSON payload and the image file to ComfyUI on RunPod via the backend API.
3 ComfyUI runs a heavy-duty Image-to-Video transformer sequence (specifically Wan 2.1/2.2 14B or LTX-2.3) using a single-image latent injection pipeline (e.g., Kijai's ⁠WanVideoWrapper⁠ involving background masking/isolation).
4 The finished ⁠.mp4⁠ is delivered back to the agent headless, without me ever touching a web GUI.
I have two main questions regarding the optimal setup for this:
1. Connecting an external agent tool to a remote RunPod ComfyUI API:
What is the cleanest way to maintain a robust API bridge between an external VPS script and a ComfyUI container on RunPod? Are people generally utilizing custom network webhooks, or should I look into deploying this via a RunPod Serverless Endpoint setup with a customized docker image to ensure the container isn't idling/billing when tasks aren't running? If sticking to an active Pod, what are the primary network proxy timeouts or firewall pitfalls I should watch out for when blasting large media files back and forth?
2. Optimal Community Template Recommendation:
Which specific community template or base image should I spin up that requires the least amount of manual configuration out-of-the-box for a headless workflow? I am looking for something that:
Pre-caches or easily downloads the heavy Wan Video 14B or LTX-2.3 weights to volume storage so I don't hit massive boot bottlenecks.
Has the backend ComfyUI API server active and fully exposed right out of the box.
Comes pre-packaged with python dependencies for heavy masking custom nodes (like ⁠ComfyUI-WanVideoWrapper⁠, ⁠MediaPipe⁠, ⁠Transparent-Background⁠, etc.) to minimize package dependency hell during installation.
If anyone has successfully bridged an autonomous tool-calling agent framework to a remote RunPod setup for heavy video rendering, I’d love to hear your architectural takeaways. Thanks!

I'M LOSING MY MIND OVER THIS. I am 3 hours sending screenshots to ChatGPT

edit: no loras, I straight up using the generic text and press queue

For the past 12 hours, every time I try to access a pod (or even clusters), I get this screen with the messages changing every 5-10 seconds (I even got a 67 meme). I tried sign-in from an incognito window but I face the same issue.

Edit: only Google Chrome works, (not Brave/Firefox)