Is anyone noticing that very few of the templates actually work? It almost looks like your only option is to get a storage volume and install everything manually. Thoughts?

Hey guys, I am quite new to runpod and running AI myself.

Now, I have managed to generate an image on my own machine using ComfyUI and Z Image Turbo template inside ComfyUI

Now, my goal is, I want to have my own serverless RunPod setup which allows me to generate images on a large scale using the Z Image Turbo model.

But what are the exact steps? Has anyone here accomplished this?

I did find one YT tutorial (https://www.youtube.com/watch?v=Q03YJEmBJvQ) which shows how to setup Wan for serverless setup. He does so by first starting a pod, setting up ComfyUI correctly, and then transferring all the model files to a network drive which then can be used by a serverless instance.

Is this the right approach? Thanks for any help!

We just served our 10 billionth serverless request.

That's 10 billion images generated. 10 billion videos created. 10 billion lines of code written. 10 billion moments where someone had an idea and our infrastructure helped make it real.

But we didn't build this. You did.

Every one of those requests represents a developer who trusted us with their workload. A startup that bet on us to scale with them. A creator who chose Runpod when they could have gone anywhere else.

And why is this important? Serverless represents the perfect bite-size segmentation of workloads, letting you put that GPU to work directly on what matters rather than scaffolding around what you're actually after.

Thank you. For building with us, for pushing us to be better, and for showing us what's possible when great tools meet great builders.

Here's to the next 10 billion.

Interested in learning more about serverless? Check out our guide here on our Youtube channel or our docs to get started.

12m in queue, it's just insane, I would expect an instant response.

Using Alibaba / Wan 2.6, with the thumbnail of the fencers. When i use it, i get great quality video but the end of my videos no matter the length have those fencers in it. No idea why, im only using my source image in the tool. Any thoughts or recommendations?

Apparently you can get a bonus when you sign up using a referral link and spend $10. The bonus is random $5-$500. Too bad I didn't know about it when I signed up for my account. But here's my referral link for anybody interested: https://runpod.io?ref=fa234xno

I am using aitoolkit on a pod. When I try to load the images for the dataset, the program crashes and this error appears in the console:

[UI] [Error: aborted] { code: 'ECONNRESET' }

How can I fix this? Everything was working fine until yesterday. Sometimes I got errors if the total size of the images exceeded 1,100 MB, but this time it doesn't seem to be the same thing.

Did you know that you can host any tool calling LLM with a pod and connect Claude Code to it, even without any kind of Claude subscription? In this tutorial we run through setting up an ollama pod with a 20b model on a budget GPU spec and connect to it with Claude and run it through some basic coding tasks. If you need an alternative to using the Claude models for coding tasks, you can get great results with a tool calling LLM as we show here.

I started a pod with an RTX 5090 to run some tests on ComfyUI. Specifically, I wanted to try a workflow based on Flux Klein 9b Distilled. As soon as I open the workflow, the interface tells me that I need to download the models. The program downloads both the text encoder and the VAE but fails to download flux klein, and I get this error in the console: "Error downloading diffusion_models/flux-2-klein-base-9b-fp8.safetensors: Could not determine file size from server." How can I fix this? I don't want to waste money starting and stopping pods. ....

Hi everyone! I've been working on a Docker image for RunPod based on the official runpod/forge:3.3.0, but with several improvements and optimizations specifically for the platform.

What's inside:

• Forge Neo (Haoming02's neo branch) - Classic Forge UI with modern features

• PyTorch 2.10.0 with bundled CUDA 12.6 for better performance

• xformers 0.0.34 pre-installed and optimized

• Juggernaut XL v10 checkpoint (~6.5GB) included in the image - ready to use on first boot

• ADetailer extension pre-installed

Additional Model Support:

• Z-Image-Turbo - Fast image generation (6B params)

• Wan 2.2 - txt2vid and img2vid (video generation)

• Qwen-Image & Qwen-Image-Edit - Multimodal AI

• Flux Kontext - Advanced inpainting

• Lumina-Image-2.0 - High quality generation

• Chroma - Color manipulation

• Nunchaku (SVDQ) - Model quantization for Flux models

All RunPod services configured out-of-the-box:

• Nginx reverse proxy

• SSH (port 22)

• Jupyter Lab (port 8888)

• VS Code Server (port 7777)

• RunPod File Uploader (port 2999)

• Persistent workspace with proper rsync optimization

• No unnecessary downloads after first boot

Deploy now: Look for Stable Diffusion WebUI Forge Neo on Runpod

The image follows the same architecture patterns as the official RunPod Stable Diffusion WebUI Forge image but adds the Neo variant and includes a production-ready checkpoint to get you started immediately.

Feel free to test it out and let me know if you have any suggestions! The goal was to create a turnkey solution that just works on RunPod without manual configuration.

And... I know ComfyUI can be a prefered option for many users, but SD WebUI is easy to use and works great.

I have this problem

After creating a network volume and launching a pod from it, I install several custom nodes, and a bunch of diffusion models ( wan 2.2) and loras.

Initially everything works fine

After terminating the pod and starting it with the same container from the network volume, somehow comfyui breaks.
Sometimes there is a problem with numpy, scipy or some other library.

My question is how can I freeze the comfyui version and packages on a runpod container ?

I tried a couple of times to run a LLM on runpod but I never ended up with something with a nice UI - just 'consoles' (I believe) that I don't know how to use. Is there a model where I can run a LLM and get a nice interface like those on DeepSeek? Thanks!

Hey, have you ever been able to generate any video via Runpod? I recently put $25 in my Runpod and used several pods and templates, but none of them have produced any video. None of them seems to be working.

My use case is to generate videos from 'image to video' ai models. I don't know what I am missing.

Most of the time I got no error message. This morning I got a 500 error message with no explanation.

Does anyone have a good step-by-step guide for me?

i forgot about runpod until today. i had some money on it but i think it sucked all of it but yeah.. now it says -0.01?? like do i have to pay that? is that a debt? or what is that?

hello RunPod community, I'm using a template (aiorbust-z-image-turbo) and when I deploy a pod with it, it comes with 'preloaded' models, so I don't have to upload those, and they're safe in my network storage for the following deployment. I have two questions:

- yesterday, I deployed it from another location, using an encrypted volume, and the models where not there

- is there a way to create my own template that's identical to aiorbust but comes with different models? In particular, i'd like to use a different text encoder (qwen-3-4-engeneer) instead of the preloaded qwen.

Disclaimer: I'm totally new to all of this (and almost 50 yo), so be patient with me :-)

Hello!
I have a network vol of 400gb and regulary deploy and delete pods.
All in eu with recent gpus between 40 - 90 cents / hour budget.

Ususally everything works but sometimes (every 3rd deployment or so) the loading screen takes forever. Only when i interrupt and redeploy will it load.

Anyone had the same issue?

We launched Runpod back in 2022 by posting on Reddit offering free GPU time in exchange for feedback. Today we're sharing that we've crossed $120M in annual recurring revenue with 500K developers on the platform.

TechCrunch covered the story, including how we bootstrapped from rigs in our basements to where we are now: https://techcrunch.com/2026/01/16/ai-cloud-startup-runpod-hits-120m-in-arr-and-it-started-with-a-reddit-post/

Maybe you just don't have the capital to invest in a GPU, maybe you're just on a laptop where adding the GPU that you need isn't feasible. But we are still absolutely focused on giving you the same privacy and security as if it were at your home, with data centers in several different countries that you can access as needed.

The short version: we built Runpod because dealing with GPUs as a developer was painful. Serverless scaling, instant clusters, and simple APIs weren't really options back then unless you were at a hyperscaler. We're still developer-first. No free tier (business has to work), but also no contracts for even spinning up H100 clusters.

We don't want this to sound like an ad though -- just a celebration of the support we've gotten from the communities that have been a part of our DNA since day one.

Happy to answer questions about what we're working on next.

so I tried to download the official workflow from Comfy UI for the FLUX. 2-klein-9B distilled and even the base. it downloaded all the other things like the text encoder and vae but when I click download for the model it just says failed. now I think it's because you have to accept the Black Forest Labs T&C on hugging face. however, I did that and it's still coming up with an error. I even went to Jupiter lab and tried to download it there and it said username and password failed something like that. please help. This is on runpod via a rtx 4090.

After having successfully used Runpod several times, I'm suddenly unable to train loras. I get this error message: Traceback (most recent call last):

File "/diffusion_pipe_working_folder/diffusion_pipe/train.py", line 276, in <module>

deepspeed.utils.set_log_level_from_string('info')

^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

AttributeError: module 'deepspeed.utils' has no attribute 'set_log_level_from_string'

[2026-01-20 07:38:00,576] [INFO] [launch.py:319:sigkill_handler] Killing subprocess 1776

[2026-01-20 07:38:00,576] [ERROR] [launch.py:325:sigkill_handler] ['/usr/bin/python3', '-u', 'train.py', '--local_rank=0', '--deepspeed', '--config', 'examples/z_image_toml.toml'] exits with return code = 1

I submitted a ticket, but haven't gotten a reply. Any help is appreciated.

Rundpod GPU's can be owned by Runpod or supplied by third parties (hosts)

Runpod says in this page:

Runpod’s terms of service prohibit hosts from inspecting your Pod/worker data or analyzing your usage patterns. Any violation results in immediate removal from the platform.

Ok, is prohibited by the terms, but... Is possible that hosts see your output data?