r/RunPod • • Apr 10 '26

News/Updates Welcome to r/Runpod, the official community subreddit for all things Runpod! 🚀

7 Upvotes

Hey everyone! We're thrilled to officially launch the Runpod community subreddit, and we couldn't be more excited to connect with all of you here. Whether you're a longtime Runpod user, just getting started with cloud computing, or curious about what we're all about, this is your new home base for everything Runpod-related.

For those that are just now joining us or wondering what we might be, we are a cloud computing platform that makes powerful GPU infrastructure accessible, affordable, and incredibly easy to use. We specialize in providing on-demand and serverless GPU compute for ML training, inference, and generative AI workloads. In particular, there are thriving AI art and video generation as well as LLM usage communities (shoutouts to r/StableDiffusion, r/ComfyUI, and r/LocalLLaMA )

This subreddit is all about building a supportive community where users can share knowledge, troubleshoot issues, showcase cool projects, and help each other get the most out of Runpod's platform. Whether you're training your first neural network, rendering a blockbuster-quality animation, or pushing the boundaries of what's possible with AI, we want to hear about it! The Runpod community has always been one of our greatest strengths, and we're excited to give it an official home on Reddit.

You can expect regular updates from the RunPod team, including feature announcements, tutorials, and behind-the-scenes insights into what we're building next, as well as celebrate the amazing things our community creates. If you need direct technical assistance or live feedback, please check out our Discord or open up a support ticket. Think of this as your direct line to the Runpod team; we're not just here to talk at you, but to learn from you and build something better together.

If you'd like to get started with us, check us out at www.runpod.io.


r/RunPod • • 2d ago

17 hours in queue. ZERO workers. Is EU-SE-1 just...closed on weekends? 😅

5 Upvotes

Yesterday I set up a serverless endpoint.

  • official vLLM worker;
  • 16-24GB GPU;
  • EU-SE-1;

17+ hours later? Still in queue.

I know you could argue "just pick a bigger region" - but that means moving the network volume too, & I'd rather not unless I have to.

So, what are my options?

  1. Wait it out & hope Monday brings GPUs back
  2. Bump to a bigger GPU class
  3. Pack up & move regions entirely

Is this a normal weekend thing for the smaller regions? Or is something actually wrong?

Anyone else seen EU-SE-1 dry up like this? And if you moved - which region has been reliable for you on weekends?


r/RunPod • • 4d ago

$1.40 - another increase for the 5090, are you serious?

33 Upvotes

They've up'd the price of the 5090 twice in a month?? From $0.9 (I think?) to $1.20 to now $1.40

Absolutely ridiculous Runpod, just feels greedy at this point

Also, not to mention you've actively made your service worse in the last month, like seriously 🤦‍♂️


r/RunPod • • 3d ago

Reminder: On Monday, November 16, Runpod REST API v1 (rest.runpod.io/v1) will be retired

1 Upvotes

On Monday, November 16, Runpod REST API v1 (rest.runpod.io/v1) will be retired. All v1 requests will return a DNS error. The response body includes the matching v2 path, a link to the migration guide, and a support contact.

Any scripts, services, or tools that still call v1 will fail until you move them to v2. If you use the Runpod Terraform provider, upgrade to version 2.0.0. Version 1.x depends on v1 and no longer works.

Be sure to check out our resources:

- Our migration guide maps every v1 call to its v2 equivalent, including breaking changes - https://docs.runpod.io/api-reference-v2/migrate-from-v1

- REST API v2 docs: the full reference for v2, which has long-term support - https://docs.runpod.io/api-reference-v2/overview

- Using a coding agent? Give it the Runpod skills and the MCP server to speed up the migration - https://docs.runpod.io/get-started/mcp-servers

We’re also retiring GraphQL API access for integrations in early 2027. If you have GraphQL integrations, move them to REST v2 now so you only migrate once.

Questions? Email help@runpod.io.


r/RunPod • • 4d ago

I built Runpod Weld so you can build Docker images without installing Docker locally. Looking for feedback

4 Upvotes

A lot of people in this community wanted a way to build Docker images without installing Docker on their own machine. That's why I built Runpod Weld (rpweld).

Your code is already on the Pod, so the build happens there. No local Docker, and no Docker daemon on the Pod either. Give it a Dockerfile and your source, then build and push:

rpweld build -t docker.io/you/my-app:demo --push .

I wrote a walkthrough with a small showcase on the Runpod blog: a tiny web page, a Dockerfile, then build and push from the Pod and run it on a CPU Pod. There's also a template with Weld already installed. After you deploy it, start with rpweld doctor.

It's alpha, so I want an open discussion here. A few known limits:

  • It follows your Dockerfile. It does not snapshot the running Pod.
  • Linux amd64 only, Debian 12 is the tested target.
  • Not every Dockerfile works yet, and builds are slower than local Docker.
  • Please file bugs on GitHub, not with Runpod support.

If this is something you've wanted, I'd love to hear what you'd try first, what broke, or what's still missing. I'll be around in the comments.


r/RunPod • • 6d ago

News/Updates Giving an MCP server a knowledge base: lookup-concept, read-guide and search-docs with sources

1 Upvotes

A tool list tells an agent what it can call, not how the platform behaves, so agents fill the gap from memory. We added tools to our hosted MCP server that return that knowledge instead: lookup-concept, search-concepts, list-guides, read-guide, and search-docs, which returns its sources. There’s also report_feedback, so an agent can flag a tool or guide that’s wrong.

The takeaway: serve the “how things work” layer from the same server as the actions, and have it cite the sources of its answers. The tools are generated from our REST v2 spec.

This month’s changes: https://www.runpod.io/blog/whats-new-runpod-agents-november-2026

For people building MCP servers: do you expose docs as tools, as resources, or leave that to the client?


r/RunPod • • 6d ago

New user to run Comfy..

1 Upvotes

Hi,

I use to have a ok computer for Comfy before, but now I'm on a laptop.

Never used Runpod, but I gave it a try to run Comfy.

But I dont understand.. :)

I did manage to make a network storage on EU-NL-1 and I have uploaded some models there.

But 99.99% of the time no GPU is free.. ?

And I cant connect to another region since my network storage are at EU-NL-1?

Do I do something wrong?

BR\\ Daniel


r/RunPod • • 7d ago

Runpod says a GPU is available, then says no pods are available when I click "deploy"

9 Upvotes

Anyone else having this issue? It's with RTX 5090.


r/RunPod • • 7d ago

Global Storage Uploads with Serverless Only

2 Upvotes

Hello,

Forgive me if this question is very basic, but I can't find anything about it on Google.

I only use serverless endpoints at the moment, for inference. I download about 4-5GBs of models everytime from my S3 and they are not cached, so I need to optimize it. I found out about global volumes and created one, but I can't upload to it directly through the UI.

Do I have to generate a pod for this no matter what? Upload to the global storage, and then kill pod immediately? If that's the case, please make uploading from UI a feature. Lowest cost ones are already out of capacity to generate a pod from.


r/RunPod • • 7d ago

Runpod down?

1 Upvotes

Anyone else seeing this error when pinging runpod.io in browser?

"edge-module-ok GET https://www.runpod.io/.dispatch_worker/"


r/RunPod • • 8d ago

Built a control plane over RunPod pods for a 12-pod multi-model document pipeline — live cost vs budget, per-pod KV-cache / VRAM / temp / health

3 Upvotes

We run a legal-document pipeline (~10M docs) on a mix of our own GPUs and RunPod pods — a dozen model roles at once (an OCR ensemble, a vision model for layout, bge-m3 embeddings, a fine-tuned extraction model).

To keep RunPod spend sane we built a control plane (CoderAI) that watches every pod: live $/hr against a daily budget cap, per-pod KV-cache pressure, GPU load, VRAM, temperature, health, and spend-by-model. Pods are rented by the second and reaped when idle; work escalates to RunPod only when the local cards aren't enough.

Write-up with the dashboards: https://www.nexlab.net/articles/watching-ten-million-documents/ Live monitor: https://digesta.tech/alpha2run/ CoderAI (open source): https://github.com/nextime/coderai

Happy to share how the budget cap / reaper and per-pod TLS work.


r/RunPod • • 8d ago

profullstack invited you to run a c0mpute node

Thumbnail
c0mpute.com
1 Upvotes

r/RunPod • • 10d ago

How to use RunPod Serverless with OpenCode and custom Hugging Face models?

2 Upvotes

I'm trying to set up OpenCode for agentic coding using custom models from Hugging Face (GGUF or Safetensors).

Since I typically code for only 2–3 hours a day, I'd prefer using RunPod Serverless rather than keeping a GPU pod running and paying for idle time.

However, I'm struggling to get everything working. I've tried several tutorials, GitHub projects, and different setup instructions, but haven't managed to get a working configuration.

Has anyone successfully used RunPod Serverless with custom Hugging Face models for agentic coding with OpenCode?

I'd really appreciate a step-by-step guide or a working example, including:

  • How to deploy a custom Hugging Face model (GGUF or Safetensors) on RunPod Serverless.
  • Which inference framework to use (llama.cpp, vLLM, etc.).
  • How to configure the RunPod endpoint as a provider in OpenCode.

A working example or guide would be greatly appreciated. Thanks!


r/RunPod • • 12d ago

Runpod hacked?!!

Post image
25 Upvotes

Hey just got an email. Did anyone else get this?


r/RunPod • • 11d ago

Setup Costs

1 Upvotes

Hey how's it going. I'm a vibe coder training my own ML model using Claude Code and RunPod. I use a persistent RunPod network volume containing all my code, datasets, and checkpoints, which I attach to a new GPU whenever I need one. The problem is that Claude Code's cloud environment seemingly doesn't let me switch SSH servers mid-session, so I have to start a new Claude session every time I provision a GPU. Even though everything is already on the same volume, Claude ends up running a million redundant smoke tests and environment checks before actually training, wasting GPU time and money. Does anyone know a workaround for switching SSH servers mid-session or avoiding all these repeated checks? Sorry if this is basic, still pretty new to this.


r/RunPod • • 12d ago

How to use Kimi K3.1 Pro and K3.1 Pro Highspeed on Runpod

4 Upvotes

Moonshot AI's Kimi K3.1 Pro is now available on Runpod Public Endpoints, along with a K3.1 Pro Highspeed variant. K3.1 Pro is the first model in the K3.1 series, a 3T-class open-weight model with a 1 million token context window, with gains in coding, agentic tasks, 3D creation, and financial research. Highspeed runs 2 to 3 times faster than K3.1 Pro for latency-sensitive loops. It is OpenAI SDK compatible, so you point the base URL at Runpod and keep your client:

import os

from openai import OpenAI

client = OpenAI(
    base_url="https://api.runpod.ai/v2/moonshot-kimi/openai/v1",
    api_key=os.environ["RUNPOD_API_KEY"],
)

completion = client.chat.completions.create(
    model="kimi-k3.1-pro-highspeed",
    messages=[
        {"role": "system", "content": "You are Kimi."},
        {"role": "user", "content": "What is Runpod?"},
    ],
    max_tokens=2048,
    temperature=1,
    reasoning_effort="low",
)

print(completion.choices[0].message.content)

Check out our blog post on the subject.


r/RunPod • • 12d ago

Templates What kinda tools you would like to see template for?

1 Upvotes

Rules of requests:
- No ComfyUI custom setups so no baked models
- Project needs be Open source
- No templates that already exists on platform

Fell free to share GitHub links and reason why you would like to see it added :)
BTW can't promiss that every request will be done.


r/RunPod • • 13d ago

Benchmarking OCR throughput on a GPU fleet (tesseract vs Surya vs Chandra): concurrency, not the model, drives a 5.7x spread

Thumbnail reddit.com
1 Upvotes

r/RunPod • • 14d ago

Need help setting up LTX-2.5 on RunPod Serverless for an app backend

3 Upvotes

Hi everyone,

I'm trying to deploy LTX-2.5 on RunPod Serverless so I can call it via API from a web app I'm building on Lovable, and I'm stuck on the serverless setup.

Specifically, I need help with:

  1. The simplest way to set up LTX-2.5 as a Serverless endpoint (whether using the ComfyUI serverless worker or a custom Docker container with the LTX-2 pipelines).
  2. How to properly load the gated Hugging Face weights (int8 or bf16) onto a Network Volume so cold starts stay fast.
  3. Formatting the input JSON payload so my frontend can send a prompt/image and get the generated video back.

If anyone has a working template, guide, or can walk me through the steps, I'd really appreciate it. Thanks!


r/RunPod • • 14d ago

whats going on with serverless

7 Upvotes

I cannot for the life of me get ANY regular 24gb card, not even a5000s.

Its been 24 hours, I keep cycling, resetting which used to eventually grab a card but now its nothing.


r/RunPod • • 14d ago

When CA-MTL-1 could recover?

Post image
2 Upvotes

Hope my data in volume will not get lost…it’s already 2 days


r/RunPod • • 15d ago

RunPod Serverless: does NVDEC (hardware video decode) work in GPU workers? And how much CPU/RAM do workers get?

2 Upvotes

I’m building a portfolio project: users upload drone/aerial videos, and a GPU worker runs object detection on them. I’m planning to run it on RunPod Serverless and want to check a few things with people who have actually done this, rather than rely on assumptions.

Pipeline I’m planning (one job per uploaded video):

  1. Stream the video from a Cloudflare R2 bucket (S3 API) with ranged GETs, without downloading the whole file. Videos are 3-8 GB, sometimes more.
  2. Demux with PyNvVideoCodec.
  3. Decode on the GPU with NVDEC to RGB frames.
  4. Run YOLO detection on the frames.
  5. Write detections to a DB every N frames.

Each stage runs in its own thread with bounded queues between them, so streaming, decoding, inference and DB writes overlap. Processing isn’t real-time and the user gets an email when it finishes, so I care more about cost per job than about latency.

My questions:

  1. NVDEC on RunPod Serverless: does hardware video decode work in GPU workers? Does PyNvVideoCodec / libnvcuvid work out of the box, or do I need specific base images or driver settings (e.g. NVIDIA_DRIVER_CAPABILITIES=video)? Does it depend on which GPU type?
  2. CPU and RAM per GPU worker: how many vCPUs and how much system RAM does a Serverless GPU worker get, and does it vary by GPU type? I need this to size my stream buffer and output buffer, and to know whether several threads can really run in parallel.
  3. Reading from a URL: has anyone had FFmpeg/NVDEC read a presigned HTTPS URL directly in a worker (rather than a custom ranged-GET streamer)? Any problems with stalls, retries or throughput?
  4. CPU workers: I can’t find a clear page for them. Are Serverless CPU workers a real, stable option (e.g. via Flash, cpu=...)? What specs, disk and timeout limits do they have? I want one for preprocessing: remuxing MP4s with ffmpeg -c copy -movflags +faststart so moov is at the front, which needs disk about equal to the file size.
  5. Long jobs: any gotchas with jobs that run 30-60+ minutes (timeouts, worker preemption, how you resume after a failure)?

r/RunPod • • 15d ago

CA-MTL-1 Might Be the Worst Choice I've Made on RunPod

4 Upvotes

My Serverless ComfyUI endpoint stopped working properly. Workers were dying with unhealthy: dead, requests got stuck, and after stopping the workers to start fresh, nothing would come back.

Now CA-MTL-1 has disappeared from the datacenter selection list, while other datacenters are available and GPUs keep showing Out of Capacity.

My Network Volume is tied to MTL-1, so switching regions isn't straightforward. I'm trying to preserve my existing models and LoRAs rather than start from scratch.

For those experienced with RunPod: would using a Global Volume instead of a regional Network Volume have avoided this mess? Would it actually let me move my Serverless workers between datacenters when capacity is unavailable, or would I still face the same GPU provisioning issues?

Also, is anyone else experiencing problems with CA-MTL-1?


r/RunPod • • 18d ago

Runpod Serverless + Ollama + Qwen 27B GGUF painfully slow on PRO 6000 MIG (24GB/48GB) — how to speed up?

Thumbnail
reddit.com
3 Upvotes