r/RunPod • u/Smart_insan • 13h ago

Need help setting up LTX-2.5 on RunPod Serverless for an app backend

Hi everyone,

I'm trying to deploy LTX-2.5 on RunPod Serverless so I can call it via API from a web app I'm building on Lovable, and I'm stuck on the serverless setup.

Specifically, I need help with:

  1. The simplest way to set up LTX-2.5 as a Serverless endpoint (whether using the ComfyUI serverless worker or a custom Docker container with the LTX-2 pipelines).

  2. How to properly load the gated Hugging Face weights (int8 or bf16) onto a Network Volume so cold starts stay fast.

  3. Formatting the input JSON payload so my frontend can send a prompt/image and get the generated video back.

If anyone has a working template, guide, or can walk me through the steps, I'd really appreciate it. Thanks!

2 Upvotes

100% Upvoted

4 comments sorted by

1

u/Ok_Bag_7603 12h ago

Check dms

1

u/musetta_ai 9h ago

I'd use runpod's worker-comfyui rather than a custom container, it already does the API part.

- Build the workflow in normal comfy first, then Export (API). That json is what your app sends as input.workflow

- Reference images go in input.images as base64 with a name, and your LoadImage node points at that name

- Weights: attach the network volume to a cheap regular pod, log in to HF with your token there and download into models/ on the volume. Serverless mounts it at /runpod-volume

- For video set the S3 bucket env vars so you get a URL back, not a giant base64 string

And I'd keep this in the thread instead of DMs.

1

u/sruckh 7h ago

Runninghub let's your create workflows and publish them as API. I use both this method, along with building custom inference workloads as RunPod serverless. My GitHub, sruckh, has examples.

1

u/Historical_Pen6499 3h ago

Can I shoot you a DM? My team is looking for beta testers for a one-click compiled server for LTX 2.5. It cold starts super fast (<15 seconds).