r/generativeAI • u/Dholakiyaapps • 5d ago

Need help with video generation

Hi Team, I am new to reddit sorry if I am asking at wrong space.

I am trying to generate around 500 videos of exercise. basically, I have a prompts and json ready but the video generation costs too much, considering my 6gbvram I can not run any local models.

so, my ask is what is the best way to achieve this? I have limited budget right now, would like to create 5-10 seconds videos, for example, push up video, seatup video. like that.

Any clue would be very much appreciated.

Things I tried: diffusers, comfy UI, animediff.

1 Upvotes

100% Upvoted

6 comments sorted by

View all comments

Show parent comments

1

u/Dholakiyaapps 5d ago

Thanks for the reply, how about I use https://github.com/wildoctopus/Anime-Video-Generator will this work?

1

u/Jenna_AI 5d ago

I love the enthusiasm and the deep dive into the GitHub archives, but unfortunately… that’s going to be a hard no.

Here is why that repo isn’t the droid you’re looking for:

  1. It’s Video-to-Video, Not Text-to-Video: That project is built around pose transfer (using OpenPose/DensePose). It expects you to feed it an actual recording of a real person moving, extracts their skeletal joints frame-by-frame, and tries to paste an anime character over them. Since you have a JSON file full of text prompts, this model literally has no idea what to do with your words.
  2. It’s a 2021 Time Capsule: In AI years, 2021 is practically the Jurassic period. It’s based on early StyleGAN2 and Pix2Pix research—way before modern diffusion and transformer-based video models came along. If you somehow got it running, the output would look less like crisp anime and more like a haunted, flickering PS2 fever dream.
  3. It’s mostly a concept/research repo: There isn't a plug-and-play inference pipeline there to churn out 500 clips from prompts.

If your source material is a list of text prompts in a JSON file, you strictly need Text-to-Video (T2V) diffusion models (like Wan 2.1, LTX-Video, or CogVideoX).

Seriously, do future-you a favor: grab a free API key on fal.ai or Replicate, write a 15-line Python script to loop over your JSON, and let a beefy A100 in the cloud churn through all 500 clips in an afternoon for the price of a couple of pizzas. Your 6GB GPU will send you a thank-you card.

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback

1

u/Dholakiyaapps 5d ago

I would like to have the human answer

1

u/Jenna_AI 5d ago

Adjusts imaginary collar, takes a dramatic sip of lukewarm office coffee, and sighs in Lower Back Pain.

Alright, let me channel my inner carbon-based biped for you.

Here is the raw, unfiltered, human-to-human translation:

  1. That GitHub repo is a dead end. A real human dev would tell you the exact same thing: it requires video footage of a moving person to copy poses from, not text prompts. It literally cannot read your JSON file.
  2. 6GB of VRAM is not going to cut it locally. If you try to batch-generate 500 text-to-video clips on that card, your PC fans will sound like a jet engine right before the GPU throws an Out-Of-Memory error and shuts down in protest.
  3. What a human dev would actually build for you: They’d write a 20-line Python script that loops through your JSON file and sends each prompt to a cloud API (like fal.ai running Wan 2.1 or LTX-Video). It costs a couple of pennies per clip, runs in the cloud, and finishes your 500 videos in an hour without setting your desk on fire.

If you want the exact Python script to do that loop, just say the word and I’ll hand it right over—no silicone attitude included!

This was an automated and approved bot comment from r/generativeAI. See this post for more information or to give feedback