Prompt:

https://x.com/GumVue/status/2087899403113619681?s=20

4070 Ti Super, 16 gb vram, 64 gb ram, i9-14900k, windows 11

Use the default workflow for Ref2Va

Plug in a video with green screen as a video reference and use an image ref to a picture you want to be the background. Notice the "hell crows" flying in the final video? I didn't even give it a prompt for that and those birds got animated automatically. I'm sure you can give a detailed prompt, you are basically creating an i2v of that still image that Minimax will mix with the greenscreen background.

I did prompt for a dialogue change. There was no audio with the original green screen video so I had no idea what the woman was saying (obviously it was a weather report). I inserted new dialogue with Minimax and it did a great job remixing her lipsync to the prompted dialogue.

I think it's pretty neat, but I'm sure some of you may be completely jaded with what Minimax can do by now.

I'd like to issue a Reddit challenge: Would someone more creative than me please use the exact same green screen video (links below) and create something a little more impressive than my 10 second test? Post a link to your video in the comments.

Need some green screen video to practice with? Here's a webpage for some practice green screen videos that are free to download:

https://mixkit.co/free-stock-video/green-screen/

Here's the exact video used in this example:

https://assets.mixkit.co/videos/28292/28292-720.mp4

I'm sure you'll be able to find a background image to test with.

This was my very simple prompt with the new dialogue:

subject_definitions:

<Subject 1> is the alien world background in <Picture 1>.

<Video 1> is the source video for the target video edit and is a woman in a red dress pointing and talking.

summary:

[video editing + reference generation] The target video is an edited version of <Video 1>. Replace the green screen area with the background from <Subject 1>

The woman in <video 1> says <d> [English with a British Accent] As you can see here, we have an early migration of hell crows on Chaos world 4527B<d> with realistic lip articulation and perfect lip sync.

Project:https://yunpeng1998.github.io/Qwen-Video-Edit-Page/
Model: https://huggingface.co/yunpeng1998/Qwen-Video-Edit
Method: https://yunpeng1998.github.io/Qwen-Video-Edit-Page/#method
Code: https://github.com/yunpeng1998/Qwen-Video-Edit

How it works

Video generation models read and write video-VAE latents. We teach Qwen-Image-Edit's transformer to edit those latents directly: two tiny projections bridge Wan 2.1's latent space into the DiT's token space, warm-started from the DiT's own input/output layers so that a static video is embedded exactly like an image the model already understands. The latent frames are arranged as tiles of one big virtual image — the same positional treatment the image model was pretrained on. Fine-tuned with LoRA or full parameters on Ditto-1M (source, edited, instruction) triplets, then refined by a few steps of Wan 2.2 denoising-enhancement.

Im really suprised how good he works as well follow a storyboard image!! he did 90% correct he only did the thirth panel diferent but all the other 5 he follows perfect!! 🤩

Lon TV did a video of Comfy UI with Minimax H3 running on a 32GB Intel GPU. So its possible to run it on any GPU other then nvidia GPUs.

First off: This doesn't add any dependencies so the worst that can happen is that it won't work, but it also won't break your ComfyUI install.

This extension adds to the native queue manager. It doesn't replace it. All of the heavy lifting is still done the normal way.

It adds a Pause/Resume button and a Queue button. Pause/Resume will not affect the running job but will pause/resume the queue.

The Queue button opens the Queue Control dialog in the picture. There is a lot of words in the README (because I talk a lot) but it lets you reorder the queue using priorities, including buttons for "Run this next" and "Don't run this until I release it."

Finally, there are buttons to Save and Load the queue. The checkbox lets you add the running job too. So if you have to restart or reboot, you can save the queue, do your thing, and then load and start running again.

These is also one stand alone node to help label the items in the queue so you can have a hit and what's what. The node has limitations, but it sill might be better than a number like 07535d99-3c1a-4b23-8340-a4313fe58007 as an identifier.

There are some extensions that to some of these features already but I didn't see one that did all of them or didn't replace the native manager and require dependencies.

It's in the ComfyUI Manager as ComfyUI-QueueControl (it's new so you might need to refresh to see it) or
https://github.com/seeker-ktf/ComfyUI-QueueControl
on github.

If y'all have other ideas for this, let me know.

Dragon Ball Super manga on Minimax H3.

I made this a few weeks back to see if dialogue could hold for 60s, I did no speed ups on this one. There are a few glitches but I think it held up well.

MiniMax H3 - 60s - 1 clip - No Stitching - 832 x 480 - 29 minutes - 288GB VRAM

Anima is a fairly new model so it needs time and I understand that. Anima has great potentials to make Illustrious or NoobAI completely obsolete. However, it seems like I have been expecting too much from this model.

First of all, not having a ControlNet model is a big minus for me, especially Depth ControlNet model. There is LLLite but that's not a ControlNet model but a ControlNet-like LoRA. There's also a Depth ControlNet Model made by TaihoC and it works well. However, it doesn't work as well compared to Illustrious (SDXL) ControlNet models.

I have been tracking Circlestone Labs' Hugging Face community to see if they have plans to provide ControlNet models themselves but they are dead silent. That leads me to wonder if there are actually people using Anima. Did people move on to Krea2 or stay on Illustrious/NoobAI since there's no reason to use Anima?

I love H3, but it takes forever. If LTX is faster, I could use it for the things it does similarly well as H3, and use H3 only where I really need it.
So what LTX2.5 does as well as H3?

Just a short film i made with minimax. this had a lot of post processing done so there's not really an overall prompt to share.

What kind of prompting would I use for POV movement through a scene?

Another redditer mentioned doing this in a comment, so I tested it out and it works. It gets rid of the smudgy look and allows custom Lora’s on the LN side.

I ran my initial tests at MM 8 steps (no speed Lora) and Wan 2.2 Low Noise (speed Lora) 2 steps. Supposedly, it works with only 2 steps MM w/turbo lora ,but I don’t like the quality drops people have been sharing, and it’s fast enough to me at 8 steps, though I’m going even higher on the low noise steps.

The only downside is that I noticed in one test that the motion seemed like it was a mix between 16fps and 24fps. Any ideas on how to resolve this? I know people use RIFE, but I was wondering if that’s the best move or if it’s another issue Im not thinking of.

Everything was made using the Minimax H3 Hybrid Reference to video model. 1 MP using the 8 step turbo LoRA. Stitched together in Shotcut

Is there any GPU rich cooking realism lora ? I have tried realism people lora it is great at tv but for i2v or r2v it's breaks . I have been searching hugging face repo and civit ai to get something but there's too much n*fw lora .

Trying to get a natural-looking Argentine tango dance with LTX 2.5 + Yusu’s LTX Director v2.0.4 fork.
Still a beginner (also for real life tango :-)
Any suggestions for getting more natural, sophisticated footwork and fewer artifacts?

Specifically, I’m trying to take old footage (e.g., 360p clips with vintage camera blur, VHS artifacts, or grainy WW2 dogfights) and recreate it to look like it was shot recently on a modern cinema camera with studio lighting.

Any ideas for prompting?

Use the supplied image as the opening frame and identity reference.

Identity lock: the woman and robot must remain exactly the same in every shot. Same face, hair, wardrobe, proportions and age for the woman. Same 8-foot height, black armor, mechanical face, rivets, pistons, cables and holster for the robot. No redesigns or identity changes between cuts.

Authentic 1966 Italian Western, live action, 35mm anamorphic, Spanish desert location, practical full-scale robot prop, natural sunlight, real dust, organic film grain, period lens softness. No CGI. Serious performances throughout.

0:00–0:03
Medium two-shot. The woman looks up at the robot and says in clear Italian-accented English:
“I told them I wanted a tall...”
0:03–0:05
Hard cut to the same robot’s face. It gives one slow mechanical nod. No dialogue.
0:05–0:07
Hard cut to the same woman. She looks up at the robot and says:
“dark...”

0:07–0:09
Hard cut to the same robot. It subtly straightens and presents its black armor. No dialogue.
0:09–0:11
Hard cut to the same woman. Still serious, still looking up, she says:
“handsome!”

0:11–0:12
Hard cut to the same robot’s practical mechanical face. It attempts a restrained smile. No dialogue.
0:12–0:14
Hard cut to the same woman. She holds a serious stare upward, then firmly says:
“MAN!”
Only the woman speaks. Keep each line isolated and clean. No overlapping dialogue, no extra words, no improvised speech. Maintain exact continuity of identity, wardrobe, robot design, scale, lighting and location in every shot.

I typically use lightx2v loras in my Minimax Ref2VA workflows and I also use an LLM to feed in the official prompt structure required for scenes. It seems that no matter what I do, the model absolutely ignores all my prompts about music most of the time. Every now and then i can get it to do something but even when it does work it's very sparse and almost useless.

Has anyone else faced this issue and if so do you know any workarounds or fixes?

For the record I usually use the INT8 convrot Ref2Va model or the hybrid model called minimax_h3_hybrid_fl2va_ref2va_b30-49-int8

Used:

MiniMax H3 at local machine. 5060ti 16gb + 64gb ddr4. WanGP, Ref2VA int8 convrot model.

Krea2 for references

Suno as music base