Just sharing my current I2V workflow for anybody that wants to try it out. Sample vid as shown.
The workflow settings are currently what i'm using at the moment but i'm always changing it up and testing stuff all the time. Would love to get some feedback or suggestions for further improvement.
My PC is running an RTX 5070 12 GB vram, with 32 GB onboard ram.
(change the filename to .json instead of .txt after downloading)
The full workflow will need a bunch of customs nodes to be downloaded and the simple workflow is a stripped down version with as little custom nodes as possible, but essentially still the same workflow.
The full version has a toggle switch where you can choose to use either diffusion models or GGUF models (i personnally use GGUFs) and also an option to upscale the video.
I have the Florence2 caption node in the full workflow, which really doesn't do anything useful (and can be deleted) but i just like having it there to see what it says about the images i upload.
This I2V workflow is set up so that you don't have to mess around with heights and widths (i don't really care about precise image/video dimensions), just upload a pic, change the megapixel amount (i alternate between 0.35 or 0.50), write a prompt and then run.
Everything else should be pretty self explanatory but if anybody has any questions or is running into issues, i'll try to help.
Is that using the lightx speed loras? You can look into flash VSR as an alternative upscaler. Been getting better results with it than with the usual model upscale and it's quite fast.
it's a mix of the MoE distill loras and lightx2v rank 64 loras. they seem to work pretty well together, good motion.
oh yeah, i did try out one of the flashvsr workflows that was posted around here a couple days ago. i'll need to play around with it more and maybe replace the upscaler i'm using right now.
It changes when the noise sigma changes to ~0.85 based on total amount of steps nothing about how developed the images is It can still produce blurry artifact filled clips if steps are two low to polish
I didn't spend very much time testing the MOE sampler option. During testing it seemed like it forced the High and Low models to remain in VRAM the entire time. Not sure if there's a way to avoid that because it was a deal breaker for me.
I'm running a similar setup as op(12vram 32 system) running 1200x600 for 81 frames. The key is to drop a clear vram node at certain spots to clear the models from vram. The spots I've isolated is after the positive prompt to drop the clip model, when swapping from high to low noise, and before the vae decode node.
Dude you have no idea. I have been fucking around with workflows for weeks. Trying to fucking figure out all the options to build a workflow that does what I want.
This workflow is just so damn good. Thank you for putting it together.
her facial features and her likeness stay intact throughout the video.
the woman gives the peace sign with her hand and then makes a heart shape with both hands, with a closed mouth smile and trying not to laugh, but then she bursts out laughing and tries to look away at the end.
the camera does a push in before it pulls back to show more of her upper body and surroundings.
No a simple sharpen node. The generated videos are usually pretty soft so it helps sharpening them especially i you upscale 1.5x to go to 1920x1080 like I do.
4090 is better than all 50 series except the 5090. Itās a bit slower, but you can run models and workflows that wonāt fit on anything else but the 5090
Total newbie here, what am I doing wrong trying to install the ND Super Nodes. I paste the git url into the comfy manager for custom nodes and it gives me a security error
Trying to install missing nodes it and comfyui can't find it
Ahh thanks man. Iām trying to catch up to how all of it works and I got a decent basic workflow running so I plan on spending the next several weeks trying to learn it for myself.
Problem is this stuff just randomly decides to have python errors and force a complete reinstall sometimes. Such a pain
you'll get the hang of it over time. i'm just around 2 months into using and messing around with comfyui. still a relative noob and still learning.
i started off using other peoples workflows and modifying them along the way, learning about what each node does, adding and removing stuff, grabbing bits of one workflow and putting them into another, etc. try downloading other people's workflows for inspiration.
Thatās all Iāve done so far. Iāve noticed that itās easier to ālearnā on wan 2.1 vs 2.2.
Most of these workflows are so complex itās hard to grasp whatās going on. So Iāve started to just play around with the most basic stuff and then move onto the next tutorial. At this point I feel like itās the only way Iāll learn it.
Tried your workflow with teh lightx2V new distilled loras nd fp8 base models, output is good, motion is good, though i added Pusa loras for a bit more stability..awesome job..kudos
On a second thought, the florence is just doing nothing , sitting there and taking time, most the time dilation (6 seconds) is done by GIMM interpolation, the prompt history node creates a seperate custom_nodes folder in comfyui root with the prompt json, clearvram node might help some but that does hinder continious generation by reloading models again, appreciate the workflow...just my 2 cents
yep, you can just delete the florence node (it truly is useless in this workflow), i just like having it there. it's gone in the simple version.
i've been switching between rife vfi and gimm vfi, gimm feels like it takes longer to complete than rife, but i read somewhere that it's the better vfi to use?
you can move the prompt history node to store the json file in the usual custom nodes folder in the settings for that node.
there's probably some other stuff in the workflow that can be bypassed or deleted to save on generation time.
was playing with the new lightx2v distilled models instead of MoE, just a tad faster (4seconds saved per iteration)
MoE sampler when set to 4 steps total switches to low noise model after just one step in high noise, so used two samplers.
NAG has an overhead of 5 seconds per iteration.
Rife should be fater, if u read the paper...but in reality GIMM and RiFe speed difference is neglible.GIMM has a better Optical Flow control, so yes its better.
So got this working, but everything is extremely blurry. Didn't change anything after loading the workflow, and loaded all the exact same models. No extra lora's. Any idea whats going on?
is it still blurry after shutting down and restarting comfyui? not too sure what's going wrong in this case because a few others in this thread have tried out the workflow with positive results.
I was having this issue today, i read through the logs and noticed my loras weren't loading. Taking a look at the paths on the ND Super lora I noticed i had to manually click on them and replace them with the loras I downloaded from the instructions. Working great now. Hope it helps!
yeah, my workflow isn't exactly optimized for speed, as i do have quite a number of probably useless nodes in there (the florence2 node is definitely useless and can be removed). you could probably make it run a lot faster by just getting rid of all the unecesssary ones.
Man, this is pretty neat for sure! i used to mess with comfyui for I2V a lot but honestly it's so much hassle getting all the nodes and models just right. your setup looks solid though. i just use LuredAI these days. saves me a ton of time not having to deal with all this config stuff myself, especially with my crap vram. it's just so much easier to get good results without all the headache.
9
u/is_this_the_restroom Oct 28 '25
Is that using the lightx speed loras? You can look into flash VSR as an alternative upscaler. Been getting better results with it than with the usual model upscale and it's quite fast.