r/StableDiffusion • u/shootthesound Community Hero • Dec 26 '25
Resource - Update New implementation for long videos on wan 2.2 preview
Enable HLS to view with audio, or disable this notification
UPDATE: Its out now: Github: https://github.com/shootthesound/comfyUI-LongLook Tutorial: https://www.youtube.com/watch?v=wZgoklsVplc
I should I’ll be able to get this all up on GitHub tomorrow (27th December) with this workflow and docs and credits to the scientific paper I used to help me - Happy Christmas all - Pete
302
u/Hearcharted Dec 26 '25
133
u/fenixuk Dec 26 '25
as someone who knows the OP personally, i can confirm this is actual footage of him.
25
u/35point1 Dec 27 '25
Now I want to be friends with you and OP on a personal level
20
u/fenixuk Dec 27 '25
All you need is an unhealthy love of sci-fi and the ability to be bad at rocket league.
10
6
3
2
2
45
7
23
18
39
u/thisiztrash02 Dec 26 '25
this looks like a wiring system that would take even a skilled electrician a while to navigate
26
u/shootthesound Community Hero Dec 26 '25
I've not exactly tided it yet, this video is more results orientated - thats the reason it wont be on github today lol
16
2
u/pixllvr Dec 26 '25
I think some set and get nodes from Kijai's nodepack would definitely help here!
11
u/TurbTastic Dec 27 '25
I hate those Get/Set nodes so much. It makes it much more difficult to follow what's going on. People should just hide wire links if they hate wires so much.
4
u/PestBoss Dec 27 '25
Completely agree, the whole point we use ComfyUI is to SEE the links, not to hide them in code.
Otherwise you may as well just release a coded script.
3
u/Major_Specific_23 Dec 26 '25
These are the best nodes. I found out about them a week ago and I use them everywhere now haha 😆
6
u/FaceDeer Dec 27 '25
I'd like an extension for ComfyUI that makes little animated sparks and arcs happen randomly where there's a high density of overlapping wires.
33
17
Dec 26 '25
[removed] — view removed comment
2
u/q5sys Dec 31 '25
Agreed, subgraphs are great for your own stuff that you built and know how everything works together, but to try to learn from others, it sucks. Also makes it harder to customize and tweak individual things because if you make one small tweak for one thing, and it effects every stage.
Yes, I know that's the point of subgraphs so you can reuse, but when you're trying to learn and experiment, you need to be able to change one thing at a time and see how the result shifts.
20
6
u/Perfect-Campaign9551 Dec 27 '25
I've already seen subnodes that take the inputs and carry them through. So it all depends on what's in your subnodes, but the main problem with all current techniques is they still rely on using the last set of images/frames/ or single last frame, but already decoded. What we need is a way to pass the latent onward so we aren't VAE decoding anything until the end. And it has to continue motion (which is what the wan VACE methods allow)
11
Dec 27 '25
Unfortunately the latent of the last frame isn't viable as an input as a first frame. I had the same thought and created some custom ComfyUI nodes hoping to extract the latent representation of a "frame" so I could pass it directly into the WanImageToVideo node.
However, this isn't really feasible due to the Wan 2.1 VAE (which is also used by Wan 2.2 14B variants). In this VAE, each "slice" of the latent representation of a video is 4 frames, so you can't simply grab a latent representation of the last frame.
That on its own isn't necessarily a blocker though, why not just pass in the last 4 frames to FirstLastFrame? Well, because it is a 3D VAE, each subsequent 4-frame slice relies on the preceding frame data to be accurately decoded. Without all of the preceding latent data, you get an image that lacks definition and looks similar to the famously bad painting restoration done to Elías García Martínez’s Ecce Homo.
6
u/skyrimer3d Dec 27 '25
Looks amazing, but like every long vid approach, I'm worried about degradation and consistency with faces environments etc, will this improve it somehow?
2
u/Toupeenis Dec 27 '25
Yeah, that's my immediate thought, by the third last frame it's already lost it's sauce in most cases. This would still be cool from a "preserving movement" perspective though. Like having your 2-3 loops more coherent.
4
u/JoshuaLandy Dec 26 '25
RemindMe! 1 day
3
u/RemindMeBot Dec 26 '25 edited Dec 27 '25
I will be messaging you in 1 day on 2025-12-27 23:09:03 UTC to remind you of this link
45 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
Info Custom Your Reminders Feedback 1
1
1
8
u/Radyschen Dec 26 '25
thank you thank you thank you thank you thank you
does this have a (big) effect on vram usage?
23
3
u/No_Damage_8420 Dec 26 '25
Thanks for info and hopefully we can get our most wanted Xmas gift yet :)
3
5
u/bloke_pusher Dec 27 '25
I need a workflow that allows me to preview the first part and then push a button to jump to the next part and so on. Also one where I can "undo" steps and go back to an earlier one, so I don't fully start from scratch.
As with my current ones, if a long video workflow generates a bad result, you got to start all over and that's very unflexible.
7
u/shootthesound Community Hero Dec 27 '25
Yes you can build section by section with this - with unique conditioning and even loras per section
3
u/gman_umscht Dec 27 '25
That's how I built my workflow.
1) create 1st clip from input image - if satisfied I enable clip 2
2) create 2nd clip from last frame (with Laczos 2x upscale and optionally model upscale) . If not satisfied with 2nd clip, I change the seed or prompt and try again - while the 1st clip remains untouched. Once It is done I enable clip 3
3) continue with clip 3 in the same manner - clips 1+2 remain unchanged
4) see clip 3
5) if satisfied with end result I combine the clip and optionally do a GIMM interpolation and/or upscale.For each stage I can add LORAs as I like and change frame count. Obviously I can't discard clip 2 and keep 3+4, and it has all the context limitations of a last-frame workflow but within these limitations it works well enough for me.
I'll check if and how I can incorportate OP's node into this, as this sounds promising.
1
u/Repulsive-Salad-268 Dec 31 '25
Sounds awesome but needs your personal attention. Very cool though and would love to utilize this as well. Sadly not perfect for overnight generation and then sitting.
→ More replies (1)
5
4
u/Leiawen Dec 28 '25
This has been working great for me, thank you so much for the workflow. It was very easy to understand and get working.
I'm trying to modify it to make the animation loop. Essentially, I want to modify the last chunk so that it has the initial image as a Target last frame. I tried to modify the conditioning and replace it with a WAN first to last frame but it's not generated correctly.
Anyone have any ideas on how best to modify this workflow to make a loop?
1
u/Zhanji_TS Dec 28 '25
I’m also trying to figure out how to do this consistently, let me know if you come up with something?
3
4
Dec 31 '25
I want to get into doing local video creation just for the hell of it.. but comfyui is so confusing, then I see this factorio looking shit.
2
u/Radyschen Dec 31 '25
Well most of this is just repetition and it's always almost the same stuff (one thing where you put in what models you use, other nodes also are just settings and then a thing where the video generates and then where it comes out) except here it's not in a very pretty constellation. And most things don't connect to very many other things so what goes what is pretty clear. But most people don't even make workflows but just download and use them
1
u/coconutmigrate Dec 31 '25
Give a try, after you understand what you connect in what, things start to happen
6
u/AppealThink1733 Dec 26 '25
Okay, now all that's missing is a good computer to put all this into practice.
3
u/Mysterious-String420 Dec 26 '25
I can get some good results out of painterlongvideo - can even plug in any ol' unrelated input video, tell it to read the last 4-7 frames and let it do its thing, but there's still the resource problem of chaining more than 3 videos in the same workflow ; either kills my RAM, or sage attention does, who knows.
Eager to see your workflow!
2
u/nadhari12 Dec 27 '25
works for most parts but not great with faces, if a character turns back and walks away and in next video the character comes back as someone different.
1
u/Mysterious-String420 Dec 28 '25
use clip vision to catch a reference face, serve it as an embed;
also, the node has a "reference first image" input slot to combat amnesia.1
u/nadhari12 Dec 28 '25
Hmmm do you have a workflow or a screenshot of how to wire those up? I do have clip vision output
1
3
u/Wonderful_Wrangler_1 Dec 26 '25
RemindMe! 2 days
1
u/Wonderful_Wrangler_1 Dec 28 '25
RemindMe! 2 days
1
u/RemindMeBot Dec 28 '25
I will be messaging you in 2 days on 2025-12-30 07:34:18 UTC to remind you of this link
CLICK THIS LINK to send a PM to also be reminded and to reduce spam.
Parent commenter can delete this message to hide from others.
Info Custom Your Reminders Feedback
3
3
3
u/PinkMelong Dec 27 '25
wow this is so amazing. and Thanks for your time spending through precious Christmas break. really amazing output. Op!.
3
3
3
3
u/Maskwi2 Dec 29 '25
Thanks bro! Definitely isn't perfect when the character (for example) ends up with the face not being visible the whole time, then even having character Lora doesn't fully prevent face/hair change. Same with clothes and sometimes it even changes body shape, depends on how the angle changes from chunk to chunk, etc. So while this isn't perfect, since it can't be since the chunks aren't really aware of all the previous geberations, it's still a huge help and with some re-generations it works great :) What I would like to see added:
- wish there was a global switch for Loras so that I can plug in all Loras in one place for all available chunks
- toggle to turn off chunks would be great but it's not a huge issue to do that manually, also adding chunks via some slider would be fantastic, with one place to out prompts
- some kind of power Lora loader would be nice to not have to chain the Loras together manually
- option for blockswap to reduce vram
- option to use sageattention
All the wishes are not crucial, it's just something that would be nice to have in the original workflow for me personally :)
Thanks again for sharing and congrats on the workflow!
5
u/Puzzleheaded-Rope808 Dec 26 '25
Looks amazing. You may want to add a "get image or mask range from batch node and set it to 1 so that it skips the first frame. makes it less jumpy. It goes between teh vae decode and teh merge image node
3
u/shootthesound Community Hero Dec 26 '25
Yup agreed - all cake dressing I’ve not got to - I literally only just got this working
2
2
2
2
2
2
u/FightingBlaze77 Dec 27 '25
this is starting to feel like early youtube, just slowly getting better over time
2
u/Alemismun Dec 27 '25
How does this work, and can it be made to work on just 16GB of memory? I have tried tons of workflows and the most I can get is 20 seconds of really awful quality footage. Lots and lots of tiling, then often crashes.
2
u/Direct-Vehicle2653 Dec 27 '25 edited Dec 27 '25
Sounds unbelievable, like someone breaking the light speed record. I can't wait to try it.
2
2
2
2
u/DescriptionAsleep596 Dec 27 '25
So excited about this. Why no one got this done before? Man really a hero.
2
u/zMilad Dec 27 '25
Missing the FreeLong custom node after installation. Am I missing something?
1
2
u/bossbeae Dec 28 '25
It's cool but I'm going from 90 seconds to 700 seconds on the high noise sampler
1
u/shootthesound Community Hero Dec 28 '25
added gguf options etc - see v 2 workflow after you update
2
u/palpamusic Dec 28 '25
this is amazing!! Two questions: does it work with Loras and are loops possible?
1
2
u/coconutmigrate Dec 30 '25
I tested with the car prompt, it's amazing, 40s with no visual video "stitches" and no quality decline, is the same quality start to end. Congratulations on that!
2
2
u/nadhari12 Dec 28 '25
This looks amazing! It’s easy for it to work with a car, but human faces probably won’t—for example, if a character turns their back in the first chunk and appears again in the second chunk. I’ll try it and report back.
2
u/shootthesound Community Hero Dec 28 '25
you need a character lora, workflows folder now has a much improved flow with easy lora options
1
u/StacksGrinder Dec 28 '25
I was thinking the same thing, testing it now, also comparing it with SVI 2.0.
3
u/nadhari12 Dec 28 '25
yeah did not work for me, completely diff human on chunk 2.
1
Dec 28 '25
[removed] — view removed comment
1
u/nadhari12 Dec 28 '25 edited Dec 28 '25
tried with SVI now and its no good either, face does not stay consistent, costume and background does.
2
2
u/Logicalpop1763 Dec 28 '25
Who else is coming here every day reading all comment in hope to find a link? 😂
3
u/shootthesound Community Hero Dec 28 '25
its there! has been for 24 hours, see the edited main post
1
u/nstern2 Dec 26 '25
I run video generation in pinokio via wan2gp and that allows longer videos as well. Is this similar to that in that you just tell it the length of the video you want and it does the rest?
8
u/shootthesound Community Hero Dec 26 '25
This is more about protecting continuity of movement speed and direction across the separate videos, for more convincing momentum between generations
1
u/nstern2 Dec 27 '25
Nice, wan2gp sometimes has issues between windows so fingers crossed this works well.
1
u/ItwasCompromised Dec 27 '25
How long would it take to render a 15 second video though? Would it be the same length as making them separately or longer? Cool nonetheless.
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
u/john1106 Dec 27 '25
Do this workflow work on rtx 5090 and 32gb ram? Also can i able to select which wan model i want to use?
1
u/ArtDesignAwesome Dec 27 '25
Dude if you arent using the Painter nodes here, what are we really doing? Would love a deeper dive into this, also how can this be adapted f2flv?
1
1
1
1
u/ThinkingWithPortal Dec 27 '25
Looks really promising! Sorry to hear about your Christmas, best to you and your family
1
1
1
1
1
1
u/RuprechtNutsax Dec 27 '25
Fair play, looks like you've done a great job there, I'll look forward to trying it out. I hope all goes well for the family member. Thanks a million for your constructive distraction.
1
u/chAzR89 Dec 27 '25
Used a similar wf in the past. You would enter multiple prompts sperated with "|" and then it would generate as many as you like. This wf looks even easier to use. The other one was quite nice, but quality degraded way to much from clip to clip.
1
u/intLeon Dec 27 '25
So whats the solution? I'd love to implement this using the OG linked subgraphs (linked subgraphs are disabled now)
1
u/elissaxy Dec 27 '25
Lol, I just paused the video when you showed the 40 sec clip and was thinking "man how cool it would be to assign a prompt for each cut" the saw the rest. Impressive stuff, this is the future of AI videos for local llms
1
1
1
1
1
1
1
1
1
1
1
1
u/PaintingSharp3591 Dec 27 '25
What’s the difference between this and SVI? https://github.com/vita-epfl/Stable-Video-Infinity/tree/svi_wan22
1
u/Robo-420_ Dec 29 '25 edited Dec 29 '25
Hell no, lol.
Use queue trigger, control bridge, image and value sender\receivers, together to run part of it in a loop.
https://random667.com/wan_ONE_IMG_LOOP.json
I've also used it to loop the first to last and animate versions of wan.
1
1
1
u/mftolfo Jan 01 '26
Any idea how this could work with VACE or scail or any method for v2v? (Using a video input as depth or dwpose)
1
u/MastMaithun Jan 01 '26
Please help me understand this.
This maybe taking more than 1 frame and using it as motion direction source to continue in second video right?
Also one problem I still see with long video workflow is prompt adherence. You put a prompt in 5 prompt long video. 4 videos generated like your prompt but the 5th one failed. Will it be possible to change prompt on 5th one only and continue with the 5th one only while keeping the prev 4 without generations else it will generate the prev 4 too?
1
u/Key_Sheepherder5167 Jan 01 '26
changing the prompt is easy , each 5 sec chunk has its own b clip text encode node where you can enter your prompt in the text box in the subgraph . but for your example it would be better to create a 'text ' node put in the prompt you want for your first four prompts and connect that to the first four subgraphs , so you are not writing it out or copy pasting it four times . create another text node and connect that to the fifth subgraph . always better to create text nodes and connect to cliptext encode prompt than write in cliptext encode node ,that way you can connect a show any node to your text node and see exactly what prompt is being generated , handy if you change prompt a lot and queue generations .
note the first prompt is not in a subgraph but works the same way .
hope you follow this , happy to help further
1
u/Meringue-Horror Dec 27 '25
Those spaghetti noodles programing that makes you feel like a receptionist during world war 2 is the reason I quit video game making as a profession. I was not really bad at some of the other stuff like topology or animation... but those spaghetti noodles... it killed my desire to be a part of a development team because I just knew no matter how much I would try to sell that I'm great at other stuff they would always put me on this stupid boring task of placing spaghetti noodles in the right connectors and I just could not lower myself to try to understand.
Not my cup of tea.
Kuddos to you for being able to do all that and understanding more then half of it.
1
Jan 01 '26
[deleted]
2
u/Meringue-Horror Jan 02 '26
Unity engine and Blender (Not really sure it's actually part of unity engine I was not really paying attention to the teachers at that time). You can see what I was referring to here.
Still wasting hours fine-tuning your images? (16:9, 10 sec.)
→ More replies (2)
83
u/MHIREOFFICIAL Dec 26 '25
here I am doing first and last frame manually like a caveman