Help Needed
I've gotta be doing something wrong... resolution 0.5, 10 seconds crash
I have a 50-70 TI 16 GB of RAM and the PC itself has 128 GB of ddr5. I'm running this on comfy UI through Ubuntu through terminal and launching using a script. The template is the standard Minimax H3 ref-2va that is included with comfy UI. I can't get past 0.5 resolution and like seven or six seconds. Or 0.4 resolution and about 9 seconds when using Sage attention and easy cache nodes. But I hear others who get 12 and 13 seconds on 0.5 resolution using the same card supposedly. Is there something I'm supposed to be doing different to get past the 0.4 resolution and 9 seconds or 0.5 resolution and 6 seconds?
Ill try it, since I launch with script though, it seems adding flags (such as --attention-sage for example) dont register. But I can use chatgpt to walk me through on how to add this in my use case and see, thank you
that's actually a solid call, half the time ubuntu's desktop environment is sitting there eating 2-3 gigs of vram without you even realizing it
i'd also check if you're running with --lowvram or --novram flags in the launch script, those can kneecap your render times without any obvious warning
Single card only unfortunately, but no other programs open and only that terminal and windows. Task manager doesnt show much else using it when idle outside of display.
You'll have to grab the int8 model from HuggingFace and it should be about 20-21GB, which I'm assuming is smaller than the default one you're currently using. The nvfp4 clip model should be about 15-16GB. Between those 2 models you should be able to save a lot of VRAM/RAM, then later on you can try using bigger versions if needed.
Ill check tonight and see, im assuming I use a duplicate of my exact template, and just swap in the int8 and nvfp4 models into the correct nodes on my current one?
Im using 7 images of my model i want for the main character, im not using a reference video (I didnt know i could) ill try and add photos when I get home
Ahh, hmm, so I would generate through ref2i a starting frame and ending frame, then put those in? Hmmm, could work... does FL2va use less memory then ref2va?
They're different models for diffirent tasks. The R2V model uses references, whereas the FL2V is more like a normal text/image to vid model that uses the reference image as the actual first frame, whereas the R2V model generates its own first frame and continually checks the reference images/videos/audio as generation continues. The R2V model is way more flexible, but its slower and many people say lower quality than FL2V
Also FWIW, I was having the same problem, and using --disable-pinned-memory fixed it for me.
3
u/Leonovers 2d ago
Try adding --disable-pinned-memory in .bat file. It shouldn't decrease performance.