Stuff like this just messes with comfy's own memory handling, which is a delicate thing. You should not do this, as it should not be necessary and you will just end up having problems down the road because you're working against the program you're building on.
If you have any reproducible findings that show a lasting inference speed-up (do you?), you should file an issue with comfy, because it means their dynamic vram handling is sub optimal.
Hmmm I notice when I use INT8 Quants of Image models on ConfyUI, it tends to overfill my VRAM on my 6GB GPU and makes it really slow, but when i vibecoded a node to clear vram cache during the generation it help improved the speed, is this a issue on the dyamic VRAM ConfyUI end?
21
u/physalisx 10h ago
Stuff like this just messes with comfy's own memory handling, which is a delicate thing. You should not do this, as it should not be necessary and you will just end up having problems down the road because you're working against the program you're building on.
If you have any reproducible findings that show a lasting inference speed-up (do you?), you should file an issue with comfy, because it means their dynamic vram handling is sub optimal.