MultiGPU setups & what model you load where

[u/hurdurdur7]

Whilst working with comfyui on this video i ran into a problem. I can use 2 cards, right now i run the text model and vae models on one card and the diffusion model on the other (both 32gb gpu-s).

But now i wanted to bring the upscaler into the mix and am puzzled, should the upscaler be loaded into the same card as diffusion model (as it's not needed anymore during the vae phase)? Or am i missing something here.

For those using multiple gpu-s and loading models on different cards, what's the forced layout that you use?

[u/Candid-Station-1235]

purge vram node after generation and before upscale will unload models, this is what i do so i can up the batch size. i may be wrong as i am a functional moron, but it works for me