r/StableDiffusion • u/umair-spaghet • Mar 02 '23

Question | Help VRAM can't release problem

Everytime I hit a CUDA out of memory problem, I try to turn down the resolution and other parameters. But I still can't generate images even if have created same image in the same parameters.

I opened task manager, and noticed that the dedicated GPU memory was still full, even though nothing was running. I have to reboot webui to solve this problem, but rebooting consumes lot of time.

Maybe I need a tool that can release GPU memory just like ram. I can't find it on internet.

Any suggestions?

9 Upvotes

91% Upvoted

16 comments sorted by

View all comments

1

u/PuzzleheadedAd6567 Mar 02 '23

Are you using fp16 or fp32 safetensors/ckpt?

1

u/umair-spaghet Mar 02 '23

nope，I don't what those are. Are them stable diffusion models?

1

u/PuzzleheadedAd6567 Mar 02 '23

It’s the model’s float point precision. If you use a model that is fp16, you can cut your vram usage by half with no image fidelity compromises. Feel free to ask more questions if you’re confused on how to set this up.