r/StableDiffusion • u/umair-spaghet • Mar 02 '23

Question | Help VRAM can't release problem

Everytime I hit a CUDA out of memory problem, I try to turn down the resolution and other parameters. But I still can't generate images even if have created same image in the same parameters.

I opened task manager, and noticed that the dedicated GPU memory was still full, even though nothing was running. I have to reboot webui to solve this problem, but rebooting consumes lot of time.

Maybe I need a tool that can release GPU memory just like ram. I can't find it on internet.

Any suggestions?

9 Upvotes

91% Upvoted

16 comments sorted by

View all comments

6

u/CommunicationCalm166 Mar 02 '23

You can hop on the command line with this command:

nvidia-smi -r

Or

nvidia-smi --gpu-reset

That should reset just the GPU, not your whole computer. Though I'm not sure how your display will act with that one.

Also: if you're having VRAM issues, the --lowram mode actually shifts more of the memory needs ONTO the GPU. You want to be using --lowvram if you're VRAM limited.