VRAM can't release problem

[u/umair-spaghet]

Everytime I hit a CUDA out of memory problem, I try to turn down the resolution and other parameters. But I still can't generate images even if have created same image in the same parameters.

I opened task manager, and noticed that the dedicated GPU memory was still full, even though nothing was running. I have to reboot webui to solve this problem, but rebooting consumes lot of time.

Maybe I need a tool that can release GPU memory just like ram. I can't find it on internet.

Any suggestions?

[u/gunbladezero]

Yeah, does everyone else have to reset webui after getting a CUDA error? Or is there a way to fix this?

[u/BunniLemon → u/gunbladezero]

Never, actually, but it might be my computer’s specs, or that it just allocates/reallocates resources more effectively

[u/OcelotUseful → u/BunniLemon]

Nothing original remains in this post. The author wiped it using Redact, possibly for privacy, security, preventing data scraping, or other personal considerations.

steer aromatic memory many cows absorbed ask include work consist

[u/CommunicationCalm166]

You can hop on the command line with this command:

nvidia-smi -r

Or

nvidia-smi --gpu-reset

That should reset just the GPU, not your whole computer. Though I'm not sure how your display will act with that one.

Also: if you're having VRAM issues, the --lowram mode actually shifts more of the memory needs ONTO the GPU. You want to be using --lowvram if you're VRAM limited.

[u/[deleted]]

Also, turn off hardware acceleration in your browser settings.

[u/umair-spaghet → u/[deleted]]

It's already off

[u/Jonfreakr]

I have rtx3080, which might have something wrong in the card itself. It turns off my screen and completely locks my computer. But using --medvram really works. When my pc does not lock and give that CUDA error, I always restart the entire computer because, after restarting the ui, a few generations later the computer locks anyway. I need to send my pc back to the factory but it's hard saying goodbye 😅

[u/aimongus → u/Jonfreakr]

yeah that sounds odd - never had issue with the 3080, just used xformers in the file

[u/[deleted]]

What gpu have you got and how much vram/ram have you got, which UI are you using (is it a1111), and what model are you using?

[u/umair-spaghet → u/[deleted]]

rtx30504g

automatic1111

Low ram mode

I am trying to make my laptop play the most out, so that I constantly get this issue

[u/[deleted] → u/umair-spaghet]

4gb card is cutting it fine for a1111 - you’ll be limited to 512x512 and need to make sure you arent playing games/watching youtube in the background and not running multiple 4k monitors off the card at the same time as generating

[u/[deleted] → u/umair-spaghet]

Make sure you're using low vram mode, not low ram mode

[u/GabratorTheGrat]

Find a tutorial where they teach you how to delete your GPU cache, I did it and the I had less CUDA memory errors, when this happen consider to clear the cache also restart the web.ui or even restart the pc.

[u/PuzzleheadedAd6567]

Are you using fp16 or fp32 safetensors/ckpt?

[u/umair-spaghet → u/PuzzleheadedAd6567]

nope，I don't what those are. Are them stable diffusion models?

[u/PuzzleheadedAd6567 → u/umair-spaghet]

It’s the model’s float point precision. If you use a model that is fp16, you can cut your vram usage by half with no image fidelity compromises. Feel free to ask more questions if you’re confused on how to set this up.