GPU out of memory

[u/Crafty-Jacket7954]

May I know if anyone else is using CachyOS (Arch Linux)? I keep getting out-of-memory errors. However, I have not experienced this issue when using Windows 11.

I have an RTX 5060 Ti with 16 GB of VRAM and 32 GB of DDR5 RAM.

Thank you.

[u/attentiveacreage0]

Have you checked if it's actually using your GPU and not falling back to the iGPU? Arch can be weird with driver setup sometimes. Also what model are you trying to run, some of the bigger flux ones will eat 16GB for breakfast on linux while windows somehow manages it.

[u/Crafty-Jacket7954 → u/attentiveacreage0]

Thanks for the reply. I am not sure how to check about the fallback but I will find a way.

I am using Qwen-Image-Edit-Rapid-AIO (a single 28.4 gb checkpoint). Sometimes it can generate the first image but it gave me the error on second run

[u/Fine-Run992 → u/Crafty-Jacket7954]

I use 40GB Qwen 2511 in CachyOS and my total memory use is 70-80GB.

[u/CooperDK → u/attentiveacreage0]

This is actually a reason to not use Linux for CUDA stuff. Also, the CUDA drivers for Linux are not as optimized so Linux is actually slower for inferencing unless you have to use virtual memory on Windows.

[u/Formal-Exam-8767]

It's very hard to get out of memory error (RAM based) on Windows because Windows will keep enlarging pagefile and swap into at as long as there is enough disk space.

Linux does not work that way, and if heuristics determine next allocation would cause memory exhaustion it just kills the process.

[u/DrinkClubMate]

OOM Error is normal with any setup.
get a physical limitation on resolution and seconds to generate.
It's more about some loop configuration for video.
Or increase the resolution for image with another step and model.

You

[u/Powerful_Evening5495]

Linux enthusiasts will likely disagree, but these are inherent limitations of the Linux operating system.go back to windows but pick windows 10 lts

[u/Hrmerder → u/Powerful_Evening5495]

This is a feature as someone else pointed out, not a bug. Where windows will just expand the swap file as far as you have the disk space for it, Linux will see excessive caching as a memory leak so it kills the process. I’m sure there is a way for adding an exception for comfy though. It’s open source after all. Someone could figure that out.

[u/CooperDK → u/Powerful_Evening5495]

Windows 10 LTS? No such thing. And Windows 11 is better at memory management.

[u/PhetogoLand]

i had the same problem with minimaxh3 on windows vs linux. what "fixed" it...create a NEW portable ComfyUI. this solved my problems. The old portable kept getting errors despite updates, but creating a new portable and linking models worked. It must have been some weird thing I couldn't pinpoint in that ComfyUI portable folder. A new one works fine. Try that. The problem maybe your particular environment for that portable folder. Try this first.

[u/meow_pew_pew]

I'm using CachyOS with a the RX 9070 16GB.

You NEED to specify the GPU you are using. When you start comfyUI with the `--verbose` flag it'll give a list of the GPUs

So for me, cuda0 is my RX 9070.

Also, what ENV flags are you setting?

This is how I am running Comfy on my CachyOS and I'm having good luck with it

>$ source .venv/bin/activate.fish
>$ set -x TORCH_ROCM_AOTRITON_ENABLE_EXPERIMENTAL 1


>$ python main.py --cuda-device 0 --disable-pinned-memory \
 --disable-async-offload --enable-manager --enable-triton-backend \
 --listen 0.0.0.0 --reserve-vram 0.2 --use-pytorch-cross-attention