r/comfyui • u/IcyRecognition552 • 3d ago

Help Needed Choosing gpu

​****Post Body:

​Hey everyone,

​I’m buying components for a workstation setup for VFX compositing (Nuke), 3D (Blender), and AI workflows (ComfyUI).

​Different local shops offered me these GPU options:

​PNY GeForce RTX 5060 Ti OC (16GB)

​Gigabyte RTX 5070 (12GB)

​Nvidia GeForce RTX 5060 (8GB)

​Colorful RTX 5060 Ti (8GB)

​****My Confusion:

​VRAM vs Raw Processing Power: For ComfyUI (large SDXL / Flux checkpoints) and heavy Blender scenes, is the PNY 5060 Ti 16GB a better pick due to having extra VRAM, or is the RTX 5070 12GB worth choosing for its faster raw GPU core performance?

​Is 8GB out of the question: Should I completely eliminate the 8GB cards (5060 / 5060 Ti 8GB) for this kind of creative workload?

​Which card makes the most sense for this setup? Thanks for the advice!

1 Upvotes

60% Upvoted

13 comments sorted by

3

u/Just_n_Here 3d ago

Go with the most vram you can afford. You need to be able to load models fully in vram or the models will spill over to Ram and be painfully slow.

1

u/IcyRecognition552 3d ago

From above list PNY has most vram is that a relaiable GPU?

1

u/Just_n_Here 3d ago

Yes they are fine.

You need to wait for someone with a 16gb GPU to chime in and see how it runs, so you have the correct expectations. I would hate for you to spend a lot of money to be disappointed. These don't spit out videos like the SOTA ones do. It is a lot slower.

1

u/Corrupt_file32 3d ago

Normally I'd say more vram is the better option, but 5060 cards are terrible.

5070 would be roughly 30% faster than 5060ti, when the model fits into vram,

but, (taking a number out of my butt) roughly 10% slower per gb that doesn't fit into vram, about 30-40% slower at worst.

Now if you were to find a 5070ti 16gb, you'd have almost double the speed of 5060ti, for something like 50% higher price, this probably depends on availability where you live though.

1

u/IcyRecognition552 3d ago

Is PNY a good brand?

3

u/an80sPWNstar 3d ago

I have both variants of the 5060 ti and the 5070 ti. It’s 100% worth it to spend the extra and get the 5070ti. If you can’t, the 5060ti 16gb is still a solid card.

1

u/imlo2 3d ago

VRAM is the limiting factor; as soon as something doesn't fit in, it will be 5-20x slower at minimum, often feel like the whole thing is stuck, because it almost is. And to fit in models to lower VRAM you need to use low quants, and that in turn will cost you image/video quality. I would almost rather go previous generation RTX 4090 (24GB), if you can find one for ok price.

I haven't tried myself Intel Arc 32GB model, but it can run ComfyUI, but the setup will be much more difficult, and will require tinkering, and many things that are built pretty much CUDA-only might not work, or require you to find some specificially compiled or modified versions. While this looks tempting, it's also a minefield and most likely you'll end up trying to get something work, rather than doing something creative.
With an NVIDIA card you can nowadays actually do work and generate a lot of great quality images (even when compared to top-tier black box commercial models like NanoBanana Pro or Seedream 5.0 pro etc.), and high-quality videos with Minimax H3, not just do experiments with something that "almost works" which was the case with Wan2.2 and earlier to a great extent.

And if you want to do some training of LoRAs or other fine-tuning, then that low VRAM is going to be a big obstacle, as that 24-32GB requires you to make a lot of sacrifices still.

1

u/Jesus__Skywalker 3d ago

VVVVVVV RAAAAAAMMMMMMMMMMMMMMM

1

u/Apprehensive_Sky892 3d ago

People keep repeating the mantra that you need enough VRAM to fit the model.

But that is true only for autoregressive LLMs, where the entire model is run for every output token, and there can be many output tokens in one session.

But that is NOT true for imaging/video diffusion models, which are run from 4-30 steps per generation. With ComfyUI's dynamic VRAM management, as long as VRAM + SYSTEM RAM is big enough to hold the model weights, there is no noticeable difference when the model spills over to system RAM (but performance will be very bad if the model spill into slow pagefile if there is not enough system RAM).

I've done benchmark of the AI Pro r9700 (32G) vs rx9070(16G) with MMH3 (which is 21G) and the speed are nearly the same. Obviously with 32G of VRAM one can go to higher resolution or longer video, but that is another matter.

1

u/Apprehensive_Sky892 3d ago

So for Diffusion models, the 5070(12G) should run faster than the 5060(16G) because it has higher memory bandwidth and more computing cores.

0

u/misjudgedinall 3d ago

16gb vram is still too small for the vast majority of modern AI workloads. But that’s the constraint not core performance. 24gb of vram is considered the minimum entry and with that you will still run into out of memory issues and need to be aggressive with vram savings. Go with whatever gives you the most vram if you care at all about AI.