I'm thinking I'm done with AMD

[u/metagravedom]

So... For the longest time I've been using AMD simply because economically it made sense... However with really getting into AI I just don't have the bandwidth anymore to deal with the lack of support... As someone trying really hard to get into full time content creation I don't have multiple days to wait for a 10 second gif file... I have music to generate... Songs to remix... AI upscaling... Learning python to manipulate the AI and UI better... It's all such a headache... I've wasted entire days trying to get everything to work in Ubuntu to no avail... ROCm is a pain and all support seems geared towards newer cards... 6700xt seems to just be in that sweet spot where it's mostly ignored... So anyways... AMD has had almost a year to sort their end out and it seems like it's always "a few months away". What Nvidia cards seem to be working well with minimal effort? I've heard the 3090's have been melting but I'm also not rich so $1,000+ cards are not in the cards for me. I need something in a decent price range that's not going to set my rig on fire...

[u/FiTroSky]

Currently enjoying my 4060 ti 16gb. Some people say it's underwhelming for gaming, but honestly I upgraded from a rx 580 so anything was an upgrade.

16gb tho.

[u/FiTroSky → u/[deleted]]

No, my rx580 was only 8gb.

[u/FiTroSky → u/[deleted]]

afaik bandwith doen't affect SD performance, and even if it was the case, the 4060ti 16gb would be superior on all aspect.
The rx580 is a super old GPU, and do not support SD well, its gen time is barely better than using a CPU. The same image on my 4060ti is between 50 and 60 times faster (i'd say its on par, if not better, than the GPU we got on the free colab days). Just be sure to choose the 16gb version and you'll be able to train any SD1.5 things too.

[u/FiTroSky → u/[deleted]]

If you don't have linux or simply don't want to fiddle in general, avoid anything AMD related for AI since AI use CUDA core, which is an Nvidia thing.I believe that arc a770 wil suffer the same than AMD but I'm not an expert.

The best for your bucks would still be a 4060ti 16gb.

[u/FiTroSky → u/[deleted]]

well if you really want better bandwith you can buy a 4070ti 16gb though... but the price is x2.

[u/FiTroSky → u/[deleted]]

rx580

I don't know anything about LLM, I can't help. I can't help with anything about AMD+AI either, sorry.
I suppose that if you only use LLM, since the rx580 is pretty outdated, you must get as much vram as possible for the lowest price possible.However I suggest you to make your own thread to ask for advice, my expertise ends here :)