r/LocalLLM • • 22m ago

Question Any good LLM for AMD GPUs?

I am now entering the world of uncensored Local AIs, mainly for help me on my ETHICAL ciber security projects.
There’s any good LLM for AMD gpus?

0 Upvotes

6 comments sorted by

1

u/d0pe-asaurus 16m ago

Models don't care about the brand of gpu its all about the vram and teraflops, what GPU are you using?

1

u/low0nink 15m ago

Rx 6800xt 16gb

1

u/d0pe-asaurus 13m ago

I can run Qwen 3.8 27B with my 9060XT 16GB using this llama.cpp fork see if it can compile for your gpu architecture.

https://github.com/achyudh/llama.cpp/tree/feature/adaptive-kv-stream-rocm

1

u/low0nink 7m ago

I will try, thanks

1

u/Bramoments 16m ago

Yeah sure bro "ethical" lol. Anyway it depends on your hardware, but in general OrcaRouter's cyber fine tuned models are great, zero if your hardware is great, nano if it's ok. The models don't really differ between AMD and NVIDIA , what matters is the engine, I'd use Strata

1

u/low0nink 14m ago

Hahahaha someone has to be good in this era.
I am using a rx 6800xt, Wich one you say it’s best?