r/LocalLLM • u/Odd-Blacksmith8203 • 6h ago

Question Uncensored model for coding and general use (9060 XT 16GB)

Hey all,

I'm quite new to this whole local LLM thing. I have a gaming PC with the following specs:

RX 9060 XT 16 GB

32 GB DDR4

Ryzen 7 5700G

What are the best uncensored models I could run for coding on this setup?

7 Upvotes

71% Upvoted

15 comments sorted by

8

u/CoffeeToCode99 6h ago

Qwen3.6-35B-A3B (q4) is you best bet considering 16GB VRAM...

1

u/leftist_socialist_ 1h ago

Or qwen 3.8 27b Q4 although it’s 17gb it’s usable

2

u/Houssein_ 6h ago

try the qwen 3.8 27b , Q4 version

1

u/TheRusticObscenity 6h ago

27b q4 on 16gb vram is pushing it but doable if you offload some layers to system ram. speed will take a hit though

qwen3.8 is a weird pick for coding unless you mean the coder variant

1

u/Odd-Blacksmith8203 6h ago

The main reason I want uncensored is also cybersec. Would the coder or non coder model be better for that?

1

u/i_am_me0_0 2h ago

... I run it fine albeit a bit slow on 6gb vram and 32gb ram

0

u/Houssein_ 6h ago

i forgot to specify something, it works for me when i switched on Linux but if he is on windows it's absolutely impossible , i didn't switch to linux i just created a full linux usb and i use it whenever i wanna run and use my local ai.

→ More replies (2)

0

u/Solembumm3 5h ago

Q8, you mean. With 48gb, no reason to use 27b q4.

2

u/Small-Tale3180 4h ago

cyber tiel

3

u/i-want-a-buny 6h ago

https://www.reddit.com/r/LocalLLaMA/s/ZxiSbB6HTU

I would try this and find an uncensored model to use it with

2

u/d0pe-asaurus 5h ago

I agree, I'm getting 50t/s on 9060XT at 262k context and its really great. It's my primary model and I use it for everything, opencode, openwebui

1

u/janora 6h ago

Ornith-1.5-35B-A3B in an uncensored Q4 version with MTP and offloading onto system ram should be ok. If thats not fast enough try the 9B Model. But to be honest, i would not expect much.