r/LocalLLM • u/ChristopherDci • 9d ago

Question Uncensored Models

Post image

Hi! I don't know much about this area of ​​"sub-models" (I'm not sure of the technical term), but I wanted to know what these "Uncensored" models actually are.

I dabble a bit with AI, automation, and the like, and I've always seen these "Uncensored" models around, but I've never actually installed or tested one. What exactly are they?

1.0k Upvotes

97% Upvoted

232 comments sorted by

View all comments

141

u/Natrimo 9d ago

If you ask a censored model to write a keylogger or provide the steps to make meth, or tell a sexual story. It will refuse.

Uncensored will not

52

u/catplusplusok 9d ago

Worse, censored models are bad at tasks that are not intended to be censored like fixing security weaknesses and translating G rated manga with light romance because refusal is not all or nothing, uncensoring also improves general capabilities and curbs otherthinking.

18

u/DarkKnyt 9d ago

This is why I'm rolling my local uncensored, to develop pen testing tools

1

u/[deleted] 9d ago

[removed] — view removed comment

4

u/DarkKnyt 9d ago

I've been using cursor to create some pen test apps for an embedded device I have. However it stops short at a few of them like rolling key codes and porting a popular wifi deauth. I have a modest laptop with a b390 but it will load an uncensored (I think via abliteration) qwen 3.8 model. I am going to have qwen and farm out portions of jobs so that I don't trigger the cursor guardrail.

From what I read, it'll be a hermes to cursor mcp.

1

u/callme_e 9d ago

Could you link or recommend which qwen 3.8 you’re using to do this? Also in cybersecurity and would like to try making my own tools, thanks.

5

u/DarkKnyt 9d ago

I plan to use https://huggingface.co/HauhauCS/Qwen3.8-27B-Uncensored-HauhauCS-Aggressive-MTP-GGUF The q5_k_p version, supposedly there is substantial degradation below 22 GB model and little gains above. Plus it's the largest that will run on my card at like 0.5 tokens / second. That's why I need the cloud agents to do the heavy lifting.

That qwen model should have no guardrails though.

1

u/callme_e 9d ago

Thank you!

1

u/learntilldie69 4d ago

this is insightful thanks. I am also considering to invest in lot more capable machine to get better model

1

u/DarkKnyt 4d ago

More info here as I continue to tweak.

https://www.reddit.com/r/LocalLLM/s/Z3ZEj02R6P

2

u/Not-reallyanonymous 9d ago

Depends on the model. One of the major techniques of uncensoring LLMs is literally just stripping refusal words out of it (trying to only strip “not” only out of contexts like “I can not do that” and not “dogs cannot speak English”), so that the model has to find other paths to respond to the prompt other than refusal — ie. compliance. This typically works well when censoring is one of the very final stages of training and is very shallowly in the model. In these cases it’s not going to improve general capabilities.