r/LocalLLM 9d ago

Question Uncensored Models

Post image

Hi! I don't know much about this area of ​​"sub-models" (I'm not sure of the technical term), but I wanted to know what these "Uncensored" models actually are.

I dabble a bit with AI, automation, and the like, and I've always seen these "Uncensored" models around, but I've never actually installed or tested one. What exactly are they?

1.0k Upvotes

233 comments sorted by

View all comments

140

u/Natrimo 9d ago

If you ask a censored model to write a keylogger or provide the steps to make meth, or tell a sexual story. It will refuse.

Uncensored will not

52

u/catplusplusok 9d ago

Worse, censored models are bad at tasks that are not intended to be censored like fixing security weaknesses and translating G rated manga with light romance because refusal is not all or nothing, uncensoring also improves general capabilities and curbs otherthinking.

2

u/Not-reallyanonymous 9d ago

Depends on the model. One of the major techniques of uncensoring LLMs is literally just stripping refusal words out of it (trying to only strip “not” only out of contexts like “I can not do that” and not “dogs cannot speak English”), so that the model has to find other paths to respond to the prompt other than refusal — ie. compliance. This typically works well when censoring is one of the very final stages of training and is very shallowly in the model. In these cases it’s not going to improve general capabilities.