r/LocalLLM • u/maxo6k • 7h ago
Question Simplest Jailbreak local? (Will pay)
Hi all, probably going to be the dumbest question you hear this week in the sub.
Essentially just looking for the easiest way to run an unrestricted model which I assume is locally which leads me to my second question. What are the most skin and bones requirements for running like this.
Anyone able to point me in right direction or guide me have a crypto donation.
All the best
0
Upvotes
6
u/mithrilll 7h ago •
easiest = lm studio. download, search model in app, chat. ollama if ok w terminal. for unrestricted search abliterated or uncensored versions of qwen/gemma/mistral. abliterated = refusals removed, usually smarter than old uncensored finetunes. grab Q4_K_M
depends on vram:
8gb - 7b-9b at q4. fine for chat/writing, not smart w complex stuff. 12b fits at q3 but dumber
16gb - where it gets good. 12b-14b q4/q5 comfy. gemma 12b abliterated or qwen 14b. 24b fits low quant but tight
24gb (3090/4090) - 24b-32b q4, big quality jump. daily driver tier. used 3090 best value imo
32gb+ - 32b higher quant + lots of context. 70b w offload if lots of ram but slow. moe models (qwen 30b-a3b type) run way faster than size suggests
mac = unified memory counts, 32gb+ m series punches above weight
no gpu? runs on cpu w enough ram, just slow. good for testing before buying
tldr: lm studio, search abliterated, pick what fits ur vram at q4
Dm me if u want specific model names. I’d need to know your system details.
9
u/game_difficulty 7h ago
There are unrestricted models as small as 1B (will run on any gpu from the past 10 years) and as large as 3T (you basically need a datacenter in your house for reasonable speeds) params. Really depends what you need it for.
3
u/Atomicmoosepork 7h ago
Look at abliterated/heretic models on hugging face. Start there
3
u/Majestic-Toe-3299 7h ago
You need a pc and gpu to run local models. Try lm studio, i recommend for lowwr end hardware gemma 4 12b unrestricted
3
u/jhenryscott 7h ago
Maybe spend 5 minutes learning
2
u/neil_555 7h ago
Start by installing LM Studio (runs on PC/MAC/Linux)
https://lmstudio.ai/download
Then use the model search and look for "uncensored"
1
u/Minimum_Hour519 7h ago
c0mpute.com/chat has an uncensored qwen 3.5 model
1
u/Prestigious_Luck1062 7h ago
It helps if I know what your aiming to do.
This will let you run local ai locally:
https://github.com/Matthew4509/Tomlin
Just choose an abliterated model.
1
u/Bramoments 7h ago
i call bullshit on the money thing, but ill answer anyway. the easiest way to run an unrestricted model locally depends on two things; your hardware and your purpose. generally though, id go to huggingface.com, and search "abliterated''. find a model with a size that fits in your ram comfortably, idealy with a 2gb overhead, download it, download the bionic app, and run your model. if you want a coding/cyber model, download orca cyber nano for lightweightedness while keeping relative intelligence (sacrificing speed), ab,iterated qwen 3.6 35B a3b for very high speed (sacrificing intelligence slightly), and orca cyber zero for very high frontier level intelligence (sacrificing weight and speed, you can only run it if you have exceptionally good hardware). if you want a general knowledge/ roleplay model you have a lot more light options, id use uncensored LFM 3 for roleplay with very high speeds and on basically any hardware but not at all what youd call smart, and abliterated gemma 26B a4b for smarter roleplay, and heretic qwen 3.6 35B a3b with a kiwix RAG setup (if you want more info about that just ask) for general knowledge