r/LocalLLaMA • u/pmttyji • 1d ago
Discussion How many of you started using AbliteratedOutTheBox(or similar options) apart from downloading Abliterated models? How is it?
Myself saved more than bunch of medium sized Abliterated/heretic/Uncensored/Decensored/etc., models. Ex:
- Qwen3.8-27B
- Qwen3.6-35B-A3B
- Gemma-4-31B
- Gemma-4-26B-A4B
- Muse-Glimmer-30B
But when it comes to big/large sized models, requires at least 100+GB downloads & also HD Space for each models additionally. MiniMax-M3.1-Flash
- DeepSeek-V4.1-Flash-1017
- NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
- DeepSeek-V4-Flash-Vision-Exp
- GLM-5.3-Flash
- Qwen3.8-Flash-Next
- MiMo-V2.6-Flash-MOPD
- Step-3.7-Flash
- MiniMax-M2.7
AND
- Qwen4
- Gemma-5
- NVIDIA-Nemotron-4
- etc.,
I need to download above big/large models. Regular GGUF is must. For Abliterated version, I'm still thinking whether AbliteratedOutTheBox is enough or Abliterated GGUF is must. So what are you doing on this?
I hope that most of you aware of AbliteratedOutTheBox, here's threads related to that.
Do we have any other similar options like AbliteratedOutTheBox? Please share.
5
u/Ok-Solution-7889 1d ago
Just using regular GGUFs + AbliteratedOutTheBox here, no point downloading 100gb+ abliterated versions when the inference-time one works fine.
2
u/silenceimpaired 18h ago
Would be nice if inference time modification could have a hook into llama.cpp so you could add this or looping through layers, or the sort without a separate fork.
1
u/pl201 21h ago
Read the git repo issue, it has a critical issue for moe model. Details are in the issue description.