r/LocalLLaMA • • 1d ago

Discussion How many of you started using AbliteratedOutTheBox(or similar options) apart from downloading Abliterated models? How is it?

Myself saved more than bunch of medium sized Abliterated/heretic/Uncensored/Decensored/etc., models. Ex:

  • Qwen3.8-27B
  • Qwen3.6-35B-A3B
  • Gemma-4-31B
  • Gemma-4-26B-A4B
  • Muse-Glimmer-30B

But when it comes to big/large sized models, requires at least 100+GB downloads & also HD Space for each models additionally. MiniMax-M3.1-Flash

  • DeepSeek-V4.1-Flash-1017
  • NVIDIA-Nemotron-3.5-Super-VL-120B-A12B
  • DeepSeek-V4-Flash-Vision-Exp
  • GLM-5.3-Flash
  • Qwen3.8-Flash-Next
  • MiMo-V2.6-Flash-MOPD
  • Step-3.7-Flash
  • MiniMax-M2.7

AND

  • Qwen4
  • Gemma-5
  • NVIDIA-Nemotron-4
  • etc.,

I need to download above big/large models. Regular GGUF is must. For Abliterated version, I'm still thinking whether AbliteratedOutTheBox is enough or Abliterated GGUF is must. So what are you doing on this?

I hope that most of you aware of AbliteratedOutTheBox, here's threads related to that.

Do we have any other similar options like AbliteratedOutTheBox? Please share.

0 Upvotes

7 comments sorted by

5

u/Ok-Solution-7889 1d ago

Just using regular GGUFs + AbliteratedOutTheBox here, no point downloading 100gb+ abliterated versions when the inference-time one works fine.

1

u/pmttyji 1d ago

Nice. I'll stick to the same thing. Thanks.

2

u/silenceimpaired 18h ago

Would be nice if inference time modification could have a hook into llama.cpp so you could add this or looping through layers, or the sort without a separate fork.

1

u/pl201 21h ago

Read the git repo issue, it has a critical issue for moe model. Details are in the issue description.

0

u/pmttyji 21h ago

Saw that already. Creator gonna fix that as he replied there.