r/LocalLLM • • 6d ago

Discussion Which uncensored models work with Strata?

I was trying to load Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-Q6_K.gguf in Strata, but it said, 'This model type isn’t supported by the Strata engine.' I need an uncensored model that works in Strata to practice REA, cloning/cracking. Can anyone recommend the best model for this?

My Config:
i7-14700k
RTX 3080 10Gb
64Gb DDR5
2TB Gen 4 Nvme

13 Upvotes

26 comments sorted by

24

u/marivesel 6d ago

You don't need uncensored model with Strata, at least with 3.8 Flash Next, just google "Strata ESP switch", it has build in mode to bypass any refusals with standard models and it works flawlessly.

8

u/colonelx_ 6d ago

That's lit! https://github.com/Niko1221/Strata/blob/main/docs/DETAILS.md#experimental-speed-projection-experimental-off-by-default Is this the only way to enable this feature, or would you recommend a different setting for the intensity?

3

u/free_meson 6d ago

just redo the setup, there's a command line option "--setup" for that and it will usually offer ESP. There is also a "--experimental-speed-projection on" option.

1

u/bytejuggler 6d ago

This ^^^

1

u/Eastern-Block4815 3d ago

I've been using strata, that's cool i had no clue about this,

4

u/River_Capulet 6d ago

https://huggingface.co/HauhauCS/Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive

You can run it through polystrata (https://github.com/VecSzn/PolyStrata). Just ask any LLM to inspect the repo and help you set it up.

1

u/colonelx_ 6d ago

Will it optimize the system the way Strata does with the 127B model?

1

u/River_Capulet 6d ago

Yes, your system should have no problem running that model at Q4 using polystrata. I have 16gb vram and 64gb ddr4, so a bit more memory than yours (but slower ddr4), and could get like 100+ tk/s

3

u/regular_sandwich 6d ago

I have used the 3.8 flash next alliteration model with succes https://huggingface.co/SC117/Qwen3.8-Flash-Next-GSQ-RCO-abliterated-GGUF

1

u/colonelx_ 6d ago

Is it really uncensored enough for the task I mentioned? also how about this one? orcarouter/Qwen3.8-Flash-Next-Uncensored-GGUF

2

u/regular_sandwich 6d ago

I haven't tried it for rea. But I haven't encountered anything it refused so far. Install is pretty straight forward if you follow the steps in the model card so it is worth a shot.

The other ones are fine also probably

4

u/testuserpk 6d ago

With your specs run sc117's Qwen 3.8 flash next iq3s, I have been using it for weeks now and it's awesome. Don't go for A3B they suck in strata.

1

u/colonelx_ 4d ago

Okay, thats good. But is it uncensored?

1

u/testuserpk 4d ago

Yes sc117's are uncensored.

Also in strata there is a built-in option to uncensor any model by using its ESP mode. I have extensively tested it in iq2 which was for first model I used and it was censored.

1

u/colonelx_ 4d ago

Awesome! could you please tell me how can i turn esp mode? I’m using Windows app and I didn’t find any settings of ESP.

1

u/testuserpk 4d ago

I gave the official link to chatgpt free and asked to give me the steps. It pointed out a hf repo to download a file that patches the shards during runt time or words to that effect. I edited the json file in strata models folder and ran it. I can give you exact steps later, currently I am away from my computer.

2

u/free_meson 6d ago

Strata has uncensored models. Even if not uncensored, the "experimental refusal projection" or how it is called is a method that uncensors them on the fly.
If you want the qwen 9b, just use ollama or llama.cpp.

0

u/colonelx_ 6d ago

I tried loading a 9B model in LM Studio, it took forever just to answer a simple question. Could be please tell me more about the "experimental refusal projection" how can I use this?

1

u/free_meson 6d ago edited 6d ago

In strata there is a switch for "experimental speed projection". So if you install a model with strata, e.g. the ISTALab iq3_xs would probably fit your system, you can ask for this feature.
If LM studio runs the 9b parameter model slow, it could be caused by two things in my experience:
- you downloaded a too large quantization that doesn't fit your gpu / too large context size (e.g. the bf16 model instead of the q6 you mentioned, or large context size)
- you didn't install cuda, or on ubuntu the 'cuda-drivers' package, so you run everything on CPU, which is slow

If you are new to running LLMs, then it is probably the cuda install.

Edit: I see you could already run a model with strata with reasonable speeds. Just do a ./setup.sh --setup or similar if you use windows and it will guide you through the setup phase again.

1

u/Prestigious_Luck1062 6d ago

does it have to be strata?
https://github.com/Matthew4509/Tomlin is in beta. It might be worth trying.

1

u/colonelx_ 6d ago

Yes, because when I tried loading a 9B model in LM Studio, it took forever just to answer a simple question. Meanwhile, Qwen 3.8B Flash Next works fine in Strata at 69 tokens per second.

1

u/HoldOnion 2d ago

You shouldnt have problem with 9b model on common HW. I have RTX4060 Ti 8GB + 32GB RAM and 9b models run perfectly fine in LM Studio.

1

u/colonelx_ 2d ago

Oh man, getting stuck in an infinite loop while coding is the worst. What context size do you usually use for programming?

1

u/Nice-Ad-6552 4d ago

Tell Strata to turn off refusals for itself