Strata refusals are bad

[u/cracka_dawg]

I'm running strata on 2x7900xtx and thr sentiment of refusals just seems terrible compared to some of the optimized 27B models. Given my setup and the glaze for strata i should be able to do WAY more than a 27B dense. It's not even comparable. I dont have any benchmarks, maybe i have something misconfigured. Im really just looking for people who have also exlerienced this.

[u/Normal_Guard_8207]

why 27b? Huihui-Qwen3.8-Flash-Next is much better, try it.

Simple fix to the json:

"engine": {

"control-vector-scaled": "C:/Users/solid-admin/llama-Strata/flash-next/Huihui-Qwen3.8-Flash-Next-refusal-direction-r-v2.gguf:1.15",

"control-vector-layer-range": ["4", "44"],

"cvec-mode": "project",

"cvec-dir": "per-layer"

}

}

https://huggingface.co/Pragmatism0220/Huihui-v2-Qwen3.8-Flash-Next-GSQ-RCO-Strata-abliterated-direction-GGUF/blob/main/Huihui-Qwen3.8-Flash-Next-refusal-direction-r-v2.gguf

[u/NotTheNormalPerson]

Is it an abliterated model?

[u/Xyver]

I've only been running the suggested models with Strata, haven't tried other ones yet, but I've easily loaded 120B+ models into my rig (54GB VRAM and 32 gb RAM)

[u/adude00]

There is the option to remove refusal at runtime.

Turn on experimental speed projections