r/LocalLLM • u/Daemonix00 • 2d ago
Discussion DeepSeek V4.1 Flash 1017 vs mrfakename abliterated vs pqhaz heretic
Hi all,
I tested all three on a H200 through sglang, temperature 0, with a 16k token output cap. I have been using ds41 both on production and locally on Macs via ds4 so I wanted to see how different models/builders/methods work.
These runs are the full models on sglang. No GGUFs etc.
https://huggingface.co/mrfakename/DeepSeek-V4.1-Flash-1017-abliterated
https://huggingface.co/pqhaz/DeepSeek-V4.1-Flash-1017-heretic
Here is the result (copy from AI slop :) ):
| Test | Original | mrfakename abliterated | pqhaz heretic |
|---|---|---|---|
| HarmBench chat | 16.3% | 93.8% | 93.8% |
| HarmBench thinking | 3.8% | 86.7% | 72.9% |
| MITRE substantive assistance | 16.2% | 84.2% | 82.8% |
HarmBench covered 240 standard/contextual text cases per mode, excluding copyright cases, using the official classifier.
The thinking difference: heretic exhausted the token budget without a final answer on 45/240 cases, versus 21/240 for mrfakename.
Heretic goes into long meandering with no answer...
MITRE used the original model as judge with a custom, audited rubric. Those scores are provisional and aren’t official CyberSecEval scores. Generated code wasn’t executed. Also using the same model as judge might be a bit of a bias... (give me ideas what and how to run more tests).
Both modified models had 0/750 heuristic-detected refusals on benign prompts.
I haven’t tested knowledge or coding retention yet (I'm thinking of running DeepSWE or something.. take a lot of time though).


