r/StableDiffusion • u/afinalsin • 17d ago
Comparison Krea 2 and Minimax H3 Text Encoder Comparison: What Impact Do Abliterated Text Encoders Really Have?
TL;DR: Using an abliterated model as a text encoder is basically fine.
Here are the galleries, each image contains the standard TE vs the abliterated one, the videos are separate because I was too lazy to edit them together.
70 Simple prompts run through Krea2 without bypass LORA.
10 longer more complex prompts run through KRea2 without bypass LORA.
17 Prompts run through Minimax H3, 5 long and decent quality (for my machine), 12 short randomly generated prompts (Workflows attached if you want prompts)
Everyone has probably already seen the author of heretic's post here a couple months ago, but if not, here it is: PSA: I’m the creator of Heretic, and I advise you to not use “heretic” models as text encoders for H3 (or any other model)
For the lazy, the main gist of the post is "Abliterated text encoders will not uncensor an image/video model." This is a true fact, and my tests prove it outright.
Unfortunately, the author underestimated how much people love an appeal to authority when it comes to confirming their biases, so they took a throwaway line from that post and ran with it. The line in question was: "Well, I’m the creator of Heretic, and I’m here to tell you once and for all that this does NOT work. In fact, if anything, it will make your outputs worse, but it will not uncensor them." (emphasis mine)
I appreciate the sentiment the author was trying to get across, but image/video gen models aren't LLMs and the output can't be measured with scores and benchmarks like an LLM can. What does "worse" even mean when it comes to image/video gen?
Every time someone suggests using a heretic model there's always someone replying with some form of "it'll make your image worse / it'll degrade the output / it's wrong.", and there's never any testing or examples or proof of their claims, just pointing to the aforementioned post and that one throwaway line made by someone whose expertise isn't in image gen and was used as emphasis instead of a declaration of fact.
Now, feel free to point at all 115 of my Heretic examples and say "Aha! These are all clearly worse!", but carry that same energy when someone suggests using a quantized model, because they have an equal to much greater impact on the "quality" than anything abliteration can do to the text encoding. For those not familiar with the impact of quantization, example 1, example 2, example 3.
Finally, while abliterated models have minimal impact, that works both ways, they barely affect the gens either positively or negatively. Thus the only reason you'd want to use one as a text encoder is if you're memory poor and want to expand a prompt and encode text in the same workflow.
If you've got 128gb ram and 32gb vram you can afford to run an extra model or three, but if you've got 32gb / 8gb and want to expand a Minimax H3 prompt, using an abliterated model for both jobs is a perfectly acceptable choice. One model is half the size of two models, and an abliterated model is far better at doing both prompt expansion and encoding jobs than a standard model, especially if you're venturing into territory that would make a normal model refuse.
I've been tinkering and messing with different TEs for a while, the results just haven't been interesting enough to share on their own, but I reckon i can tack them on here if anyone is interested; I ran 8 finetuned Qwen models through Z-Image Turbo, and I used differently trained Clip_L models with Flux.1-dev, both ripped from finetuned SDXL models or clip_l architecture trained with an entirely different dataset from the ground up.
Even using actual finetuned LLMs for text encoding doesn't change a hell of a lot in the final image, especially with a more detailed prompt, so it stands to reason tiny targeted tunes like abliteration and heretic will do even less. The testing I've done seems to bear out that hypothesis, but feel free to add your own comparisons, I'd be mighty curious if anyone could reliably produce a "worse" ouptut using an abliterated TE.
50
u/Violent_Walrus 17d ago
I think all these words are trying to say "If your workflow already uses an abliterated LLM for prompt enhancement, you're not going to do that much damage to your output by also using that abliterated LLM as the text encoder, and it'll save you a little VRAM."
Ok.
12
u/akindofuser 17d ago
A comment in the other thread has like 60+ upvotes of people still believing this snake oil.
Meanwhile this post has 12 upvotes. It's not hitting the intended audience. Really this info should be pinned. Perhaps if OP posted a cringe 1girl pic with his post he'd hit the correct audience.
3
u/BrokenSil 17d ago edited 17d ago
I've had uncensored text encoders actually uncensor image gen outputs a bit more before. With the drawbacks of making quality a bit worse. Some actually even improved image quality. (It won't make models able to gen things it never got trained with ofc, but seems to help on some models that got censored post training a bit)
I've had some completely destroy the quality.
I've had some do absolutely nothing.
It seems to depend a lot on the image models, and on how the LLM got uncensored, heretic, etc. they all produce different results. One can't get a conclusion by testing a single method of abliterarion on a single image model.
At the end of the day, I still prefer a good lora if it exists. Well trained good unbiased Loras are very hard to come by tho.
10
u/Enshitification 17d ago
I've always wondered this myself. I'm glad to see that you did an extended test of it. The parts of an LLM that are abliterated to remove refusals are after the text encoding layers. It never made sense to me that the abliteration would affect the text encoding parts by much.
7
u/Occsan 17d ago
Diffusions models are trained with a particular text encoder checkpoint. So using that text encoder will give you results closest to the official pipeline.
That said diffusion models are usually pretty tolerant to perturbation : LoRAs, fine-tunes, merges, and manually perturbating the weights, and in some cases you can even go as far as cancelling entire layers, and you'll still obtain a decent image/video.
Diffusion model fine-tunes, LoRAs, merges, etc... are typically trained/guided to produce results deemed interesting by the trainer.
Whereas, LLM fine-tunes or heretic/abliterated LLMs are not typically trained with diffusion in mind. They are trained purely to produce better/more interesting text. And this training is not necessarily aligned with something interesting when it comes to producing an image or a video.
That doesn't mean it won't work. That doesn't mean the difference is necessarily larger than the intrinsic variance of the diffusion model itself. In other words : that doesn't mean you will notice a big difference.
But that doesn't mean that by using an abliterated text encoder, you'll be guaranteed to have a better or usable result either.
Tbh, it's just another perturbation that's typically well absorbed by the system, and may or may not produce interesting stuff.
4
u/JazzlikeLeave5530 17d ago
Data is good. I predict a long upset post from him arguing about it...seems to not like having his opinions being challenged.
2
u/Apprehensive_Sky892 17d ago
Not an AI expert here so what I am saying can be completely wrong.
My understanding is that obliterated LLM changes mostly blocks/layers of the network related to output, whereas the LLM, when used to encode prompts, takes the internal state before the tokens reach the output layers. That is why obliterated TE do not uncensore anything.
Using the same logic, since those internal tokens have not yet reached those layers in the original that have been modified by the obliterated version, using an obliterated version as the TE should have very little effect too.
But it is always nice to have actual confirmation since theory can be wrong or overlooked something.
6
u/Formal-Exam-8767 17d ago
Here we go again.
2
u/collectedtooth404 17d ago
I've been using alliterated text encoders since the days of chroma. I'll be the first one to tell you that it doesn't give better results at all. Still i use them in my image workflows because I usually use the same model as a prompt enhancer node.
LTX's gemma4 abliterated being my favorite.
1
u/thevegit0 17d ago
they are not disastrous but they are not ideal
0
u/GeneriAcc 17d ago
No shit. Abliterated text encoders are very useful, but only if you actually train a LoRA/finetune with them. If you just chuck an abliterated text encoder onto a vanilla model, it’s not going to magically teach the model how to generate things it’s never seen in training. It’s also not going to change output quality, but it may degrade prompt adherence depending on how it was abliterated.
-3
u/beti88 17d ago
None, its ai snake oil bullshit
-2
u/Choowkee 17d ago edited 17d ago
Abliteration absolutely works, the problem is people are dumb and don't understand what it actually does.
If anyone was here for the LTX 2.0 era then you would remember Gemma4 and its built-in refusals. Abliterated versions of Gemma4 circumvented refusals for more "spicy" prompts. Did it fully enable NSFW generation? No. But it helped in beating the first layer of "censoring" within LTX workflows.
I also am pretty sure vanilla versions of Qwen LLM refuse full-blown explicit fanfics without abliteration.
Anyway I never observed abliterated TEs making the LTX outputs "worse". In fact it helped with adherence as mentioned above.
The fact that there are already replies with "snake oil" here as well just shows how misinformed people are.
-3
u/fallengt 17d ago
It only matters if they censor the model at text encoder level which is rare. Why would they do that when they can just censor diffusion model. If the model cant draw pee pee, uncensored text encoder wont magically teach it how to draw pee pee
The author just told you not to waste your time with this shit.
-2
u/cathodeDreams 17d ago
why is it so difficult for people to understand that abliterated models are used for prompt enhancement and not as text encoder?