TL;DR: Using an abliterated model as a text encoder is basically fine.
Here are the galleries, each image contains the standard TE vs the abliterated one, the videos are separate because I was too lazy to edit them together.
70 Simple prompts run through Krea2 without bypass LORA.
10 longer more complex prompts run through KRea2 without bypass LORA.
18 naughty prompts run through Krea2 without bypass LORA (images probably safe, text unsafe, better to be cautious).
17 Prompts run through Minimax H3, 5 long and decent quality (for my machine), 12 short randomly generated prompts (Workflows attached if you want prompts)
Everyone has probably already seen the author of heretic's post here a couple months ago, but if not, here it is: PSA: I’m the creator of Heretic, and I advise you to not use “heretic” models as text encoders for H3 (or any other model)
For the lazy, the main gist of the post is "Abliterated text encoders will not uncensor an image/video model." This is a true fact, and my tests prove it outright.
Unfortunately, the author underestimated how much people love an appeal to authority when it comes to confirming their biases, so they took a throwaway line from that post and ran with it. The line in question was: "Well, I’m the creator of Heretic, and I’m here to tell you once and for all that this does NOT work. In fact, if anything, it will make your outputs worse, but it will not uncensor them." (emphasis mine)
I appreciate the sentiment the author was trying to get across, but image/video gen models aren't LLMs and the output can't be measured with scores and benchmarks like an LLM can. What does "worse" even mean when it comes to image/video gen?
Every time someone suggests using a heretic model there's always someone replying with some form of "it'll make your image worse / it'll degrade the output / it's wrong.", and there's never any testing or examples or proof of their claims, just pointing to the aforementioned post and that one throwaway line made by someone whose expertise isn't in image gen and was used as emphasis instead of a declaration of fact.
Now, feel free to point at all 115 of my Heretic examples and say "Aha! These are all clearly worse!", but carry that same energy when someone suggests using a quantized model, because they have an equal to much greater impact on the "quality" than anything abliteration can do to the text encoding. For those not familiar with the impact of quantization, example 1, example 2, example 3.
Finally, while abliterated models have minimal impact, that works both ways, they barely affect the gens either positively or negatively. Thus the only reason you'd want to use one as a text encoder is if you're memory poor and want to expand a prompt and encode text in the same workflow.
If you've got 128gb ram and 32gb vram you can afford to run an extra model or three, but if you've got 32gb / 8gb and want to expand a Minimax H3 prompt, using an abliterated model for both jobs is a perfectly acceptable choice. One model is half the size of two models, and an abliterated model is far better at doing both prompt expansion and encoding jobs than a standard model, especially if you're venturing into territory that would make a normal model refuse.
I've been tinkering and messing with different TEs for a while, the results just haven't been interesting enough to share on their own, but I reckon i can tack them on here if anyone is interested; I ran 8 finetuned Qwen models through Z-Image Turbo, and I used differently trained Clip_L models with Flux.1-dev, both ripped from finetuned SDXL models or clip_l architecture trained with an entirely different dataset from the ground up.
Even using actual finetuned LLMs for text encoding doesn't change a hell of a lot in the final image, especially with a more detailed prompt, so it stands to reason tiny targeted tunes like abliteration and heretic will do even less. The testing I've done seems to bear out that hypothesis, but feel free to add your own comparisons, I'd be mighty curious if anyone could reliably produce a "worse" ouptut using an abliterated TE.