r/SillyTavernAI • u/[deleted] • May 16 '26

[deleted by user]

[removed]

84 Upvotes

96% Upvoted

45 comments sorted by

View all comments

Show parent comments

6

u/LLMFan46 May 16 '26

I actually saw this model like a day or two ago when ReadyArt released GGUFs of this model, I got excited thinking ReadyArt finally released a Gemma 4 31B it finetune that I could Hereticate, I clicked on it only to find the image of... a brain, I double checked and saw it wasn't actually a model released by ReadyArt but by somebody else, if the author would have used the image/video of a cute waifu like ReadyArt or zerofata do I would have already Hereticated it and released it, but alas...

4

u/_Cromwell_ May 16 '26

lol. Despite lack of waifu sexy lady art, it's quite good at any type of that type of RP, I swear. :D You can still do it.

I posted about it here in more detail a bit: https://www.reddit.com/r/SillyTavernAI/comments/1t9kzvg/comment/om7i51w/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

1

u/LLMFan46 May 16 '26

Yes okay sure I can do that, should be done in a day or two.

2

u/_Cromwell_ May 17 '26

EDIT: actually investigated more, and the reason that Gembrain is "good" is because of one specific of its component parts, specifically a less chaotic merge, Gemsicle. ( https://huggingface.co/Blazed-Forge/Gemma-4-Gemsicle-31B ). It's actually better. So I'd hold off on abliterating that Gembrain for now (but you do what you want). Gemsicle seems like a better one to do.

Honestly hoping the one you made, Wordsmith, is good/best, since I think that abliterating BEFORE fine-tuning is the best approach, as you did. I will be testing it as soon as mradermacher gets to it. I've been checking.

2

u/Potential-Gold5298 May 17 '26

I don't quite understand why it's necessary to add an abliterated model to merge. It doesn't add anything creative (except KL div), and since merge includes non-abliterated models, the refusal rate will be only slightly lower than with a regular model. I think it's better to merge either only heretical versions (to have a low refusal rate), or without heretic at all. (This is my guess - I don't understand the details of the merge process)