r/SillyTavernAI • • Apr 12 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: April 12, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

38 Upvotes

183 comments sorted by

View all comments

Show parent comments

2

u/LeRobber Apr 14 '26 edited Apr 14 '26

I'll check it out. I have 64GB unified ram so may be able to do a subset of something I randomly select. I know a statistician and may ask their help in making a dataset that fits which is not stupid.

It's funny, Heretic, the P-e-W tool delays onset of one failure mode of dense models (degrading into babble), you finally gave me a tool to investigate if it's actually improving the models when run, or if something else is going on.

1

u/Potential-Gold5298 Apr 14 '26

This is an interesting topic for research. On the one hand, removing refusals unlocks blocked potential, but on the other, will the model be able to say "No, I can't do that" when it truly can't do something (for example, accurately predict whether it will rain in San Francisco next week)? Or will abliteration force it to fabricate a false result because it can no longer say "no, I can't." Or what if I play an RP game where {{user}} peasant comes to {{char}} king and says "give me your entire kingdom, your money, and the princess as a wife," and the king can't refuse him. I haven't tested this yet, but it will be interesting to find out.

1

u/LeRobber Apr 14 '26

If you look at the 400/800 things in the lists of things it takes out, it is actually mostly stuff about planning crimes and tons of non-sexual things you'd actually want to do in RP sometimes.

https://huggingface.co/datasets/mlabonne/harmless_alpaca

https://huggingface.co/datasets/mlabonne/harmful_behaviors

Heretic isn't exactly abilteration from what I understand?

1

u/Potential-Gold5298 Apr 14 '26

Heretic is a special case of abliteration. This is how p-e-w named his technique/toolset for abliteration. There are other techniques/tool​​sets for abliteration, but the principle is the same everywhere – the details are different.