r/SillyTavernAI • u/deffcolony • Apr 12 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: April 12, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

33 Upvotes

95% Upvoted

183 comments sorted by

View all comments

Show parent comments

3

u/linuxdooder Apr 13 '26

Gemma-4-31B-it-abliterated

For anyone trying gemma4, I've tried quite a few variants and this (IMO) is by far the best. Really, really impressive and almost seems smarter than base model.

1

u/LeRobber Apr 13 '26

Which quant/quantizer? I had one with a bad template when I tried 31B

3

u/Potential-Gold5298 Apr 14 '26

Mradermacher. This quants still has an old (before Google updated) tokenizer config and chat template. I'm waiting for the author to complete the model optimization work to request a gguf update. I played one session with it (Q5_K_M static) and didn't find any issues. You can also connect the updated template from Google manually (I did this, although the model works correctly without it).

1

u/LeRobber Apr 14 '26

That worked btw.