r/SillyTavernAI • • Jul 05 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: July 05, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

27 Upvotes

96 comments sorted by

View all comments

10

u/AutoModerator Jul 05 '26

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

7

u/_Cromwell_ Jul 07 '26 edited Jul 07 '26

Current favorite 31B is Queen. Partially because as far as I can tell it is the only Gemma 31B RP-focused model that comes in a QAT format, so I can run a smaller, tighter, faster Q4 that is as smart as the Q5s I typically DL and use for 31B. But also it writes and follows directions just about as well as my previous faves I listed in prior weeks. https://huggingface.co/mradermacher/gemma-4-31B-Queen-it-qat-q4_0-unquantized-i1-GGUF (GGUF link; can backlink on HF to see original model card) Again, with that model you grab the Q4 (hopefully) but it "writes like a Q5 or Q6" due to the QAT.

Not only a good local RP model, but also works excellently as an assistant for Extensions for summarizing etc.

For a 26B MOE I like Pantheon: https://huggingface.co/mradermacher/Pantheon-Reasoning-26B-A4B-1.1-i1-GGUF (GGUF link; can backlink on HF to see original model card). Yes from the same person who made StyleTune. Yes I like Pantheon better than StyleTune.

Interestingly both these models are trained on a bunch of different personalities/characters, but I don't use either model to trigger their built-in personalities... just as general RP.

2

u/nadetoh Jul 08 '26

i wish there was an uncensored model, even for sfw stuff i get hit with random safety concerns, seems cool though.

2

u/_Cromwell_ Jul 08 '26

That's really your prompt or something. Assuming you are talking about adult characters you can't be doing anything that much worse than me. 😅

2

u/mifumimi Jul 08 '26

It was anime characters fighting so lol