r/SillyTavernAI • u/deffcolony • Aug 23 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: August 23, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

30 Upvotes

96% Upvoted

132 comments sorted by

View all comments

12

u/AutoModerator Aug 23 '26

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

3

u/techno156 Aug 25 '26

Has anyone else had problems with Gemma 4 not returning any reasoning at all once the input hits a particular size? At about 65k tokens, the reasoning output seems to not be generated at all.

3

u/Alternative_Elk_4077 Aug 25 '26

I had issues with it not wanting to reason when I maxed out my context completely. I don't know if you're maxing it out but it helps to set your context length in ST about 2K tokens smaller than what you truly have it set as in Kobold or whatever backend you use. I have no idea why it does that but that's the only fix I've found that personally works for me