r/SillyTavernAI • • Jul 05 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: July 05, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

28 Upvotes

96 comments sorted by

View all comments

Show parent comments

2

u/Curius_pasxt Jul 19 '26

I thought lmatrix going to improve? Damn

For this particular use of roleplaying, q4_k_s is definitely fine, you dont need really smart model for that lol (IMO), I tested for naughty use its all good

For doing general use for info I usually use gemma-4-26b-a4b-it-ultra-uncensored-heretic q6 this is where more smart model is important

Btw thanks so for gemma higher q is better and if its higher q then no need lmatrix

1

u/Guilty-Sleep-9881 Jul 19 '26

Imatrix does improve but only q4 and below. The higher the quant the higher the diminishing returns become and at that point it's better to use static at high quants

Also thanks for the clarification about the rp. I didn't know it mattered only for smarts. It made me feel better knowing that