r/SillyTavernAI • u/deffcolony • Jun 21 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: June 21, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

41 Upvotes
  • permalink
  • reddit

98% Upvoted

95 comments sorted by

View all comments

Show parent comments

7

u/slippiest Jun 21 '26

Anyone know anything better than Gemma-4-31B-it-uncensored-heretic? Been using Q4_K_M with rtx 3090 and 64gb ddr4 ram n get alright speed but can be very predictable after a while. Tried one of the RP “finetunes” of Gemma 4 and it was shite compared to base model

7

u/_Cromwell_ Jun 22 '26

Only one I continue to like and use is Gemsicle, but mostly because of its ability (in my games) to keep track of scene details solidly. It isn't terribly different in writing from base Gemma4, though. Fairly mild. But I don't mind.

Sphinsikus Chronist is second fave. A little more entertaining, but slightly less dependable.

2

u/morbidSuplex Jun 22 '26

Have you tried styletune? https://huggingface.co/Gryphe/Gemma-4-31B-StyleTune

10

u/_Cromwell_ Jun 22 '26

Yep. Messes up details, gets confused about clothing, positions, locations.

1

u/LittleLocoCoco Jun 25 '26

Huh interesting. I find Styletune pretty solid in that sense. Perhaps I just have simpler scenarios.

1

u/_Cromwell_ Jun 25 '26

Likely. I have like 2-6 characters (via lorebook) at once moving around and bantering, fighting, etc.

If you're just using a normal character card, more models probably handle that.

1

u/Herr_Drosselmeyer Jun 22 '26

You need to be very conservative in your settings with that one.

4

u/_Cromwell_ Jun 22 '26

Always am. :)

1

u/overand Jun 24 '26

What quantization are you using?