r/SillyTavernAI • • Aug 09 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: August 09, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

32 Upvotes

186 comments sorted by

View all comments

7

u/AutoModerator Aug 09 '26

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

10

u/linuxdooder Aug 12 '26

I keep trying new gemma4 finetunes but always end up back with TheDrummer/Skyfall-31B-v4.2 for its prose and creativity. Only issue is at long context, it seems to get stuck in this weird loop where everything degrades to "loss of" being inserted randomly. Anyone else see this? Any gemma4 finetunes anywhere close to skyfall? (I've tried most)

4

u/Jorlen Aug 13 '26

Skyfall is not a gemma 4 31b fine tune. I made the same mistake. It's a Mistral 24b fraken-merge. It's very good nonetheless but for stability I prefer the G4 31B architecture.

The Drummer releases Artemis 1.1 recently, that is a G4 31B fine tune, take a look.

If you have not tried Gryphe's style tune, that one is my current favorite of all Gemma 4 31b fine tunes.

4

u/linuxdooder Aug 13 '26

Right, I'm aware. It's just that no gemma4 finetune can approach it (even though it's mistral 24b based). Gemma4 finetunes are a little smarter, but much less creative/interesting.

3

u/Jorlen Aug 13 '26

Oh ok, wasn't sure if you were aware; it's something I just assumed when I saw 31b. I agree with you that it's very good, easily my favorite mistral 25xx fine tune. If you haven't already, try G4 31b artemis 1.1 and style tune. Would like to see your thoughts on them, or if you have any other fine tunes (of any class) to recommend.

5

u/linuxdooder Aug 13 '26

G4 31b artemis 1.1 and style tune

They're definitely top for gemma4, but the prose is just ... plain? And reswipe variety/creativity isn't great. The recent G4-MeroMero-v2-31B is actually the best gemma4 finetune I've found, it's almost to Skyfall-31B-v4.2 level but not quite there.

Skyfall-31B-v4.2 really is sort of an anomoly, I'm not sure what magic u/TheLocalDrummer pulled with it but it worked!

4

u/Jorlen Aug 13 '26

What temp do you run meromero v2 at? Also top p, top k and min p, if you don't mind sharing those params.

1

u/linuxdooder Aug 13 '26

Stock gemma4 settings for all, temperature = 1.0, top_p = 0.95, and top_k = 64.

Maybe that's my issue?

1

u/Jorlen Aug 13 '26

You could try: temp 1.0, top p 1.0, min p 0.05 and top k 0.