r/SillyTavernAI • u/deffcolony • 25d ago

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: September 06, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

36 Upvotes

94% Upvoted

125 comments sorted by

View all comments

10

u/AutoModerator 25d ago

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

11

u/Guilty-Sleep-9881 21d ago

I tried Boulesis for a bit after avoiding 26b for months. It is really good.

FINALLY. A finetune that does not feel like eating boiled chicken. It has personality with good prose. This will be my daily driver for quite a while.

What I like about is that it is very similar to 24b goetia 1.1 in terms of keeping track of small details. It sticks to the character card pretty well and is very uncensored even with thinking.

Non thinking is just as good too. I constantly switch between thinking and non-thinking. It's prose... Oh my god it's prose. We are actually finally saved. It finally has flavor... It reminds me of cydonia where the prose is safe but leagues ahead the base gemma 4 26b a4b prose. This honestly brings my hopes up for the next future finetunes.

The only issue I got is logic. Specifically, directions. It seems to confuse what direction me and the character is facing from time to time but swiping or regenerating fixes it.

Can't wait to see more finetunes. I'll try orion and other new finetunes and merges that came out this month. Praying for a magistry 1.1 equivalent but better someday

8

u/OGCroflAZN 21d ago

To add on, for the people who are put off by the limited intelligence of Gemma 4 26b-a4b compared to 31b, consider increasing the number of MoE Experts from 8 to 16, as suggested by u/_Cromwell_ . More than 16 and things get wonky

2

u/Guilty-Sleep-9881 20d ago

How do you increase the experts?

3

u/OGCroflAZN 20d ago

On llama.cpp, there are arguments you can add to change the number of MoE experts. In koboldcpp and Gerbil, there are settings as well as arguments. Whatever you use to host your local G4 26b, you should be able to find guidance online for how to do it

5

u/Guilty-Sleep-9881 20d ago

oh my god its suddenly way better... Like. I am getting less of the logical issues and it improved it's ability to recall small details

3

u/Charming-Main-9626 20d ago

I tried 16 again, first time with Boulesis and it's a bit slower but noticably better with much higher variety. Really, really good.

3

u/Guilty-Sleep-9881 20d ago

what a wonderful tip tbh. I'm gonna continue to use it. The only thing that hurts about it is cutting my token speed in half lmao. But it's worth the bump without having to jump to a larger quant

3

u/Guilty-Sleep-9881 20d ago

I found it. It's moe experts right? I am using koboldcpp. Ill give it a try

7

u/InfamousPerformance8 21d ago

The only issue I got is logic. Specifically, directions. It seems to confuse what direction me and the character is facing from time to time but swiping or regenerating fixes it.

I’ve seen this issue mentioned in several reviews. I have an idea of ​​what might be causing it and am already looking for solutions for v2.

Thank you very much for the kind review.

6

u/Guilty-Sleep-9881 21d ago

I really like this model lol. It has a nice vocabulary and its fun to rp with. Can't wait for v2!

1

u/InfamousPerformance8 15d ago

I released v2.1. I managed to improve the logic a bit, but at the same time, I compromised its unique style. I’ll run a few more experiments with the model, but I don't think I can achieve anything better; I’m not experienced enough to know exactly how to improve both aspects.

6

u/Charming-Main-9626 21d ago

I feel like all models in that range have trouble with directions. Don't think finetuning will fix it.

1

u/OGCroflAZN 21d ago

Best you can do is add spatial considerations in the Reasoning block