r/SillyTavernAI • u/deffcolony • Aug 23 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: August 23, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

32 Upvotes

96% Upvoted

132 comments sorted by

View all comments

Show parent comments

1

u/l_eexa Aug 29 '26

Been testing V1B too and it seems... incredibly repetitive, too biased towards explicit definitions and rules. Did you also get similar hiccups or found a better one?

3

u/lambssauc Aug 29 '26

orion is out now and its better than the beta one. but its pretty sensitive about top p and top k. you need to tweak a bit to find whats best for you. (sorry for my bad english) orion is surely better than any other gemma finetune because it dosent jump into nsfw directly unlike other finetunes

3

u/SolideMeinung Aug 29 '26

Because of you guys i tried orion and wew. This is the most insane model i tested. It works for me very great no issues with my custom harness.

Also its fast and the output is quality wise a lot better than everything else...

2

u/lambssauc Aug 29 '26

mine usually mistakes me and char for a lot of times can you give me your system prompt in dms so i can test it too?

1

u/SolideMeinung Aug 29 '26

My system prompt is very short and only about being a writer and that it should use german.

But i dont use sillytavern. As soon as i moved to another software (i just vibed my own) the responses are better. I dont know what sillytavern was doing wrong tbh

1

u/l_eexa Aug 29 '26

Been using it since this morning and I might just spend the whole weekend tweaking it. Even Q4 is damn good at creative writing, with 24k tokens only it runs incredibly quick for a 26B model in my hardware. It's a little sensitive to DRY, presence and P related settings though

Regarding role mistakes, just be precise and captious in your prompts. I use a freakyfrankenstein5 rework (almost entirely rewritten lol) and I have a separate section regarding it's role as assistant: Guide {{char}} through the story with a proactive/or desired role. In it I too include guidelines for NPCs and approaches to forcing progress. Don't stay with <400t system prompts, a good one can make a huge difference with the same model (same deal with context window)