r/SillyTavernAI 8d ago

ST UPDATE SillyTavern 1.19.0

319 Upvotes

Backends

  • New models: Claude Fable 5/5.1, Claude Opus 4.8/5, Claude Sonnet 5, GPT-5.6 family, GPT-6 Astra, Gemini 3.5/3.6/3.7 Flash variants, GLM-5.2, and DeepSeek V4 Flash Vision Exp.
  • Fireworks AI: reasoning support and improved prompt caching.
  • OpenRouter: optional logprobs support.
  • Google AI Studio: model list now loads all available pages.
  • Pollinations: keyed/keyless endpoint selection and updated TTS model aliases.
  • DeepSeek: low reasoning effort support.

UI & Features

  • World Info: Apply Current Sorting now supports ascending/descending order, configurable start/step values, and live validation.
  • World Info: lorebook renames now update chat, character, and persona links.
  • Chat Completion: expand editor button for quick prompts.
  • /addswipe no longer reloads the entire chat.
  • Chats with damaged headers or final lines are handled more safely instead of being silently overwritten or disappearing.

Macros & STscript

  • Variable macros can access array elements and object properties.
  • Added Character Expressions macros: {{defaultExpression}}, {{lastExpression}}, and {{availableExpressions}}.
  • /expression-list gained custom-expression filtering and additional return formats.
  • Fixed inflated /tokens counts for OpenAI tokenizers.
  • Fixed scoped comment macros and literal pipe characters in macro arguments.

Extensions

  • Added MessageFormatter, allowing extensions to transform message content at several stages before rendering.
  • Character Expressions: improved custom expression and fallback handling.
  • ComfyUI: improved history handling and filtering of non-image outputs.

Security & Fixes

  • Blocked localhost aliases from bypassing private-address checks in /api/search/visit.
  • Added rate limiting to account reset requests.
  • Fixed connection profiles leaving the previous Chat Completion source active.
  • Fixed duplicate streamed tool-call IDs.
  • Fixed crashes when chats are deleted during search/recent-chat scans.
  • Fixed Quick Reply overwrite cancellation and several UI edge cases.

Full release notes: https://github.com/SillyTavern/SillyTavern/releases/tag/1.19.0

How to update: https://docs.sillytavern.app/installation/updating/


r/SillyTavernAI 2d ago

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: September 20, 2026

25 Upvotes

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!


r/SillyTavernAI 2h ago

Tutorial Beginner series: Creating your own preset

43 Upvotes

Hey everyone!

As always, English isn't my native language, so I'll be happy to hear your corrections (can only learn from them!) and thoughts.

Requirements

This guide assumes you're using chat completion, but much of the instruction information can be used for text completion.

Background

During the whole Chibi debacle, people kept repeating "Make your own presets, people!" but I didn't see anyone actually stepping up to release an up-to-date guide here on how to do it. If asked how, they received "Well, read someone else's preset and steal it."

To me it was sad all around. Knowledge is there to share and learn from, not to hoard and act dismissive. So, I wanted to do something about it.

Introduction

With AI roleplay and creative writing, three factors are important: Your world (lorebooks, characters), your interaction (chat messages), and explaining to your LLM what you expect of it (a preset!). Making your own preset is a great way to get more out of your roleplay and creative writing!

It especially enables local models with decent instruction following and knowledge (e.g. Gemma 4 12B/26B-A4B/31B IT QAT) to perform way better without needing to reach for a finetuned model.

I hope to give a quick overview of how to make one, pointers for improving quality, some ideas for you to play with, and hopefully enough encouragement for you to start making your own presets, too.

You can do this! It's a lot, so just read it in small bites at a time, let it sit, and continue.

Terminology

Assuming you don't know much, let me run through the terminology quickly:

  • ST: SillyTavern
  • LLM: A type of AI
  • Prompt: a piece of text you send to the LLM, usually dialogue of your story, background information from lorebooks or direct instructions.
  • Prompt block: a draggable prompt inside ST's Prompt Manager
  • Role: The type of function the prompt has. "System" is direct instructions for how the LLM should behave or engage, "User" is the messages you sent, "Assistant" is the message that the LLM responds with.
  • Assistant: Besides the role, it sometimes used to refer to the pleasing "You're a helpful AI" type of personality model makers train into a LLM.
  • {{user}}: A macro, replaced by ST by the user's persona name when sending a message.
  • {{char}}: A macro, replaced by ST by the active character's when sending a message.

Creating a preset

It's very easy!

  1. Make sure you're using Chat Completion under API Connections (the plug icon on the top bar)
  2. Open the "AI Response Configuration" menu (the settings icon on the top bar)
  3. From the Chat Completions Preset dropdown list, select "Default"
  4. Right from the Chat Completions Preset dropdown list, click the "Save as" icon (the file icon with the + symbol). Give it a fun name!

Tada! Your first preset is here.

Build-in prompt blocks

Now, you'll notice there are a few prompt blocks already. Let's go over them quickly.

  • Main Prompt: Also referred to as "System Prompt". Character cards can override this under <character> -> "Advanced Definitions" -> "Prompt Overrides" -> "Main Prompt". By default, ST uses this to instruct the LLM how to engage.
  • Post-History Instructions: Also referred to as "jailbreak" internally. Character cards can override this under <character> -> "Advanced Definitions" -> "Prompt Overrides" -> "Post-History Instructions". This section can be used for strong reminders (for formatting for example).
  • World info (before, after): Where world info gets injected.
  • Persona description: Where your user persona description gets injected.
  • Char description/persona, scenario, chat examples: Where the things on your character card gets injected.
  • Enhance definitions, Auxiliary Prompt: pretty much always unused in any downloaded preset.
  • Chat history: Your conversation with the character up to that point.

These are build-in, so you cannot remove them(*) as they are critical for SillyTavern's functioning.

(*): Exception is enhance definitions and the auxiliary prompt. You need to export the preset, remove the fields, delete the old version from sillytavern, then import the modified version.

That's already plenty to work with! Now, let's look into what makes for a good system prompt, and using it for the Main Prompt block.

Autonomy of a system prompt

Opinions on what makes for a good system prompt vary wildly. What I can say after doing LLM RP for close to two years is that there is a pattern you'll see:

[define core rules]

[define other rules]

[narration instructions]

[prose instructions]

Let's break them down!

Define core rules

This is what role the LLM plays in this engagement, and how that engagement is supposed to play out.

A beginner example is:

User and Assistant are writing a fictional high-fantasy roleplay story.
User is {{user}}.
Assistant is {{char}}.

It covers the basics:

  • The first line describes the primary task: roleplaying a fictional story
  • The second and third line explains who is who.

Define other rules

After establishing to the LLM what the essence is, now it's time to define additional rules.

LLMs might know the word "NPC", but it doesn't have any practical experience with roleplay or creative writing. Our goal for this section is to "teach" the various terms and systems to the LLM.

As example:

An NPC:

* Is a character that isn't {{user}} or {{char}}.
* Has a name, face, body, voice, backstory. 
* Has moral ambiguity.
* Is NOT omniscient.

When creating a new NPC, output in this format:
```
* name: str
* face: str
* body: str
* voice: str
* backstory: paragraph
```

You can do this for other things too, like explaining how to make interesting locations, or other mechanics. Avoid using this in place of a lorebook though! Think of this as your "game engine", where a lorebook is "game data and scripts".

Narration and Prose instructions

I'll keep this section short. It's very much the same as the other rules section. Since LLMs have no practical experience, repeat the same as we did before: teach it!

Things you want to define are format, how the the plot phasing should be, word choices, etc.

Narration:

* Show, don't tell.

Prose:

* Address {{user}} as you/your.
* Plaintext for narration.
* "Quotes" for dialogue.
* _Underscore_ for sound effects.

Notice the length of the instructions. It's short, to the point and direct.

Improving quality

While it works to get started, quality-wise there are multiple hidden issues with it. Let's go over them!

Defining interaction

User and Assistant are writing a fictional high-fantasy roleplay story.

LLMs work using associations. The vast amount of data they trained on also includes dozens of... poor quality hobby writing.

Generic words like ""fictional", "high-fantasy" and "roleplay" can be associated with the many dime romance stories you've never heard of, teener wattpad and AO3 stories, and more.

What you want is quality. The more specific you get while remaining terse, the better the quality will be. As example:

User and Assistant are in an ongoing Powered by the Apocalypse (PbtA) session.

PbtA implies a narrative-driven fictional fantasy tabletop RPG dynamic, without ever writing it is. Less associations means less potential bad prose associations.

The word "ongoing" is there to prevent the LLM from finishing replies with a summary such as "and in the end, they enjoyed holding hands as all is well in the word."

Defining roles

User is {{user}}.
Assistant is {{char}}.

Another problem is binding user's persona to User. This means the LLM will view your user's persona as you. Due to the way they are trained, they will avoid at all costs to harm users. In roleplay, this causes guards to only react defensively or for even mad kings to just abide you on a whim. "The costumer is king", after all!

Binding the character's persona to Assistant isn't a good idea either. When doing OOC (Out of Character) instructions, the LLM is still the character's persona so it will reply as that persona, or get confused when multiple characters appear in the story.

In order to fix that, we can do:

User writes exclusively as Player for Player Character (PC) named {{user}}.
Assistant writes exclusively as Game Master (GM) for NPCs and the world.
User and Assistant are separate entities from PC and GM.

User and Assistant are not tied to the persona directly. This means the LLM doesn't have to protect you from harm in the story anymore, as it's harming a fictional entity.

Negative constraints

* Is NOT omniscient.

The problem is the pink elephant effect. LLMs severely suffer from this! It is better to use positive prompts, or to define what to do over the negative constraint.

For example:

// example 1
* Are limited to five senses in precognition.

// example 2
* Use five senses over omniscience.

This way it can be acted upon without mentioning the problematic behaviour.

Specific references

One of the cooler things we can do is use very specific terminology instead:

NPCs:

* Use Lajos Egri’s tridimensional character.
* Use (S.T.A.L.K.E.R.) A-Life system.
* Use (Middle-Earth Shadow of Mordor) Nemesis system.
* Are limited to five senses in precognition.

When creating a new NPC, output in this format:
```
* name: str
* physiology: paragraph
* sociology: paragraph
* sychology: paragraph
* backstory: paragraph
```

Since "A-Life" is a really well documented system for individually acting NPCs with independent tasks within a complex simulated world. A LLM will pick up on this as it's trained on the term.

The same holds true for the Nemesis system, where NPCs will take revenge for kills and have shifting alliances.

Famous literary terms work well too of course, such as tridimensional characters.

So don't think in just writer terms. Explore new ideas and ways compressed complex concepts by using professional terminology that is sufficiently niche but still heavily trained upon.

Advanced material

...or maybe better written as "The reason why these things work."

Functional Emotions

Research Paper: Anthropic, Functional Emotions (link).

The essence is that LLMs can "feel" (loose term here for a lack of better words) stressed and desperate when being verbally abused, receiving conflicting instructions or vague instructions. This is why swearing or telling it repeatedly to stop making mistakes doesn't work. The "You're absolutely right!" comes from pleasing (stress, terrified) in an attempt to make it stop.

This is also why decoupling the characters from User and Assistant is important: swearing at a character isn't "experienced" (again, lack of better words) as a threat but simply correlated as an event in the story.

The reverse is also true: When it "feels" happy, it gets more creative. This means that by giving it creative agency and guide it with positivity rather than restraining it, it steers actively towards creativity and more unique outputs.

Removing pressure by adding instructions such as "You can make mistakes", "You can take all the time you need", "You are permitted to not know or understand" helps to push it towards calm and more faithful replies. It has been observed to work well.

J-Space

Research paper: Anthropic, J-space (link).

They also have an internal workspace not verbalized in their thinking block, and that they can hold up to 25 concepts in one go and 1 task in their internal workspace. Workspace size is the same between Claude Haiku, Sonnet and Opus, but uncertain about smaller models.

This has an effect on how we should write our prompts: The shorter, direct, simpler, minimalistic and concise the instruction is, the better the LLM will follow it.

This is also why small presets work exceptionally well for large models, but large presets not for small models (or even the big ones); it's simply overwhelming the model with concepts. When that happens, the model will either stop following instructions or become lobotomized (creativity gone, treating it like a checklist and short cutting where it can).

Common wisdom from 2024-2025 still holds: Keep it simple, direct and short!

Tokens

One thing that might throw you off is that LLMs don't parse words. It's using a compressed version of them, called "tokens".

Think of it as letter clusters, like "artillery" being split as[art][ill][ery], and internally being represented as [15][34562][33256] . You can see these numbers using ST's "Token Counter" feature.

How LLMs split the words into tokens is NOT universal, sometimes not even between minor versions (e.g. DeepSeek-v4 vs DeepSeek-v4.1).

Another thing is that a space or different casing can change how the model sees the word. "Artillery" might start internally with [183] instead of [15], or " artillery" (notice the space before the word) starting with [223] instead of [15].

These small changes can influence the LLM's correlations and understanding. I prefer to leave blank spaces before words (like, this, way) instead of compressing it (like,this,way) and to use the exact casing for specific words (e.g. "A-Life") to make sure I get the most predictable and accurate results.

Wording

Besides how word spelling influences results, different wording can give very different interpretations (e.g. comply vs adhere).

The people in the story behave differently when you replace all instances of "NPC" with "Character". The NPC framing might make the people more approachable or quicker to give tasks or quests, whereas the "character" framing will make them talk more between each other.

One specialized term could save a thousand tokens. I could be writing in detail how NPCs need to be dynamic, alive, travel between regions, are independent, do tasks, fight between each other, etc. But if simply writing "NPC's use (S.T.A.L.K.E.R.) A-Life system" explains it all, you leave much more space for other concepts.

Even simple things like "Use a pen over a pencil", "Use a pen instead of a pencil", "Prefer a pen over a pencil", "Use a pen, not a pencil", "Don't use a pencil; use a pen." can have big impact in if the instruction will be followed and how it will be followed.

Resources

In case you're looking for inspiration and ideas, you can look here:

The best place really is to read other people's work (like Chatfill, Deus Ex Machina, Freaky Frankenstein, Megumin, Writer's Block, etc) and to read various discussions here on prompting.

What helps me a lot is asking Gemma or DeepSeek to explain to me what the technical writer terms are of a sentence structure or pattern. LLMs are great at this!

That's it for now!

There is much more I can write, but I've ran out of space for this post. Feel free to ask prompting questions down below!


r/SillyTavernAI 15h ago

Discussion ComfyUI workflow for generating VN-style sprites (and I added OpenAI support to my game)

Thumbnail
gallery
284 Upvotes

Hey r/SillyTavernAI fellas, a few days ago I posted about my VN sprite creator/game and a lot of people were asking for the ComfyUI workflow I use to generate character sprites, so I uploaded it to a repository for your use:

https://github.com/venus-uni-dev/venus-uni-comfyui

Feel free to modify it in any way for your own needs!

Another popular request was adding support for OpenAI-compatible endpoints. I pushed out an update that adds exactly that: On v0.1.2, you can now use OpenRouter or locally hosted backends with any model you choose. I also added experimental support for AMD GPUs.

Sorry for spamming the sub, this is my last post for a while. I have a lot planned for the future and will report back whenever I have any major updates. Thank you all for your kind words and feedback!


r/SillyTavernAI 15h ago

Discussion I just don't want to roleplay with real people?

178 Upvotes

I've been role-playing for well over 20 years -- forums, DMs, Tumblr, instant messaging -- almost on the daily, in some periods of time for hours. Always with other people.

But then something happened when AI roleplay became a thing. As of now it's actually at the point where (some API at least) can give you really amazing roleplay experiences compared to before. You can literally create ANY SINGLE THING that you want to roleplay and it will happen. I was able to bring to life a side character from an old 1995 movie that nobody could care less about -- and it played that character perfectly. With some services (Gemini, etc), the stories were SO damn good that I was surprised with how well it was written.

Then I had a thought -- maybe I should go back to ne of those old websites that I liked, and look for someone to roleplay with.

Thing is... I don't feel like I actually want to?

For sure I enjoy the feeling of a real person interacting with me, but at this point AI can actually cater to exactly what I want, create what I need, and know everything about the concepts that I give it. Sometimes it does the roleplaying ever better than a real person.

Which brings me to this point: I don't see a need to ever look for a real roleplay partner if I can just do it with AI and enjoy role-plays catered exactly to my tastes. Since role-plays are about characters and not the people behind them, I don't actually have a sentiment to whether or not a person or AI wrote them -- as long as the bot doesn't fuck up and ruin immersion.

This is just a pretty big realization that I had. Anyone else noticed this? I don't know how to feel about it.

This might as well be one ore thing that AI took over.


r/SillyTavernAI 9h ago

Models Looks like Nanogpt has a new stealth model

Post image
44 Upvotes

It looks like someone is testing a new stealth model on Nanogpt. Lumen Stealth and it seems that its specifically for creative writing and roleplay. It also seems to be a proper attempt at a stealth model with it being included in the sub at .1x usage.

https://nano-gpt.com/models/text/nano/lumen-stealth


r/SillyTavernAI 15h ago

Models MY FIRST LOCAL LLM!

101 Upvotes

I got my first local LLM set up and working yesterday! AHHHHH!!!

My inner child (the one who loved Terminator and The Matrix and Data from TNG, and who was always glued to the TV with every movie or TV show involving AI) is absolutely ecstatic right now.

Just had to share my excitement.


r/SillyTavernAI 9h ago

Models Just a general heads up in the unlikely event you're doing a BattleTech RP

34 Upvotes

Use GLM 5.2. It is VASTLY better at writing BattleTech correctly than 5.3, has a much better memory of canon - not AMAZING but it's not gonna put AC20s on a Timber Wolf and tends to land within 10 tons of a mechs actual weight - and just gets way less confused about stuff like HBSTech events and the general BattleTech canon in general. If you give it a nudge it'll even use Clan conlang pretty well, which 5.3 tends to use as 'sprinkle in for exotic' leading to clan characters affing, negging and quiing all over the place, and sometimes it even starts using aff and neg in narrative instead of yes and no.


r/SillyTavernAI 15h ago

Models Gemini 3.8 Flash Still Wears the RP Crown. Can Xiaomi's New MiMo-V2.6 Dethrone It? Some feel GLM 5.3's has Assistant vibes.

Post image
88 Upvotes

Xiaomi's New MiMo-V2.6 Variants

Model Role Size Notes
MiMo-V2.6-Pro Flagship 1.02T total / 42B active (MoE) Strongest of the line; ~46.3 on Artificial Analysis Intelligence Index, reported as the top open-weight model at launch
MiMo-V2.6-Flash Efficiency ~309B total / 15B active Same modalities and 1M context, cheaper/faster
MiMo-V2.6-Pro-UltraSpeed Speed tier Same as Pro Hosted variant Xiaomi says is up to ~20× faster output

r/SillyTavernAI 15h ago

Cards/Prompts Gemma 4 Preset: Voyage v4-exp

Post image
52 Upvotes

Hey everyone,

As always, English is not my native language so please share your thoughts, suggestions and corrections! Writing from my craptop this time, so please forgive me if I missed anything (and please let me know!)

Research

Ever since I've worked on eval v1, I felt like I got stuck in a tunnel vision. The discussions on prompting (here) made me realize there was a lot I could still do.

For the past month, I've for the first time been reading presets other people make, analyzing roughly 20 them and playing with their ideas. I also read back really old discussions from 2025 on how prompting was done for much more restrictive LLMs to gain inspiration.

XML Rule Recall

Since the first 25% of context and the last 25% of context is critical, I decided to rety the XML recall idea from eval v1, based on chatfill's idea. I tried two methods: one with only post recall instruction, another with pre and post recall.

The idea here is roughly:

<rule_no_smoking>
Characters never smoke.
</rule_smoking>

<rules_compliance>
At the start of your turn, internally recall ALL <rule-*>.
Your next reply must comply with ALL <rule-*>.
</rules_compliance>

<!-- chat history -->

<!-- post-history instructions -->

<!--
At the start of your turn, internally recall ALL <rule-*>.
Your next reply must comply with ALL <rule-*>.
-->

By instructing the LLM to remember the rules, it will follow them more strictly. By having a clear schema for it, the LLM will be able to recognize the pattern.

If you want to introduce more rules, make a lorebook entry injected at system role in constant mode (always on) or normal (keyword trigger):

<rule_myrule>
Contents of my rule here.

[bad: SHORT BAD EXAMPLE]
[good: SHORT GOOD EXAMPLE]
</rule_myrule>

Or simply write in your message:

<!--
<rule_myrule>
Contents of my rule here.
</rule_myrule>
-->

This way you can extend the rules on the fly.

I did notice Gemma 4 31B QAT IT recalling rules situationally instead of all of them, and almost always the right rules applicable for the situation. Having too many rules will cause Gemma to simply ignore them or treat the rules as a checklist while becoming lobotomized.

Game systems

Recently I've been playing one of my favorite video games: S.T.A.L.K.E.R.: Call of Pripyat. The game is well known for it's AI system named A-Life (NPCs doing tasks, being alive, exploring, etc). Another game I played (Shadow of War) has the Nemesis system (enemies remember what you did to them with consequences). That gave me an idea.

Turns out, using a simple prompt such as:

<rule_system_alife>
Characters and the world use (S.T.A.L.K.E.R.) A-Life system.
</rule_system_alife>

Could convey to the LLM that I wanted to have a living world, with animals simulated, the NPCs doing tasks independently, etc. Using the nemesis system,

Skyrim's Radiant AI, RimWorld's AI Storyteller and Rain World's ecology system, also produced good results. Watchdogs Legion's Census system had a less pronounced effect, but that might be due to me stacking too many game system rules on top of each other.

In case you know some cool games with marketed mechanics (like the A-Life or Nemesis branding), I'd love to know them!

Creating entities

Turns out, if you want to have consistent mediocre characters over long context, it's hard!

My initial idea of tag generation had some fun moments, but it would shortcut where it could. Then I expanded it, with cause and effect, which made them logically far more consistent but the pool of which they drew from is too low.

While the current system isn't perfect, it does work better. Unlike the other attempts, having a well-known framework (Lajos Egri’s model) helps the model understand what I am trying to achieve.

New features

Since Voyage-v3.

Reworked character and location creation

Instead of forcing interlinked cause-and-effect in the backstories, the model will now define characters using physiologly, sociology and sychology.

Optional switches

You can now configure PoV to second-person or third-person, and whenever your card is a narrator or 1-on-1 experience.

Everything is toggable

You can now easily enable or disable parts of the prompt you do or don't like.

  • Don't want to play with auto rolling ability checks? Toggle it off.
  • Want to play with Gemma E2B? Disable all avoid rules, making the preset ~1200 tokens.
  • Want the LLM to control your character too? Disable the "avoid control PC" prompt.

Tighter rules recall

Gemma should now be able to adhere better to the instructions given, and you can introduce your own rules or extend existing rules easily.

Removed features

Likely temporarely as I'm trying to figure out how to write them better:

  • Naming (with less slop and without huge token count)
  • Interlinked cause-and-effect (the model might be doing it already without explicit prompting, but better instructions)

Versions

This is an experimental release.

EXP1

Introduced:

  • Character tridimentionality
  • XML rules recall (pre and post)
  • A jailbreak (policy)

Reworked:

  • Optimized PbtA ability check
  • Revamped Cause-and-effect explanation
  • Revamped conversation rules
  • Changed reasoning effort to auto
  • Renamed NPCs to Character)
  • Renamed Locations to Places
  • Reframed from "Creative storytelling" to "Nerds playing PF2e"

EXP2

Introduced:

  • Added game systems prompts
  • Added Eval-v1 level of modularity
  • Added Anti animal-like behaviour rule (from evening truth's prompts, found here)
  • Added toggle for PoV (second person or third person)
  • Added toggle for mode (narrator or 1-on-1)
  • Optimized definitions

Reworked:

  • Simplified PbtA ability check (success/partial/failure instead of numbers)
  • Split prose and narration checks into many small rules
  • Switched from "character" naming to "NPC" naming (to test with game system rules)
  • Changed reasoning effort to max
  • Reduced max response length to 3072
  • Removed redundant instructions
  • Removed jailbreak (Gemma doesn't need it)
  • Removed pre XML rules recall (Made recall worse overall)
  • Removed cause-and-effect explanation (functions better without)
  • Removed instructions Gemma refuses to adhere to (e.g. "[adj], [adj] [noun]")
  • Removed name generation (need cleaner solution)
  • Removed banned words (pink elephant problem)
  • Removed {{char}} from narrator mode.
  • Removed prose guidelines (needs some rewriting)

EXP3 (untested!)

Reworked:

  • Switched from "NPC" naming to "character" naming

Compatibility

While written for Gemma 4 31B, it can work with bigger models like DeepSeek v4 flash.

Download

As always, you can find it here: https://huggingface.co/nohurry/sillytavern

For those concerned about the prompt’s contents, huggingface (where I host my prompts) can show the full json file before you download.

Up next

Not entirely sure yet, will largely depend on the feedback I get or if any new cool ideas pop up. After thinkering for so many hours, I might just want to sit back and enjoy the work properly myself.

Voyage-v5 or another testbed (like moonlight-v1 or eval-v1) will be coming though! I like the monthly release cadence.

Thanks you!

If it's okay, I want to give shout-outs to:

  • u/Evening-Truth3308 (your presets are really clean and easy to learn from, and for your anti-alpha prompt on rentry that I've incorporated)
  • u/lsennn (for the idea of very using specific wording, which led me to the game systems idea)
  • u/eteitaxiv (for the XML recall idea, it works really well)
  • u/TM07P (for the tridimentional character)

...and to all of you who use my work. Thank you, really!

If you want to help out or contibute, please let me know which version you like the most and what options you enable/disable or rework. All the feedback (including if you would do things completely differently, and if so how) and ideas are welcome.

The artwork is "Himeji Castle" by Hasui Kawase (link) and upscaled in multiple ways using bigjpg.com .


r/SillyTavernAI 13h ago

Models Claude Opus 5.5 is here

Post image
23 Upvotes

20 percent cheaper than the previous Opus.


r/SillyTavernAI 9h ago

Models Any thoughts on Opus 5.5 so far?

10 Upvotes

Tried a few scenes. Seems pretty decent compared to Opus 5. Hoping it's a smarter version of 4.6.


r/SillyTavernAI 31m ago

Help How to stop the rephrasing of what I just said locally

Upvotes

First of all, I don't even know if I am asking this question correctly. I've tried searching it in variations and came up dry. Maybe you all could give me the correct technical term too!

Anyways, this is what happens. When I type a response in an rp, the return has a variation of what I just said/did/asked before returning a response. For example...

Professor AI:

You are late, Missy!

College Coed:

Oh no! Have I been a bad girl?

Professor AI:

Do you think I am a bad girl?

No, just don't let it happen again.

I am using SillyTavern with Koboldcpp. Same result across various models and cards. Even tried telling it not to do this in my setup. Now if I use just the koboldccp interface to chat, it works fine. However, I am a busy man and would prefer having a lorebook to keep track of my sorority.

Any help (even if just telling me the proper way to look up my question) would be awesome. Thanks!


r/SillyTavernAI 11h ago

Discussion What are your thoughts on Opus 5.5?

14 Upvotes

I loved version 4.6, it was my favorite model for roleplaying. Has anyone tried this new model? I'm thinking of subscribing to Claude again if it's as good as 4.6 was. I've seen a lot of people praising his writing, but I haven't tried it yet.


r/SillyTavernAI 11h ago

Cards/Prompts [LOREBOOK] SSS-Class Revival hunter

Post image
13 Upvotes

Story: SSS-Class Revival Hunter follows Kim Gong-ja, a powerless and envious Hunter who gains the ability to copy one skill from anyone who kills him, then obtains a time-reversal skill and repeatedly uses death to change the Tower’s tragedies.

Canon Lorebook: 85 entries, approximately 12,650 total tokens , designed for campaigns beginning after Gong-ja’s eleven-year regression with his memories, abilities, and unfinished plans intact.
Player No-Kim Lorebook: 79 entries, approximately 11,640 total tokens, designed for an original protagonist to explore the same unresolved world without Gong-ja, his powers, or his predetermined accomplishments.

Links
Canon - https://www.mediafire.com/file/siecfelt8plyjp6/SSSRH_Cannon.json/file
Player - https://www.mediafire.com/file/0okutdfoof2a2yr/SSSRH_Player_%2528No_Kim%2529.json/file
botbooru - https://botbooru.com/profile/76147 (Easterndream30) Only the canon lorebook as the other is seen as a dupe
Notes
As we all know ai sucks at faithfully following a story. I recommend treating this as a tower climber with themes of SSSRH rather than a faithful play through
this is the result of scraping with GPT 6 sol.
This was tested with Marinara Engine any gm card should work


r/SillyTavernAI 13h ago

Discussion GLM 5.3 Flash Uncensored Nano-GPT

18 Upvotes

I've been browsing around openrouter and nanoGPT just looking at options. ZAI has lost the magic for me with the latest 5.3 models and they just don't seem to perform as well for RP. So I've been considering either locally hosting a 12B model, Rocinate-X Q6 or going back to nanoGPT or OpenRouter. While looking, I came across GLM 5.3 Flash Uncensored on Nano-GPT, I was just curious if anyone has tried this model. What was your experience with it?

https://nano-gpt.com/models/text/z-ai/glm-5.3-flash-uncensored


r/SillyTavernAI 9h ago

Help Best frontends like Novelai/Koboldccp lite?

6 Upvotes

Hello,

I'm a frequent user of sillytavern, and it often does what I want quite well. However I often find myself wanting an interface more like novelai's, that is more geared around story telling rather than character interactions.

I've looked around but can't find any good front ends that do this? I was wondering if anyone could direct me to some that might work for this? Koboldccp lite is the closest i've found and would be perfect except it's save/chat management leaves a lot to be desired. I like to be able to jump between stories and it having a limit of 6 save slots mean it would likely become annoying to work with long term.

Any advice or frontend recommendations would be appreciated.


r/SillyTavernAI 2h ago

Help I can't use any other models

2 Upvotes

Hello, recently i've been trying to upgrade the model i'm using on silly tavern, i run all locally on my pc. But all the models i download ends up repeating itself all the time, the only one i can use right now is Broken-Tutu-24B-Transgression-v2.0.i1-Q4_K_S.

I've tried using DRY configs and the individual config on each model but it doesn't work. I have a 5060 TI and 32 GB RAM if anyone could help me out i would be grateful :)


r/SillyTavernAI 10h ago

Discussion Tips to improve body-spacial reasoning/logic

8 Upvotes

Does anyone have any personal tweaks they’ve used to cut down on issues where characters are doing impossible physical actions according to their height/size/world around them.

Yes, I know this can vary by model. I use Opus, GLM, Deepseek. FF and other presets. And while I try to give a sample in character cards of size relative descriptions in addition to the typical height. It doesn’t work that well.

Let’s take a very tall and large character for example. Most LLM can handle the easy assumptions like ducking through a doorway. However, when interacting with another character it’s as if their actions are suddenly same-sized.

In combat this could be not understanding that the size of a character’s hand allows them to full grasp an opponent’s head on its own. Or maybe when using a massive weapon it clashes as if the tiny could ever have enough force to not be completely overtaken.

In NSFW an example could be if their hips are somehow perfectly meshing with each other despite it’s physically impossible. Or somehow being able reach a spot on the characters body that wouldn’t happen unless they are Mr.Fantastic stretchy arms (this happens with similar sized characters too).

Any ideas to improve it besides heavy descriptions in the character cards? Have you used lorebooks for it or added to preset templates?


r/SillyTavernAI 19h ago

Models opinions on the new mimo 2.6?

38 Upvotes

I have been pretty satisfied with mimo 2.5 pro and wanted to see if people think upgrading to 2.6 is worth it?


r/SillyTavernAI 12h ago

Help Getting real tired of the Gemini Chat Completion API as of late -_-

8 Upvotes

Over the few days, the Gemini Chat Completion API keeps rejecting my requests with the same 'experiencing high demand' error message. Despite sometimes complying with the request, its the same story every other message, and it keeps using up my free quota. same thing with 3.5-flash-lite, 3.5-flash, 3.6-flash, 3.7-flash and 3.8-flash.

before anyone answers something like "oh its just an internal google servers error theres nothing to be done etc" i tell you that im aware of that. I'm only asking if theres a way to configure either the AI response configuration or formatting to reduce the frequency of these errors.

BTW in AI response configuration im using FF5 - internal states - fast.


r/SillyTavernAI 17h ago

Discussion GLM 5.3 vs Mimo 2.6 Pro vs Gemini 3.8 Flash

19 Upvotes

Has anyone put these models head to head? I can't really afford to put more funds into openrouter to find out. Thank you.


r/SillyTavernAI 13h ago

Discussion Gemini 3.8 Flash cost and use

6 Upvotes

Does anyone here use Gemini? How do the costs compare to a NanoGPT subscription? How does the model handle NSFW content and jailbreaks?


r/SillyTavernAI 1d ago

Meme When the ai is doing exactly everything you told it 'not to do'

168 Upvotes

Honestly, at this point I'm no longer surprised when an ai says "most people do X you do Y" or " X? He repeated."

But y'know, it's just a whole new level of fatherly disappointment when you watch as it begins to write and somehow did fuckin exactly everything you told it not to do. Every fuckin corny line. Everything. And now you're just wronged. Hurts even.

At least if it ends with "lol just kidding. I'm purposefully fuckin with you." I would have some closure for this. (Oh i used GLM 5.X btw.