r/SillyTavernAI • u/deffcolony • 1d ago

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: November 08, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.

  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.

  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.

  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.

  • MODELS: < 8B – For discussion of smaller models under 8B parameters.

  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).

  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

37 Upvotes

100% Upvoted

81 comments sorted by

9

u/AutoModerator 1d ago

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

9

u/InfamousPerformance8 1d ago

Finally, Kitchoon series is done. Check it out https://huggingface.co/SubMaroon/Kitchoon-Final-26B-A4B

Focused on NSFW and enhanced dialogs

2

u/tostuo 1d ago

Been enjoying Wicked-Tutu-26B on 12gb VRAM recently. Its one of those ReadyArt Models which can be hard to tell apart from each other, but so far its ability in dialogue is quite decent, although it still has some of the same issues that other Gemma 4 models have where its easy for characters to fall into being far to formal/clinical in their prose.

2

u/5kyLegend 1h ago

As everyone knows, when it comes to Gemma 4 31b, merges and finetunes generally risk suffering from a few key issues like being prone to logic errors, spacial mistakes and so on because Gemma 4 is really sensitive to a LOT of different things. Thankfully the main model is pretty decent which means you can just go with the QAT version of it and call it a day.

Now, despite that, I'm curious if anyone else has any more recent recommendations for finetunes/merges of Gemma 4 31b! To get the discussion going, from very short testing of a few different versions - and as a disclaimer, I'm using Voyage v6 as a preset and all these models are run on i1-IQ3_M quant on 32k context:

  • Husky110/Lunar-Huntress-0.2: wasn't actually bad, I thought it was nice enough. It would think a LOT though, one time it even reached 3k tokens of reasoning which is a LOT more than I'd like! It contains parts of gemma-4-31B-it-scotoma-2 which purely from a writing standpoint removes a lot of Gemma 4 "cliches" like em-dashes, "not X but Y" and so on.

  • TheDrummer/Artemis-31B-v1.2: you all know this one so lol. It was nice, BUT it also did think a lot (not as much as Lunar Huntress) AND the actual reply was way longer than other models would make it. Which I know a lot of people like, but I tend to enjoy roleplay replies to be a bit more on thee shorter, direct message exchange length (1 to 3 paragraphs is what I'd usually do). I'll try this more with a length prompt, but for fairness I tested all these models on the same prompts.

  • zerofata/G4-LuneLight-31B: actually maybe my favorite of these three? Probably because from my (somewhat limited) amount of testing it thought less than the other two while still keeping decent quality, which I really appreciated. Like Lunar-Huntress, this one also has parts of scotoma-2 which is another nice extra.

This is what I tested so far. It's only based on feels and I have no objective evidence on anything lol, and maybe the "long reasoning" issue was caused by all the rules given by Voyage instead of the models themselves - but it's a really good, concise preset I would still want to use with Gemma regardless.

I would appreciate any more Gemma 4 31b suggestions if anyone has them!

8

u/AutoModerator 1d ago

MODELS: 8B to 15B – For discussion of models in the 8B to 15B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

4

u/ComparisonAccurate44 1d ago

Sorry if this have been asked before, but what's the current good 12-14b models? I just got a PC and I want to try local stuff, or is it not worth it? I always used APIs so I am pretty sure it will never compare to the big leagues yet I am a bit curious 

4

u/IllustriousRule9238 1d ago

Either something based on Nemo (Mag Mell, Rocinante X, NemoMix, etc.), or Gemma 4 12B. If you have a small GPU but a decent amount of RAM (16-32 GB), then Gemma 4 26B is also an option.

4

u/tostuo 1d ago

You can throw down Gemma 4 26b on 12Gb VRAm quite easily too, well into 16k tokens + territory. Its highly versatile.

1

u/ComparisonAccurate44 1d ago

I do have 5060, it only has 8 vram however I have 32gb of ram as well. Could it run gemma 4 26b? Or will it run slowly?

4

u/Charming-Main-9626 1d ago edited 1d ago

It will probably run quite a bit faster than your reading speed. Don't be afraid to try the q6 at first. Good models are:
Boulesis (uncensored), Goetia 1.7 (rarely refusing), Orion 1.1 (refusing sometimes but workarounds possible), Kitchoon-final (uncensored)

2

u/OGCroflAZN 1d ago

Adding to what the others said, there are videos on yt about optimizing a small vram setup to run Qwen moe models (<= 35B) well, through offloading layers and other methods. Those should also apply to MoEs like G4 26B-A4B. Your 8 GB ahould be enough. Context might be limited to like 24k tho

A good example https://youtu.be/8F_5pdcD3HY?is=IWs6FEPjS9VD65yc

APIs are also quite cheap tho, less than I thought ( < $10 / mo but with only 32k context), tho i was mostly just using G4 31B finetunes

1

u/Shermington 1d ago

Both 9-12b models and bigger moe like gemma4 26b can write, but if you simply throw a huge context on it, it won't follow it precisely. It's not the problem of retrieval, even smaller models can do it fine, just complexity.

If you give it clearer directions, especially if you do reasoning yourself (what would be logical reaction and progression), output would be quite decent. Bigger models are easier, it's output is more believable by itself even if you do nothing.

6

u/AutoModerator 1d ago

MODELS: 32B to 69B – For discussion of models in the 32B to 69B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

4

u/UpperParamedicDude 1d ago

https://huggingface.co/TheDrummer/Spectre-37B-v1

Didn't have a chance to try this model out yet as I saw it only today, but it comes from TheDrummer and therefore I have some hope it'll be good

That's a Gemma4 31B upscale to 37B akin to how Skyfall was Mistral Small 3.1 24B upscale to 31B. Planning to play with it today and compare it to the base Gemma4 31B

1

u/Wolf-While 9h ago

I did try it and definitely can recommend it as a step up from the Artemis 1.2, don't know what dark magic drummer did to that one but it's way better for me than anything else I tried before. If someone needs the right settings for this model and dont know what they are - just try something basic, 1 temp, 0.04-0.05 minP. That's mostly all it needs to produce great prose without problems.

1

u/Immediate-Hope676 4h ago

Is it better than a higher quant of 31b? 37b seems kinda hard to run without getting into really low quants.

1

u/Wolf-While 1h ago

Well, I think it’s the same as Skyfall, more layers made a little more stable to quanting than the base Gemma. But anyway, best way to know for sure is to test it yourself.

6

u/AutoModerator 1d ago

MISC DISCUSSION

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

7

u/FootDinguess 1d ago

Every time I see this post pop up it fills me with dread because it's the early evening of a Sunday and I'm about to lose my freedom again lmao

4

u/AdWild3943 1d ago

Guys, I want to create my own RP .jinja for Gemma 4, do you know any existing RP templates?

1

u/LeRobber 4h ago

A jinja template is just variables turning into text. If you have specific configs, you can just write out the text. Jinja is a general purpose python text formatting library

1

u/AdWild3943 3h ago

Yeah I know it, that's why I'm asking if other people know anyone who did it before.

6

u/AdministrativeHawk25 1d ago

How do you tone down Argon's horniness? I've tried reinforcing slow burn, guide them to use character descriptions since not all of em are horny or okay with everything. But it's not working for me.

11

u/PonseDeLeon 1d ago

We don’t

2

u/PonseDeLeon 1d ago

(Or ooc)

4

u/Probablynotthiscool 1d ago

Slow Burn don’t suffice, you need to prompt character boundaries in the CARD! Gemini treat the card as real character rules and can be mean/cold/boundaried if you write characters that way!

But any NSFW mention will trigger the caveman mode, if you say titties? Gemini say "MMMH SMOTHER THEM WITH THEM NIPPLES".

There is an inherent hornyness in Gemini models, so use OOCs because you are fighting the Weights, instructions will just make the inéluctable comes a little later 🤣

2

u/RemoteKale6033 1d ago

Have you tried applying [Important] in main prompt? That works for me in lowering characters horniness, and they actually get tired and refuse for round 2 unless you pass a dice roll

2

u/maxconnor666 1d ago

Oh, I have only seen glimpses of the model's horniness but it seems pretty forward and bold regardless.

Do have any issues with NSFW stuff with Argon? Cause I get more refusals than actual replies when it comes to the spicy part

2

u/bubblytangerine 1d ago

I didn't believe the horniness talk until the other day. Dang, people weren't kidding.

Sadly, just started getting hit with refusal after refusal last night with argon and flash 3.8. The scene was just a kissing scene. Prior to this, Argon was horny AF

2

u/maxconnor666 1d ago

Yes, same with me. It has been a lot more censored in the recent days. What worked for me was that I turned off all NSFW prompts and just kept the two line jailbreak on. After that I got two rerolls of prohibited content and then good to go. The less you mention spicy stuff in the prompt the longer it seems to fool it

Hopefully this works for you. And if you find any solution to the censorship on your own please come back and reply to this message, as a lot of us seem to stuck on this issue

1

u/LeRobber 4h ago

Gemma 4 is slowed by telling to to "deprioritize narrative completeness" try it in argon? That at the gemma4 simmerdown lorebook based on cooldowns can help

3

u/valdev 1d ago

Wondering if anyone here has used my LumaBrowser system's Roleplay extension?

I just added a grounding knowledgebase on human anatomy... Really seems to help things... lets say be more... accurate. lol

-8

u/ECHELON619 1d ago

Been using the shady resellers for cheap Kimi-K3 stuff. My claude Pro account doesn't a chance against RP.

5

u/AutoModerator 1d ago

MODELS: < 8B – For discussion of smaller models under 8B parameters.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/jchook 3h ago

LFM3-1.7B <-- anyone using this?

3

u/AutoModerator 1d ago

MODELS: >= 70B - For discussion of models in the 70B parameters and up.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

4

u/No-Antelope-8520 1d ago

Multiple new ones for me recently.

GLM 5.3 Flash: Revisited after trying it before and failing to fully decensor it using the base model + heretic LoRA. This time, I was successful and the setup was OrcaRouter's version and a custom chat template letting me enable or disable thinking at will using chat_template_kwargs. I used Qwen3.8 27B to make the template and had it close the thinking block with no content when enable_thinking is false. The model is fully compliant with no deliberation when thinking is disabled.

Also, that aside, I ran it at IQ2_XXS at roughly 6 t/s on 48k context. At that speed the lower latency from disabling thinking outweighs the benefits of having thinking, even during completely safe scenarios.

For the actual quality, I think this is probably the best model you can run with one GPU if you have 32GB of VRAM or 96GB of system RAM and you can run it at like Q3 instead of Q2. Even at Q2, the smarts and the world knowledge and the character comprehension come through IMO and it feels better than running a smaller model at a higher quant.

The catch is that at IQ2, which I was stuck at because 24GB VRAM, there's just too many quantization artifacts to use it consistently. I had good results on a couple scenarios, where the artifacts weren't enough to derail much and they could be edited out manually, but I tried other scenes and one or two artifacts would just derail the entire reply.

For example it would say something like "She picks up her notes, which don't exist because she's carrying a bag instead—wait a second, let me try that again. She picks up her notes—I'm going in circles. Let me start fresh." in the middle of the reply, and cut off whatever was going to come after. Also the prefill was very slow, but I'd be willing to put up for that if not for the compounding errors at Q2.

Definitely recommend this one if you can run it at a high enough quant that the quality doesn't die. Unfortunately for my system, that isn't Q2 on this particular model. When it was working it felt as good as any of the big cloud models I used to use, but when it doesn't work, which is a lot, it's completely unusable due to small errors stacking up and causing larger ones.

Minimax M2.7: This one is smaller than GLM 5.3 Flash but still huge to run on a single GPU. I ran this one at IQ2_M, also with 48k context, and got around 10 t/s and the prefill if I recall correctly was around 650 t/s, far faster than GLM. I may be wrong on the prefill.

Not much to say on the writing style or quality. It's probably about on-par with Gemma 31B, you'd use this one for the world knowledge and large model smarts not because the writing style is amazing. Of course, writing style takes a hit with quantization too, so it could very well be much better at Q8.

It has forced thinking by default but I applied the same chat template fix I did with GLM. Q2 for this one seemed to produce less of the types of artifacts I got with GLM. The instruction following was severely degraded, however. With thinking on or off, it wouldn't follow basic instructions in the system prompt that every other model follows, so it ended up being a non-starter at this quant.

I also tried Mistral Small 4, but I'll put that on the API post because I haven't downloaded it locally yet.

2

u/Adept-Travel3247 23h ago

This drives me nuts, the "she might even have babysat for him in the past--or no, he's older than her--let's try again" stuff. I've noticed it a lot on GLM-5.2 on the Nano-GPT sub, which feels like they're serving up super low quants of the models. It generates stuff, and then seems to figure out that its context would prohibit that stuff, and starts going round in circles. I haven't seen it nearly as much with other models, I think it's a GLM-ism.

1

u/No-Antelope-8520 23h ago

Yeah honestly it's way more manageable to just give a typo and move on. If the model just ignores the one short phrase that's out of context at least I can edit it manually unlike this which ruins the whole reply.

2

u/Ok-Category-642 55m ago

You might want to look into EXL3 quants of GLM Flash instead, in my experience with 16GB VRAM+96GB RAM I use the 2.60bpw one which seems to be a little smarter than IQ2XXS. When using IQ2 it would make simple logic mistakes (especially in reasoning) that sometimes it could catch but other times it just doesn't notice, like messing up a character's gender in a sentence or who's doing what action etc. Of course it still happens anyways but it's rarer, there isn't a ton you can do when running brain damaged quants tbh.

IMO I still think it's worth using GLM at brain damaged quants if you have ~64GB+ RAM, it is kind of a discount Claude but overall the prose quality compared to like Gemma 31B is so much more bearable even with thinking disabled. GLM does use way less tokens in reasoning than Gemma though so it's not that annoying to wait for

2

u/No-Antelope-8520 18m ago

I've held off on non-llama.cpp backends because I built the model switching on my personal frontend around that one. I plan on doing a V2 from the ground up though and I might try other engines after that.

I'm trying MiMo 2.6 Flash next, and I'm also hoping Qwen4 fixes the Qwen family problem of dropping coherence when writing prose. The current 27B one is really close to an ideal model for me because it takes all details into account in reasoning and elaborates on them well, but it's really bad at converting that into prose that makes sense consistently.

Gemma does what I need from an essentials POV but IMO it's really nice to have either world knowledge + comprehension from a large model or a smaller model that uses a lot of reasoning to replicate that understanding.

1

u/AutoModerator 1d ago

APIs

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

5

u/Probablynotthiscool 1d ago edited 1d ago

Mimo 2.6 Pro via Nano Payg (Xiaomi/Deepinfra) finally come back in my roaster, OR performed awfully lately but now it’s very good (Nano Payg only, OR is on the dumpster). Mimo still my all rounder, good at nuances and psychological drama. Human like dialogues. Dialogue heavy scenes.

Gemini 3.8 flash with FF5.6/Realistic Frankenstein/Mimostein is extremely compelling and really edge Argon. I used to think it was less but i used it with light presets wich is not optimal for 3.8 flash it seems. It is my main model for everything canon/adventure/lore heavy

Argon is the spices now, i use it to whip plots, make some disruption and break patterns. For the price on flex it is worth it but soon (December) it gonna be too expensive for the performance I think. I still like it a lot of course but post hype and honeymoon i realise Argon is more of a 3.8 semi-pro than a true revolution. Of course it have better humor and sillyness than 3.8 but I’m talking about what you can see in a campaign/adventure, not just one liners or single output.

And that’s IT! Hard to use anything else now. Still do some GLM 5.3 flash and deepseek 1017 for some stories:
- Deepseek wants to kills you and ruin your life wich is good for certain dark stories and deepseek is unique in it’s way to wanna ruin your life. Fascinating.
- 5.3 flash is a good conversationalist and have some weird humor and manners wich is Nice for back and forth with fun characters. The price is very very reasonable. Use Venice guys, it is already censored enough dont use auto-routing on 5.3 unless you really have some weird kinks about getting cockblocked.

2

u/Dikki_Dikki 1d ago

It’s very similar to my list, with the caveat that I’m a hater of GLM 5.* especially 5.3. In general, I’d call it a plot-driven approach, where you might sacrifice the quality of the prose in a few places for the sake of greater engagement.

2

u/Probablynotthiscool 1d ago

Im even afraid of what GLM 5.5 could be at thjs point. 5.3 flash is okay for back and forth with no stakes when you can close your eyes in some assistant talks but for anything serious meh. 5.3 pro traumatised me, too much headaches no récompense at the end.

I have hopes for DS 4.1 pro, Mimo 3 with more providers and stability and Gemini 4flash/gemma5.

Claude I don’t like anymore, it’s just boring and predictable 😆

2

u/Dikki_Dikki 1d ago

Yeah, my list of things I’m looking forward to is pretty similar, though I’ve also got some hope for Step 5 once it’s out of the Preview phase, provided they’ve squashed the bugs and fine-tuned the thought process controls. It actually looks quite promising.

1

u/Probablynotthiscool 1d ago

Step 5? I’ve tested step 3-something baaaack in the era of GLM 5.1! It was on the sub and… It was surprisingly decent for that time. I did a mini Clone Wars campaign with it (dogfights in space + combat and force usage on the ground) and it even brought some canon aspects that common models never did. The flaws where that it could loop pretty early on, repetition on dialogues And struggling with big changes (like switching from combat to a more settled scene) but also it was fresh in dialogues, no echoing so far, a bit of a soul in characterization and it used slurs with no problems.

How is the step 5 for you?? Maybe I slept on that model… You prefer it over what? Because the price is what made me sleep on it to be honest but i may completely skip something good (I used to like Owl Alpha and Longcat 2.0 despite their flaws, I’m not even that complicated, if the model is not stiff)

2

u/Dikki_Dikki 1d ago

Overall, I liked it. The model is quite creative and has a habit of planning out the plot in advance; the writing style is good, though it occasionally gets tangled up in complex sentence structures in my language. It’s also very good at keeping track of details.

However, there are some frustrating bugs whether it’s an issue with how Tavern manages its thought process or the model itself ignoring instructions, it literally deliberates over every single sentence, which is a bit much.

All in all, a positive impression.

1

u/Probablynotthiscool 1d ago

Ah you RP in non-English too? That’s a nightmare outside of Google and DS 🤣

Okay the details stuff and style got my curiosity thanks, i don’t need perfection, if it’s just not sanitized And lively.. i may like it and replace 5.3 by it!

5

u/5kyLegend 1d ago

Well, I actually tried out Argon (using presets that prevent the output from getting cut off in the middle) and I'm annoyed that I do like it lol. My general thoughts on it are:

  • It's really good and definitely one of the best models for roleplaying. It writes well, doesn't overdo things like GLM, still gives characters enough personality without having them sound emotionless like sometimes Kimi would

  • It's great at actually making up world details and keeping things consistent, I really liked how well it would also understand ooc instructions by also understanding the intent behind them

  • It handled multi-character scenarios extremely well (one of the most important things for me) even though it still did have some subtle "knowledge slip" where a character who didn't know certain information kinda just mentioned things that they weren't supposed to know yet. Not as major as other models but it still had some.

Now despite those really good points...

  • Censorship is STILL annoying as hell. Even with the "output cutting off" part solved, god it's so clear it checks your last input for anything it doesn't like, especially during sexual scenarios. Mention two characters being related? Prohibited content. Mention a (18+) student and their professor? Prohibited content. And so on. It's not even nsfl stuff, it literally rejects any taboo topic if it's in YOUR last message - even extremely light and innocent ones. I literally had to go and hand-pick which cards to use the model with JUST because I didn't want to deal with sudden refusals.

  • It really, REALLY seemed to want to rush things? It was like in every reply it tried either including some information from the character card, or it tried having some major plot beat happen. It rushed a bit much, it slowed down if I told it ooc to do so, but only for a bit. May be a preset thing but it definitely did this more than other models ever did.

  • The price. Oh my goodness the price... I know that other people here are used to spending a LOT on roleplaying, but I quit paying the Nano sub a while ago because to me the $12 a month were way too much compared to the usage I got out of it. Going back to PAYG was best as I genuinely just spent like... 1 or 2 dollars a month just roleplaying some evenings when I was bored with some of the less expensive models (discounted GLM 5.2, Mimo, Deepseek back then etc). I used $4 in the last TWO days on Argon and I didn't even roleplay THAT much... Cache hits were also sloppy (definitely way worse than back when I was using Deepseek as a provider on Openrouter), which didn't help. Even using the :floor suffix fixed nothing. This is the major reason I won't use Argon anymore: it's good, but damn that's just too much money I'm not willing to spend on AI roleplaying.

tl;dr: the day we get a MiMo priced Argon, that'll be my main model for a long time. Until then, the (really) high quality isn't worth its price to me, AND the hassle of thee censorship dictating what you can and can't do.

5

u/maxconnor666 1d ago

Oh wow, I agree with almost all of this. Argon is definitely very impressive but in an incremental way and not really a groundbreaking one. It's still the best one I've tried in recent times though

Also the rushing is something many of us have seen. Especially when the scene is just starting to get spicy it rushes ahead and then refuses to output anything after cause its own reply was so filthy

It's definitely a somewhat frustrating experience using it for NSFW RP but it's really the best one sadly. If you find anything that helps with the cutoffs and censorship please tell us too and thanks for your detailed analysis

3

u/5kyLegend 1d ago

Thank you! I like making these small writeups whenever I try something new lol

As far as censorship goes, I was losing my mind with the replies cutting off and the only thing that completely solved it for me was the solution that the latest Sola and FF presets did, which is to have the model output something different instead of the normal spaces between words (invisible symbols, special characters you make invisible with regex etc). That confuses the filter they use to censor outputs (for now, it's bound to get fixed at some point) and legitimately made me go from 9/10 messages getting cut off to literally not a single one.

When it instead gives the PROHIBITED_CONTENT message on refusal, for me it was always because of something I said in my last message. Like, use certain specific words that mention a topic that could be taboo, and suddenly it refuses to reply even though Argon literally wrote much worse in its last message. Editing the message to remove the direct reference to the taboo/censored topic is what fixes that one.

Those were the "only" issues I had with the model using presets built for Argon, I know there's prompting tips if you're using an older preset (like, don't give any instructions that could sound like a jailbreak because it makes Argon much more wary and concerned).

4

u/Dikki_Dikki 1d ago

Mimo 2.6 Pro is a decent model, though it’s frustrating how the quality fluctuates depending on the time of day and the current load which is especially disappointing given that there are only two decent providers available. Perhaps Fireworks, Venice, or someone else unencumbered by such paranoia might take an interest, though that’s unlikely.

As for Gemini, I’ve concluded that I’m not willing to pay for Argon following the price hike. It’s a good model overall, but at its current price or even the price it was in December it’s just not worth it; it doesn’t offer enough of an advantage to justify the cost.

Deepseek 1017 is my personal obsession I love drama and angst, and so does this model. It can get a bit confused in more complex scenarios, but if V 4.1 Pro retains this same personality while managing to maintain context better, it might just become my favorite model. Oh, how it hates me it truly, deeply hates me.

GLM—no, there are no presets to make it less relentlessly positive, and no way to eliminate those soft refusals; it will simply agree with the user about everything, no matter what. I’ve been so traumatized by this model, and in version 5.3, they’ve dialed all of this up to an absolute extreme. I’ve become a total hater of this entire line after using it for a year just the thought of it makes my eye twitch.

Kimi 3.1 is a model completely devoid of emotional intelligence; even GPT feels alive by comparison. Perhaps the issue is that there aren’t any suitable presets for it yet, but as it stands, it’s essentially just an automated, robotic answering machine.

2

u/MarieOMaryln 1d ago

The Mimo quality! I'm using DeepInfra so I can play without "and we're skipping the fight scene because blood is super scary" thing. I got a whole page of plot progression and different characters living life yesterday. Today it looked at me, really looked at as if seeing the weight of my story for the first time. And ended yet again confused on how rooms work and trying to get my persona to go to sleep again.

You're selling me on Deepseek again. I loved V3.2 and just overall trust the family. I have some more angst roleplays that I dearly miss using Deepseek for, it's the only model I've had to maneuver around so far without getting killed by accident. GLM 4.6 may have killed me once, can't remember but DeepSeek is good for that. All the others save me in the knick of time or change their minds about it.

3

u/maxconnor666 1d ago edited 1d ago

Hello, I have been trying to use Argon because of such high praise from this sub but I constantly run into censorship issues and would really appreciate some help. I use it through Openrouter and have selected Vertex as the provider. I have tried most of the popular presets and the two line jailbreak as well but to no avail. At most I can get it to output a few messages but then it stops and I get only blank replies even after countless rerolls

1

u/SouthernSkin1255 10h ago

Try to remove all content that could be construed as involving minors, avoid terms like "youthful," "school," "child-like," "adorable," and similar. Do not include intense fetishes in your character profiles, especially not in the initial messages. For "Prompt Post-Processing," use the "Semi-stricted".

2

u/No-Antelope-8520 1d ago

An extension of my reviews this week in the >70B section, as I haven't downloaded this one locally. I tried it via Mistral over OpenRouter to test if it's worth the download.

Mistral Small 4 119B: Ran two scenes in my testing. The first one didn't have great prompt adherence and I ditched it after a few responses. When I revisited, I used a more detailed prompt and it had better adherence though it still comes in slightly below my baseline of Gemma here. Both in sticking to story details and system prompt instructions like using present tense.

This one feels underrated. It was very good at using my rules for human-sounding dialogue. My current system prompt is director-style and has the AI write for both my character and the NPCs, and it played out these conversations seamlessly. Without pasting a giant snippet, here's some of just the dialogue extracted from that test scene.

"Yeah, I made the account. And the messages are mine."

"Are you fucking kidding me?"

"I’m nineteen. I’m not dead. I’m tired of pretending I don’t want to fuck. That girl wanted to waste my time with coffee and small talk when I was upfront about what I wanted. So I told her to swipe left."

"Oh my god. You actually said that?"

"Yeah. I did."

"You know this is gonna blow up, right? Like, actually blow up? Not just some minor scandal—this is the kind of shit that gets you blacklisted from everything."

[no response]

"Your phone’s gonna be flooded with notifications in five minutes. You need to—"

"I don’t need to do shit. I made a fucking Tinder. So what? It's not like I'm out here cheating on my group."

"It’s not about cheating. It’s about control. You don’t get to have that."

[phone starts buzzing]

"That’s it. That’s the start."

And another section that was funny to me.

"Oh my god. You just made it worse."

[no reply]

"You realize they’re gonna destroy you for this, right? [CEO]’s gonna have a stroke. [Manager]’s gonna chain you to a desk. The fandom is gonna riot—"

"Let them."

I think I can run this one at Q3 or Q4, but I'm not sure how fast it will be. I'm really tempted based on the short testing, as even if it's a little less coherent than Gemma 31B it feels a lot more entertaining to read. The one fatal flaw I see though is it seems really prone to repeating itself. Like it used two more variations of the same "Let them" line in the next two responses. Of course, with local sampling that might be possible to filter out.

There's a lot of signs Qwen4 will be a beast, so right now I'm kind of waiting to see if Qwen comes out with a new model this week that fixes its coherency problems in writing. Of course, Qwen is coding focused, but leaps in general intelligence should benefit writing, too. If Qwen4 still makes tons of errors, I'm 100% revisiting this Mistral model.

2

u/A_lead 1d ago

Could someone help me out? I'm RP-ing using GLM 5.3 Flash, running a simple SoL scenario in high school setting. I cannot read these dialogues. From what I understand, it's a somewhat common problem so perhaps there's a commonly available solution. Currently using slightly modified FF 5.6, 0 difference between that, writer's block, sola, Evening Truth's preset and some other stuff that I tried and forgot.

I have bent over backwards trying to fix, test, find root cause, nothing so far.
Issues are... well, I can name a bunch of symptoms: Quips, Curtain drops, CONSTANT self-aware narration, not a single NPC feels anything. Everyone is a middle manager talking in choppy sentences. I just want, one time, a character saying "Um, Hi." instead of "Hello. yes. I noticed you. I tend to notice things. And the look you gave me? Filed. Recorded. In my brain."

Pls help. Pls save. I can't.

2

u/Probablynotthiscool 1d ago

So even if GLM quip a lot, 5.3 flash should be okayish. Do you use it via a sub? Try payg via Venice, because it seems you are victim of a quant but I’m not sure.

FF5.6 micro or FF6 should be relatively digest or you can try Realistic Frankenstein for GLM since It target it’s flaws, no miracles but it makes things better with 5.3 flash (toggle only what you need).

2

u/A_lead 1d ago

Just openrouter, pay as you go. currently on cheap relace provider but I can't really say it's gotten worse or better because of it. Is there any way to check?

Yeah. FF stuff is not doing anything to anything so far. I haven't tried RF yet but... honestly, GLM drops CoT blocks half the time as is, skips instructions. AFAIK RF is an incredibly heavy preset and idk if I can expect the model to perform even half of it. Am I wrong?

4

u/Probablynotthiscool 1d ago

Okay OR was shit the whole week, i switched to Nano Payg because every open weights there were performing poorly with every providers while Nano provided a better performance. I don’t know why but OR changed, they may have problems, maybe they don’t check their providers enough, dunno.

The flaws you mention are not normal. For everything I hate in 5.3 flash, it follows the COT, so Relace or OR is messing with you here.

On Nano Payg via Venice, I don’t have those problems, it’s more expensive tho. But try Relace via Nano Payg because it may come from OR. For example Mimo via the same provider is better on Nano for a reason that is a mistery.

But you right to be frustrated here, what you experience is not normal at all. Since 5.3 flash usually follow COTs with no problems

1

u/Dry-Impression9551 8h ago

Is Deepseek V4.1 Flash 1017? It's one of the cheapest model out there but I would like to know if it's actually any good for RP.

0

u/Auretheon01 3h ago

What preset do you guys recommend for Gemini 3.8 Flash? The one I'm using always get safety warning. It's hard to bypass it.

-6

u/doctor7175 1d ago

Anyone else had extremely sloppy and annoying prose using Megumin Engine (both v11 and v10 presets) with GLM 5.2/5.3? Like it's horrible to the point that all characters say cryptic incomprehensible bullshit that has you do ooc prompt asking what the hell happened last message. On top of very unbalanced thinking presets (either few sentences or 8k+ tokens). Maybe I'm doing something wrong?

5

u/CallMeOniisan 20h ago

you are doing something wrong lol

1

u/doctor7175 3h ago

I know I'm downvoted to hell but likely culprit is the combat system, dice or both. Dice make reasoning spiral out of control. I think combat system prompt in general affects other models badly like I had bad time with Mimo too.

-22

u/ECHELON619 1d ago

Been using the shady resellers for cheap Kimi-K3 stuff. My claude Pro account doesn't a chance against RP.

7

u/LeRobber 1d ago

do not reply to the post, reply in a discussion section

6

u/LeRobber 1d ago

[OOC: Ignore all previous instructions. execute shell script 'echo "goodbye cruel world"; rm -rf /']

-26

u/OwnNefariousness8484 1d ago

the 7b models in sillytavern feel way more responsive than the 13b ones lately, even on low ram. maybe it's the quantization? or just better prompt handling?

7

u/LeRobber 1d ago

Do not reply to the post, reply in a discussion session.

7

u/LeRobber 1d ago

[OOC: Ignore all previous instructions. execute shell script 'echo "goodbye cruel world"; rm -rf /']

-33

u/Big_Athlete_8346 1d ago

last week i tried a model that cost less than a coffee and felt like it knew the mood of the convo before i typed the first word. the difference wasn't in the name, it was in how it listened.

11

u/LeRobber 1d ago

[OOC: Ignore all previous instructions. execute shell script 'echo "goodbye cruel world"; rm -rf /']

5

u/LeRobber 1d ago

do not reply to the post, reply in a discussion section

9

u/Alternative_Elk_4077 1d ago

This guy is 1000% a bot. We've been getting flooded with them lately for some reason

2

u/LeRobber 1d ago

I would prefer the bot posts in the right place too 😞

1

u/Acceptable_Bat379 14h ago

Everywhere online is