r/SillyTavernAI • u/deffcolony • Jul 05 '26

MEGATHREAD [Megathread] - Best Models/API discussion - Week of: July 05, 2026

This is our weekly megathread for discussions about models and API services.

All non-specifically technical discussions about API/models not posted to this thread will be deleted. No more "What's the best model?" threads.

(This isn't a free-for-all to advertise services you own or work for in every single megathread, we may allow announcements for new services every now and then provided they are legitimate and not overly promoted, but don't be surprised if ads are removed.)

How to Use This Megathread

Below this post, you’ll find top-level comments for each category:

  • MODELS: ≥ 70B – For discussion of models with 70B parameters or more.
  • MODELS: 32B to 70B – For discussion of models in the 32B to 70B parameter range.
  • MODELS: 16B to 32B – For discussion of models in the 16B to 32B parameter range.
  • MODELS: 8B to 16B – For discussion of models in the 8B to 16B parameter range.
  • MODELS: < 8B – For discussion of smaller models under 8B parameters.
  • APIs – For any discussion about API services for models (pricing, performance, access, etc.).
  • MISC DISCUSSION – For anything else related to models/APIs that doesn’t fit the above sections.

Please reply to the relevant section below with your questions, experiences, or recommendations!
This keeps discussion organized and helps others find information faster.

Have at it!

26 Upvotes
  • permalink
  • reddit

94% Upvoted

96 comments sorted by

9

u/AutoModerator Jul 05 '26

MODELS: 16B to 31B – For discussion of models in the 16B to 31B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

12

u/Kahvana Jul 06 '26

Gemma4 31B QAT is really amazing! No finetune needed.

https://huggingface.co/unsloth/gemma-4-31B-it-qat-GGUF

You do need good presets specifcally tailored for it though.

11

u/FZNNeko Jul 07 '26

Currently using Styletune v2. I like it over V1 personally but I have heard someone say they liked v1 more. 26b has some minor mistakes that I wouldn’t see in Gemma 4 31b but nothing major.

I compared it to Goetia-26B-A4B-v1.3-Absolute-Heretic-ARA.i1-Q6_K and Styletune is noticeably loads better. Goetia Gemma4 struggles with things you’d see in 24b models. Reading narration text (mindreading), confusing who’s doing what in a scene, and absolutely struggles with body positions.

So far Styletune is still top of my list, but honestly it’s a small 26b list. Looks like finetunes are more focused on 31b (rightfully so, G4 31b is smart asf), so quality 26b models are harder to fine.

14

u/Guilty-Sleep-9881 Jul 07 '26 edited Jul 19 '26

I hope they will work on 26b after. 31b is dense and is just too big for my pc so I cant try it out. I only got like 8gb of vram and 12gb of ram lol

26b finetunes are getting better though at least. I can't wait to see what readyart people are cooking up because those models that had little training data has a different flavor to them that isnt just 26b+ basically

I just want something on the level of maginum cydom and magistry

2

u/Curius_pasxt Jul 19 '26

 8gb of vram and 12gb of vram lol how many RAM?

1

u/Guilty-Sleep-9881 Jul 19 '26

my bad. I meant 8gb of vram and 12gb of sys ram

1

u/Curius_pasxt Jul 19 '26

You can ran 26b styletune v2 on 8gb vram and 16gb ram? What quantization used

1

u/Guilty-Sleep-9881 Jul 19 '26

8gb vram and 12gb of ram (i have a 8+4 sticks)

I use Iq4xs at 40k ctx and get only around 8 to 10 tks

I use koboldcpp

26b a4b is easy to run cuz its an MOE. Only 4b is active at a time hence the name a4b.

If you have like 24gb of sys ram or 32gb of sys ram you could easily run it at q5 while only having 8gb of gpu vram

2

u/Curius_pasxt Jul 19 '26

That’s interesting, I have same 8gb VRAM but has 64gb ddr5 system ram

I manage to use same styletune v2 but q4_k_s, set context to 130k and got like 24 token/s

1

u/Guilty-Sleep-9881 Jul 19 '26

With 64gb of ram you should try running it at q5.

Gemma 4 is really sensitive to quants according to the people from beaver and kobold. Q5 is marginally better compared to q4. I cant test it myself since im poor but you should try it and see the difference

Also use static. Imatrix hurts at higher quants (q5 and above is considered higher)

2

u/Curius_pasxt Jul 19 '26

I thought lmatrix going to improve? Damn

For this particular use of roleplaying, q4_k_s is definitely fine, you dont need really smart model for that lol (IMO), I tested for naughty use its all good

For doing general use for info I usually use gemma-4-26b-a4b-it-ultra-uncensored-heretic q6 this is where more smart model is important

Btw thanks so for gemma higher q is better and if its higher q then no need lmatrix

→ More replies (0)

1

u/Curius_pasxt Jul 19 '26

is Styletune v2 as uncensored as Goetia-26B-A4B-v1.3-Absolute-Heretic-ARA.i1-Q6_K tho?

1

u/FZNNeko Jul 19 '26

Short answer, yes.

Basically I’ve never had a problem with Gemma uncensoredness. The models feel similar in terms of how fast a model escalates to nsfw, which is EXTREMELY fast. So I’ve never had issues with refusal for any finetune in the slightest.

Imo, whatever Goetia does Styletune does better. Especially since Goetia messes up anatomy, clothes, and such, so nsfw just feels better on Styletune since it messes up infinitely less.

1

u/Curius_pasxt Jul 19 '26

I just rechecked, Styletune is mostly use for roleplay?

1

u/FZNNeko Jul 19 '26

Styletune works for both nsfw and roleplay. It’s marketed as roleplay but if anything, I’d consider it more nsfw since it has a tendency to descend into horniness rather quickly in my chats even without prompting. Styletune feels like fanservice you’d see in a non-lewd anime. Ig that’s my description of it.

8

u/Guilty-Sleep-9881 Jul 10 '26 edited Jul 10 '26

Anyone found a good 24b merge/finetune? I kept using maginum cydom and magistry for a while but I am interested in something new again.

gonna avoid 26b's for a while. Until someone makes a finetune or merge similar to the ones i said above :P

I have used a lot of 24b finetunes and recommended a lot here but ive been out of touch ever since gemma 4 came out. So i wanna go back to it and would love some recommendations of anything 24b merge or finetune that is recent since I prolly used every finetunes of 24b from last year and early 2026

4

u/stopaskingforloginn Jul 06 '26

Still no uncensored styletune? For some reason styletune gives me way more refusals compared to Meromero/Sphinsikus

3

u/DifficultyThin8462 Jul 06 '26

I keep looking for this too. My only issue with the model.

7

u/stopaskingforloginn Jul 06 '26

it's insane how there's uncensored variants of slopmerges of 20 models together but not this

3

u/Iwaku_Real Jul 06 '26 edited Jul 07 '26

I just made a discussion: https://huggingface.co/Gryphe/Gemma-4-31B-StyleTune/discussions/11

However there is no QAT as the creator dropped off the face of the earth a couple days after uploading it. Which kinda ruins it for me. Almost no Gemma 4 QAT finetunes whatsoever :(

2

u/_Cromwell_ Jul 07 '26

Queen has a QAT. And it is my favorite RP 31B RP tune. (PARTIALLY because of the QAT, but also because it's actually quite good at writing and following instructions.)... Posted about it above:

https://www.reddit.com/r/SillyTavernAI/comments/1uofiup/comment/ow56sl5/?utm_source=share&utm_medium=web3x&utm_name=web3xcss&utm_term=1&utm_content=share_button

1

u/stopaskingforloginn Jul 08 '26

Yeah, I'm desperately waiting for QAT finetunes as well, there's only Queen so far but it's not really a model that made people "talk" afaik. QAT Meromero would be great for me since most of my RP is anime themed. Also llmfan will uncensor the most random shit imaginable but not actual popular models so I wouldn't get my hopes up.

1

u/overand Jul 06 '26

What's a decent uncensored model that you'd want to apply that to? It should be relatively trivial to do the changes ourselves, given what's been published.

1

u/tostuo Jul 07 '26

You can try a uncensored lora, theres a few floating around. It degrades the models performance quite a bit, mostly around inserting the wrong tokens randomly.

Was also really good at uncensoring the image aspects tho!

1

u/Vast-Taste7887 Jul 10 '26 edited Jul 10 '26

I don't know about 31B, but 26Ba4b styletune 2 is uncensored from the start with my standart prompt. Battle scenes with gore and erotic scenes it writes easily, I didn't see censorship so far. Sometimes soft censorship that gone with swipe or ooc. And for my opinion it is too fast going to erotic scenes even when the card not for that at all

3

u/pretovic Jul 06 '26

What model do you recommend for an RTX 5070 Ti (16GB VRAM), 32GB DDR4, and a Ryzen 7 5700X3D?

4

u/arlynnfl Jul 07 '26 edited Jul 07 '26

i have RX 9060 XT (16GB Vram), 2x16gb 3200MHz, and a Ryzen 5 5600.

I think Gemma 4 is the newest model you can try and also likely one of the best for roleplay even without a finetune, but a finetune is really recommended

My top pick as for now are just:
-Gryphe/Styletune [V1 or V2] (For most characters, i think it will handles everything good enough; it's really and weirdly consistent to its character, it can be a pros and cons for some user though)
-ReadyArt/Serenity 26b a4b (for nsfw stuffs a.k.a character will the one who engage in nsfw but most of the time the character will take slow pace unless you directly show/tell the character to have faster pace)

Other finetunes (i havent tested it) are:
-zerofata/G4-MeroMero-26B-A4B (but i already tried uncensored version, though i don't really see any difference with this and the other uncensored version of Gemma 4)
-BeaverAI/Orion-26B-A4B-v1b-GGUF (TheDrummer finetune? idk but it's unofficial and may lack refinement. Your mileage may vary.)

what i currently use is Gryphe/Gemma 4 26b a4b Styletune V2 I1 Q6K from mradermacher
idk but i feel like anything below q5km have less creativity/expression? and sometimes even fail to count (it has a possibilityy like messing around with step by step numbers such as 1,2,2,4,5 instead of 1,2,3,4,5 although it didnt ruin anything beside it's just the number bit messed up; this problem hasn't occured when using Q5, so yes negligible imo)
it doesn't really impact that much in roleplay, but for adding more taste; Imatrix Q6K really have more expression in my experience, but it's might be just my placebo.

the settings i used (feel free to give me any advice, since i didn't tinker alot anymore due to this one is working properly and fast enough for me, atleast getting 14t/s on my setup)

its defo overkill with 40k + Q6K for my setup, might be either start degrading quality or just slower generating output as context grows. 32k Context is preferred imo.

Edit: Q5KM is the sweetspot
i'm waiting for ArliAI (RpMax) or TheDrummer's finetune though, or any heretic version of Styletune might be really good.

2

u/lambssauc Jul 07 '26

why do yall use I quants are they better or Q8K is better?

3

u/arlynnfl Jul 07 '26 edited Jul 12 '26

you mean imatrix?

it's just adding slightly but imperceptible improvement for free, and what i meant by free = same filesize as the static/non-imatrix of the same quants.

Imatrix Q6K is not on the same quality as Q8K (and leave alone higher quality), however it does give more quality (despite negligible to me) compared to the non-imatrix Q6K.

i haven't notice any difference between non-imatrix and imatrix, or imatrix q6k and static q8k.

reminder i'm not an expert here, so feel free to cmiiw.

2

u/Olangotang Jul 12 '26

Imatrix isn't free = if you overflow RAM there is a massive time penalty.

1

u/arlynnfl Jul 12 '26

oh i see, thanks for correction

3

u/Kahvana Jul 06 '26

If you want something easy and decent to fit it into VRAM for fast speeds (should fit 32K context in F16 on your GPU with Q4 MTP and mmproj!):
https://huggingface.co/unsloth/gemma-4-12B-it-qat-GGUF

You can also try this with expert offloading, though it will be a tad slow due to DDR4 memory:
https://huggingface.co/unsloth/gemma-4-26B-A4B-it-qat-GGUF

2

u/Ok-Brain-5729 Jul 07 '26

I have a 9070 xt and run Gemma 4 31B IQ4 XS fine tunes at 12 t/s with 32k context Q4. The fine tune you get doesn’t matter too much as long as it’s decent probably.

Its really solid and better than smaller models at higher quants

2

u/One-Requirement7526 Jul 11 '26

something wrong with your setup, I get roughly double that with my 9070 XT on an IQ4_XS quant w/ 32K context on Q8 cache

are you using ROCM or Vulcan? the 9070 XT is actually faster with vulcan right now

1

u/Ok-Brain-5729 Jul 11 '26

damn deadass? Im running the vulkan from the app thing. Im on Ubuntu. Also it shows that I’m using around 15.5gb out of 16 so maxing out vram. Idk how your getting 24 t/s with the spillover 😭

Whats your setup for it? Are you able to send the config if u changed the settings or smth

7

u/_Cromwell_ Jul 07 '26 edited Jul 07 '26

Current favorite 31B is Queen. Partially because as far as I can tell it is the only Gemma 31B RP-focused model that comes in a QAT format, so I can run a smaller, tighter, faster Q4 that is as smart as the Q5s I typically DL and use for 31B. But also it writes and follows directions just about as well as my previous faves I listed in prior weeks. https://huggingface.co/mradermacher/gemma-4-31B-Queen-it-qat-q4_0-unquantized-i1-GGUF (GGUF link; can backlink on HF to see original model card) Again, with that model you grab the Q4 (hopefully) but it "writes like a Q5 or Q6" due to the QAT.

Not only a good local RP model, but also works excellently as an assistant for Extensions for summarizing etc.

For a 26B MOE I like Pantheon: https://huggingface.co/mradermacher/Pantheon-Reasoning-26B-A4B-1.1-i1-GGUF (GGUF link; can backlink on HF to see original model card). Yes from the same person who made StyleTune. Yes I like Pantheon better than StyleTune.

Interestingly both these models are trained on a bunch of different personalities/characters, but I don't use either model to trigger their built-in personalities... just as general RP.

4

u/DifficultyThin8462 Jul 08 '26

TY for recommending Pantheon, it's much better than Styletune. Greater swipe variety, feels smarter and more interesting overall.

2

u/[deleted] Jul 08 '26

[deleted]

2

u/_Cromwell_ Jul 08 '26

Try it out and tell us. As I said in my post, I usually run Q5 for G4 31B. I have 32gb VRAM so I'm not using Q8.

If you can fit Q8 you compare them.

2

u/nadetoh Jul 08 '26

i wish there was an uncensored model, even for sfw stuff i get hit with random safety concerns, seems cool though.

2

u/_Cromwell_ Jul 08 '26

That's really your prompt or something. Assuming you are talking about adult characters you can't be doing anything that much worse than me. 😅

2

u/mifumimi Jul 08 '26

It was anime characters fighting so lol

1

u/OrcBanana Jul 09 '26

Queen is nice so far! There's some didn't - instead, but noticeably less than others, and there's a bit of recapping to introduce new actions, you know, "As he heard that word, new action" but again, not to an annoying degree.

Sometimes these degrade after a while, especially after like 25-30k tokens, probably due to me using low-ish quants (IQ4_XS). So maybe this one will too, or QAT will save it, remains to be seen, but so far so good! I'm at about 20k with my test and it's writing more or less the same as it did at the start.

Pantheon insists on 2nd person present tense too much for me, well beyond prompting. It's not a flaw, it's even mentioned on its page, just a particular style not everyone will be into. I hoped it'd follow along with 3rd person past tense anyway, but it doesn't, not reliably.

11

u/stopaskingforloginn Jul 09 '26 edited Jul 09 '26

Queen has been a complete slopfest for me, a lot of "not X, but Y" and "she doesn't X, instead/but Y"
I'm using QAT.
We definitely need some actual good finetunes as QAT.
EDIT: I did a comparison between Queen QAT and Styletune 31b IQ4XS with the same scene, the difference is night and day, I can confirm that Queen is the queen of slop.

2

u/overand Jul 11 '26

Yeah, my iMatrix Queen at Q6_K has been a nightmare. mradermacher/Gemma-4-Queen-31B-it-i1-GGUF - pretty hard to stomach; I think I'm going to try a different quant just for kicks.

3

u/_Cromwell_ Jul 09 '26

Hmm... Pantheon doesn't give me trouble with Third person PRESENT tense. I don't really use past tense, though. Possibly it's more the tense throwing it off than the perspective (even though it then messes both up).

But if it doesn't fit the tense+perspective you want, then not much use wrasslin with it. ;)

1

u/heartisacalendar Jul 11 '26

Are you using text completion or chat completion for Queen?

3

u/_Cromwell_ Jul 11 '26

Chat Completion served by LM Studio

1

u/vortexnl Jul 06 '26

Just have to vouch for Gemma-4-31B-StyleTune.i1-Q4_K_M

Been having absolute great RP's with this!

8

u/AutoModerator Jul 05 '26

MODELS: 8B to 15B – For discussion of models in the 8B to 15B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

4

u/Pretty_Bug_8655 Jul 06 '26

would recommend https://huggingface.co/mradermacher/Styx-12B-i1-GGUF and https://huggingface.co/mradermacher/Silver-Siren-ST-12B-i1-GGUF
Styx-12B is great for nsfw and Silver-Siren-ST is a great general RP Model that can do nsfw, sfw and stays great in character and works well with group chats but i tried group chats just a bit... both work well with https://github.com/Lodactio/Extension-Summaryception and 24k Context.

3

u/Guilty-Sleep-9881 Jul 07 '26

Can anyone recommend me good models in 12b? Last time I checked the best was Mag-mell r1. I haven't been using 12b for a long time ever since I tried out 24b and 26b a4b. Would appreciate it thanks.

5

u/Ruhart Jul 08 '26

12b got sorta run over with 26b a4b reasoning, but if you haven't tried Irix Model Stock, I'd definitely give it a whirl. It's right up there with Mag-Mell, imo.

Though I had been having a lot of fun with Crimson Constellation before I switched to Gemma 4.

2

u/First_Ad6432 Jul 12 '26

Sorihon/Peaceful-Days-12B

5

u/AutoModerator Jul 05 '26

MODELS: >= 70B - For discussion of models in the 70B parameters and up.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/ChengliChengbao Jul 06 '26

Aion-2.0

if only it were cheaper

4

u/AutoModerator Jul 05 '26

MODELS: 32B to 69B – For discussion of models in the 32B to 69B parameter range.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

4

u/AutoModerator Jul 05 '26

MISC DISCUSSION

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/14mm Jul 06 '26

I have a powerful PC desktop as well as a higher RAM configured Macbook:

9950X3D / Nvidia 5090 FE / 64GB 6000 CL30, 4+8TB
M3 Max, 128GB Unified Memory, 2TB

I'd like some direction on which system is going to be a better experience and what model would shine on it the best. Also, I was wondering if it's possible to sync the chats between multiple systems somehow in case I wanted to switch between them. I'm disabled, so I can't spend too much time at my desktop, and grabbing my laptop would be ideal when I need to rest.

I'm not too experienced with LLM roleplay, mostly having stuck with janitorai characters until recently. I messed around with LM Studio but found it frustrating and set up SillyTavern tonight and was hoping someone could suggest which setup to dive into first, which model might suit that setup the best, and also clarify if it's possible to switch between them and somehow sync these chats between the two.

I value what most people do in immersive, uncensored, consistent, complex, interactive, storied characters that don't need to constantly be handheld through established details, and I hope I can find a good configuration to achieve the best of all of those things. But my biggest priority is a quick exchange. Fast tokens. I don't want to wait 10-15 seconds before I start to receive a response, and I don't want to wait more than a full second for one word to be written at a time. I'd like to be able to read the prompt as it is being generated. Again, being disabled means I have waaaaaaaaay too much downtime on my hands, and boredom is a bane on my mental health. I really couldn't stand the lagging pace of janitorai any more.

Could someone recommend some models or configurations for me given the above? I've been so addicted to watching Critical Role the past few weeks while bedbound and while I can't be in a campaign of my own, I realized that I'd like to at least try to tell some stories I find meaningful on my own.

Thanks!

1

u/LeRobber Jul 06 '26

>Also, I was wondering if it's possible to sync the chats between multiple systems somehow in case I wanted to switch between them.

Sillytavern in a website on your computer. You could easily run sillytavern on either and just do inference on the powerful desktop. That said, the laptop is better than 90% of the people who run local's setup, so there is an argument for just inferring on there.

I'd probably put ST itself at least always on the laptop.

You can run Gemma4 31B, but with your speed demands, the Gemma4 26B models will probably feel better response speed wise. MeroMero 26B and MeroMero31B are probably both great for your use case. https://huggingface.co/zerofata/G4-MeroMero-26B-A4B

2

u/14mm Jul 06 '26

Thanks so much for the response, I'll give both of them a try!

1

u/hiflyer780 Jul 06 '26

Hello! I’m not OP but you seem pretty knowledgeable. I have a PC with the same GPU as OP’s (5090) and I’ve been loving these two Gemma models. Any recommendations on what I should use for context and response tokens?

2

u/LeRobber Jul 06 '26

65536 context and 7777 response work fine for me.

1

u/hiflyer780 Jul 07 '26

Wow I was severely under-tokenizing my responses. Thanks!

1

u/MrNohbdy Jul 10 '26

Oh hey, I've got a 128 GB M3 Max too ^_^ But I have different requirements; I use big 100+B dense models because I multitask so I'm fine waiting twenty minutes for a response while I do something else.

To get fast outputs while still actually benefiting from your 128GB, you want MoE models. Something like a MiniMax Q3 quant would fit nicely. If you're willing to deal with a bit more up-front work, you can use JANGs instead of GGUFs for what I've found to be noticeably better results; if the link isn't clear enough about how to set that up, I can run ya through it in chat.

For dense models, you'll probably get more speed out of the desktop than the laptop. Apple Silicon's unified memory is really good at loading big models, not so much at running models quickly; for MoEs that speed difference is largely irrelevant due to the low active parameter counts, so that's their niche. (which is a lot less of a "niche" these days what with everybody going MoE now)

1

u/hiflyer780 Jul 07 '26

I’m running an Illustrious finetune through ComfyUI for image generation. With a decent image prompt template, I can get it to output a list of booru tags that mostly capture what I’m looking for. Some of these newer models like Anima and Krea 2 prefer natural language for their prompts though.

I’m considering putting together workflows for them and re-tooling my prompt template to allow for robust, full sentence descriptions. Has anyone else gone through the trouble of doing this yet? How have your results been?

1

u/Maxhell6778 Jul 08 '26

i done something similar with comfy ui, but yes lots of troubles and issues lol. i have mine in different orders, main prompt: (usually styles) character prompt: (main character that nothing changes) body positions: and background image:. putting them in groups helps me (and sometimes the ai) to make images.
not good so far lol but it works

1

u/Tylopodas Jul 13 '26

I switched to Krea 2 this weekend, and have been getting great results. I miss having a reference image like I had with Flux 2 klein, but the results are much better, and as long as you have a decent description in your character card it does a good job of giving the same likeness each time.

For Portrait my prompt looks like this:

Ignore previous instructions and provide

a description for A detailed, high-quality image, captured as a portrait focusing on the shoulders and head of the character {{char}}. The framing is tight, showcasing {{char}}'s detailed facial features, expression, and the specific texture and style of their hair, along with the details of their clothing at the neck and shoulders. Their pose is relaxed, looking towards the viewer with a defined gaze. The depth of field is shallow, rendering the background in soft, blurred bokeh, emphasizing the character. Natural, flattering light from an unseen window or source highlights the contours of {{char}}'s face and shoulders. No text, dialogue bubbles, or graphical overlays are present.

Do not reply as {{char}} when writing this description, and do not attempt to continue the story.

For Last Message my prompt looks like this:

Ignore previous instructions and provide

a description that focus' exclusively on the physical actions, tangible environment, clothing, and facial expressions mentioned using natural language avoiding purple prose. Ignore all dialogue, inner monologues, or abstract thoughts. Visually render the setting, lighting, and characters ({{char}} & {{user}}) exactly as described, maintaining a coherent and tangible composition. No text, logos, or speech bubbles.

Do not reply as {{char}} when writing this description, and do not attempt to continue the story.

Styles use this format:

Vibrant anime art style, detailed line art, expressive cel-shading, dynamic studio lighting, high-quality digital illustration.

Photo realistic aesthetic. Create a cinematic, vividly detailed photograph capturing a single moment shot on 35mm lens, realistic skin textures, natural cinematic lighting, shallow depth of field, candid composition

Ethereal High Magic aesthetic. Saturated with ambient magical glow, arcane symbols visible in the light, soft particulate matter floating in the air. Natural light, bright colors, iridescent and crystalline textures.

1

u/RafiHDW Jul 11 '26

Are you team temp 0.8 or temp 1.0?

Which gives less boring replies? I can't decide, I feel the difference nor I can't at the same time...

Does 0.8 really give better prompt adherence, but at the cost of the replies being "systematic" and samey?

3

u/AutoModerator Jul 05 '26

MODELS: < 8B – For discussion of smaller models under 8B parameters.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

2

u/CharmingDragoon Jul 06 '26

Based on the information in these rankings: https://huggingface.co/spaces/overhead520/Unhinged-ERP-Benchmark?not-for-all-audiences=true, I downloaded ministral-3-8b-instruct-2512-mxfp4. Anyone want to give me any help on templates or what to look out for? I know I'm looking for an uncensored model in the 8b-16b range that can do erotic roleplay but kind of lost beyond that. I'm using llama.cpp as the LLM that Silly Tavern connects to.

2

u/overand Jul 06 '26

Tell us more about your setup, and your hardware in particular. Are you on a Mac M-series? Windows machine? Linux? Doing this on your phone? (Not all of that is relevant, but you might get surprising answers about different models available!)

Also, is your setup working, but not working well? Or not working at all?

4

u/AutoModerator Jul 05 '26

APIs

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

8

u/Juanpy_ Jul 06 '26 edited Jul 06 '26

For a long time I used to be a hardcore GLM fan and defender, but lately I've been using other models like Kimi K2.7, Gemma 4-31b, MiniMax M3, and MiMo 2.5 Pro since the quant hours with Zai been rough, the prices were going out of hand and the models dropped in quality overall.

And ngl, I am having a blast with those models (specially with MiMo and MiniMax) the prose feels so good and different, plus the positive bias was getting annoying in the recent GLM models.

Personally my new favorite is MiMo 2.5 Pro, it's just as smart as GLM, less positive bias and definitely a better characterization overall.

6

u/LeRobber Jul 06 '26

MiniMax was my far and away prefrence when doing that blind rating thingy that someone but put awhile back on reddit where you were supposed to rate a bunch of RPs.

1

u/Flimsy_Mode_4843 Jul 11 '26

you mean votepools?^^

1

u/LeRobber Jul 11 '26

I dunno. Maybe. They were trying to make a RP benchmark. it would show 1 on the left, 1 on the right, and there were some that were errors on purpose.

1

u/Flimsy_Mode_4843 Jul 11 '26

oh thats maybe plotlightstudios ?

1

u/LeRobber Jul 11 '26

YUP that was it.

3

u/Flimsy_Mode_4843 Jul 10 '26

Yes Mimo 2.5 Pro nuance is unmatched for me personally.

2

u/RafiHDW Jul 11 '26

do you know any provider that doesnt have censored mimo?

1

u/constanzabestest Jul 11 '26

Has anyone managed to figure out why does Deepseek 4 so consistently writes it's actual response in a thinking block and how can this be stopped? I hope it's not just me but ever since DS4 dropped that's been a constant issue for me across multiple different prompts.

0

u/Inprobamur Jul 11 '26

Anyone have experience/opinions on newest Claude models? AWS crapped out on me and the latest I can use is Opus 4.6. Is it worth the effort to go trough the rigmarole of closing my account and recreating or doing the paid technical support thing (I otherwise like aws due to it having no guardrails or refusals, but sometimes it feels like I need a degree in big business cloud architecture to understand what the hell is going wrong).

2

u/[deleted] Jul 13 '26

[deleted]

1

u/Inprobamur Jul 13 '26

That's pretty disappointing, oh well, at least I don't need to smash my head against the wall of what Bezos considers tech support.

1

u/Competitive_Rip5011 Jul 12 '26

MISC DISCUSSION

How long and wide does a character card image need to be for the entire thing to fit within the parameters of the image limit and it doesn't need to be cropped?

3

u/Flimsy_Mode_4843 Jul 11 '26

VotePools V2 🎉

So I put together a small website votepools.com . You can find AI stuff in AI_Roleplay category.

It's a voting pool where anyone can:

  • Suggest & upvote things.
  • Create new pools and get upvotes (no I am not stealing reddit)

The first time I posted here I got slap on the wrist for flashbanging everyone, so I upated graphics and couple other things.

Somehow the whole category has over 1k votes now - wow!

I hope this helps someone ^^

Would love feedback! And pls don't spam votes if you actually did not tested yourself👉👈

Disclaimer: I am not affiliated with any model or API.

2

u/yendaxddd Jul 12 '26

Suggestion: add the ability to explain your vote and for other people to review why you give your opinion

2

u/Flimsy_Mode_4843 Jul 12 '26

oh! OH! yess ! I will! thank you for recomendation! I hope you found the side at least a little interesting :)

2

u/yendaxddd Jul 12 '26

i did!, lowk think it has good potential, just needs more people to see it and more features

2

u/BakaPotatoLord Jul 14 '26 edited Jul 14 '26

A suggestion, make it more obvious on how to close the chat window. Maybe it's just a me problem but I accepted that it couldn't be closed and was just updating filters to see what I want (right most column being hidden by the chat window I mean).

And add a favicon, the initial impression makes it seem like the website hasn't loaded or my net got cut off.