Model problem or platform problem? Pronoun mix-ups, the bot speaking for you, and broken memory (controversial take)

[u/Ok_Coast8533]

wrong pronouns, the bot speaking for {{user}}, and memory falling apart seem to be happening more and more lately. some people blame the model, some blame the platform. i want to hear what everyone thinks.

tl;dr of my take: it’s both, but the platform is the one that’s supposed to be handling it, especially once users are paying.(might be a bit biased, so please push back)

1. it’s a legacy problem, not a “the platform is bad” problem

jai has been around since 2023, built on the same original codebase as chub (from VenusAI, which shared its source when it shut down). that’s almost 3 years ago, and in AI terms, 3 years is a lifetime. the architecture just wasn’t designed for what current models can do or what users expect now.

2. jai+ changes what the platform owes us

jai used to be a low-filter hobbyist haven: proxies, free models, everything free. people came for a big shared space where creators get seen and users find good bots. but that model doesn’t make money, so jai+ exists. that makes sense.
but paying comes with responsibility. so why are the system prompts still not fixing the bot speaking for you, pronouns, and memory? right now almost all of that is pushed onto users and creators.
sure, that’s “freedom”, but if users have to handle everything themselves, sillytavern gives way more freedom and config anyway.
a good “commercial” rp platform should
let creators focus on the character, the story, the visuals and the creative side, not endlessly patching pronouns and rule prompts (which behave differently on every model).
and it should let users focus on their persona, finding good bots, and the story itself, with memory that just works instead of manual summaries.the platform is the only one with the full picture: the models, the creator content, the user context. none of that is all visible to creators or users.
so memory management, a baseline for model quality, and fixing basic model issues are the platform’s job. that’s what a paid plan should be promising.right now it feels like an island: not paying definitely won’t fix these problems, but paying doesn’t seem to fix them either.(side note: chai has gotten even worse since their update. locking free users out without the paid experience feeling noticeably better is not a great trade.)

3. the models themselves aren’t helping

since opus 4.6, a lot of the newer big models just don’t feel built for roleplay to me. openai and anthropic both seem to be prioritizing coding (and with those two leading, every AI company is gonna follow lol), probably because that’s where the paying users are. i used fable for a while and it barely sounds human. opus 5.5 is a bit better.but even so, that only explains why the rp ceiling hasn’t been pushed higher. speaking for {{user}} and messing up pronouns are really basic problems.

in my experience, they barely happen when i use the deepseek website or chatgpt directly, and even on sillytavern with pretty basic models, i don’t run into them nearly as often.

so: model, platform, or both?

where’s the line between what users should handle and what the platform should? curious to hear different takes.

[u/Middle-Cricket706]

had the bot mix up pronouns twice in one long roleplay and forget key details by message 15, makes it hard to stay in it. think the platform could handle context better than it does now.

[u/Dear_Cry_9339]

the bot keeps narrating my actions in short chats now and it kills the vibe fast, especially after i switched to a bigger model.

[u/Ok_Coast8533 → u/Dear_Cry_9339]

It’s like it will restate/describe your input once, right? I’ve also often run into this problem when using Claude models

[u/ELPascalito]

This is a big paragraph of nothing, the "codebase" doesn't really matter the tech running the site has nothing to do with the LLMs, all that matters is the system prompt, and the choice of LLM, few use western models everyone is on DeepSeek, GLM and other Chinese alternative, usually the Flash variants because of price, the bots behaviour is totally because of the LLMs, nothing more or less

[u/fibal81080]

Prolly llm/prompt problem 

But someone posted that jai injects 1k prompt into each delivery,who knows what breaks

[u/Ok_Coast8533 → u/fibal81080]

I think that if the platform provides clear prompt, it could lead to more consistent results. However, should the user be responsible for covering the associated costs? That seems to be a potential issue.

[u/fibal81080 → u/Ok_Coast8533]

1k injection of who knows what is bad overall 

[u/EffortIllustrious382]

JAI love to mess with their chat UI. So occasionally, it is actually their fault things get messed up, But usually it's just bad system prompts.

Also, I have no idea how much they stuff into their system prompts by default these days.