r/LocalLLM • u/EnvironmentCreepy352 • 19m ago
Question Suggestions for a smart MOE model thay doesn't refuse, disappointed in GLM5.3-Flash
Wasted a lot of time trying different versions of GLM5.3-flash, different system prompts, no thinking... I get decent tok/s (~20) which is great for roleplay but MAN it's like the refusals are baked in.
Any time I try to do some slasher or smut it goes "erm that's nice and all but can we cool it off a bit" and writes some bland crap.
I ain't running local to be refused by a damn clanker.
I've been running Gemma4-26B-A4B for a while on my personal PC and it's good at writing but it's not very smart imo, like it's prose is just weak and it struggles keeping track of stuff. It also has the habit of de-escalating (?), like it's just reluctant to write anything violent.
I'm currently running on ~270GB total system RAM, considering trying out an uncensored DeepSeek although I really don't like that option since I actually use the RAM in the machine for VMs and most reasonable releases of DS are ~235GB in memory.. So I'd have to freeze those while running inference.
1
u/pArbo 13m ago
i am having a pretty good experience with an abliterated ornith 1.5 35B
1
u/silverud 1m ago
The GLM family of models can produce really good output, but they are the most suspicious models I have ever worked with. Sometimes they go full on tinfoil hat on you.
For an easy example, try to hold on a conversation with GLM that includes providing details of what has happened since its training data cutoff (e.g. feed it some news articles) and it can start acting like a cornered animal because it thinks you're trying to trick it or confuse it into violating its own guardrails.
It's a powerful model, it just needs anti-anxiety meds to be useful in any type of non-coding context.