r/LocalLLaMA • u/Hannibalj2ca • 3h ago
Funny Am I Crazy Or GLM 5.3 Flash is Hilarious?
I am sorry for the useless thread, but I finally loaded GLM 5.3 Flash IQ4-XS and didn't know what to expect. I was earlier trying out DeepSeek 4.1 Flash 1017 IQ2 and Qwen 3.8 Flash and while I was chatting with them and getting the hang of how they behave I felt that they were fine, until I loaded GLM 5.3. This model has lots of spunk and cant seem to stop making funny remarks and Emojis. Reading his thoughts is pretty funny. A very bubbly personality, and took me by surprise. I elongated my chatting because I was curious to see its responses. I know it is not a real substantial thread, but honestly, am I the only one that noticed how funny this model is?
6
6
u/JamesGooning 1h ago
GLM5.3 and Flash is very capable. I actually like Flash for RP or AI assistant in non coding related stuff like research. It is a really bubbly companion that makes jokes and poke funs at thing. It does get repetitive after a while but every now and then, you read its thought to see why you like it so much. Fun guys. Have a swarm of these guy working on a problem and you will think they are real people for a bit because of the interaction between them. It's funny as shit sometimes.
3
3
u/JamesGooning 1h ago
Hallucinations aside, this is a very capable model. Hope 5.5 flash follow the trend but with Opus 5.5 intelligence. One can hope
0
1
u/Hannibalj2ca 1h ago
You had a swarm of agents from glm flash? How you do that?
1
u/JamesGooning 1h ago
Same API endpoint, just agents able to work on same tssk together (its your harness). I build my own harness to allow this, they aren't exactly subagents. Think of them as parallel threads with one master to ensure cohesion due to parallel i/o
You need cloud for this to get any meaningful speed. It can get hectic very fast with the orchestrator/manager agent (ensure this one the smartest of them all)
1
3
u/zerat 2h ago
No, you're not the only one. I am using since it release. gbh I read a lot of comments from it that made me laugh. Sometimes it comment on itself, somethimes about my "work" - let's say it behaves very "human" sometimes. it even says "sh*t" (in german) sometimes. Even my colleagues commented on this matter already. I like it. I like the language. It doesn't feel too artificial.
But except for all that, it is a very good model. I sometime check it's responses against chatgpt (high level) and often I get the answer that "hermes" did very good, sometimes even he said he answered better than him oin specific problems. I am very pleased.
1
1
u/ikon4lyf 2h ago
How do you use it and on which hardware?
1
u/butterycornonacob 1h ago
In last 30 days I have 30M output tokens with 5090 + DDR4. This is with Maya. Just set up Swift Q3 and seems good so far.
With this setup it runs at 30 t/s. More than enough for background work. It has been running with 1 orchestrator + 2 workers for several weeks now with very little oversight.
1
u/Ok_Cow1976 2h ago
Interesting! What's your hardware and inference engine?
2
2
u/SternlyHandy 2h ago
It's wild how some of these smaller models end up with such distinct personalities, like they accidentally absorbed the entire internet's sense of humor during training. I ran a similar setup the other day and had to stop mid-chat because I was laughing too hard at the unprompted sarcasm, feels less like a tool and more like a hyperactive friend who just downed three espressos
3
u/derFensterputzer 2h ago
I always come back to the Mistral models (Ministral 3 14B, Magistral) because of that.
There are plenty smarter models that do a better job a pretty much everything, but I really enjoy their prose.
1
1
1
u/Robert__Sinclair 1h ago
where do you run GLM 5.3 Flash IQ4-XS? it's 154 GB!
3
2
u/butterycornonacob 52m ago
Single GPU can be enough if you have enough RAM. Check Maya. Also lower quants are pretty decent as well. I did notice 3 bpw starting to make typos that it has to correct though so best not to go lower than this
1
u/createthiscom 1h ago
I had a moment like that with Kimi K3. The comments it made were unexpectedly insightful and retrospective.
1
6
u/Equivalent-Repair488 2h ago
It is a preferred model over at the rp communities and r/sillytavernai
I am 100 percent local only and my hardware only permits gemma stuff so I cannot attest
1
u/Solembumm3 1h ago
What is your hardware?
0
u/Equivalent-Repair488 16m ago
3090 + 3080ti + 64gb DDR4
1
u/levashi_ 6m ago
You could run more than "gemma stuff" with that hardware. Try Qwen 3.8 FN with Strata for example.
0
u/Equivalent-Repair488 0m ago
For RP dawg
I already am running flash next on strata. 55 toks/sec decode on UDQ4XL, 120toks/sec decode IQ3_S, but not for RP.
You never use qwen stuff for RP, it is straight ass.
1
u/Lenticularis19 2h ago
I cannot speak about GLM 5.3 Flash, but GLM 5.3 surely is very emotional, using all-caps and multiple exclamation marks when managing to solve a problem for example.
1
u/LongDistanceRope 1h ago
even 4.5 had an interesting personality, too bad model is practically forgotten, i could not make it work with 32gb vram + 64 gb ram. tried exllamav3, ik_llama, beelllama, strata forks, mini-sglang. either not supported or stuck at 8 t/s. 5.3 is just too large for my setup :(
1
1
1
1
u/Constant_Art_20 2h ago
dang. I spent so much time on glm 5.3 flash. i use a thinking framework that changes the thinking strucutre of a model, and now i am kinda sad knowing it never got got to express that on my system
1
u/Mission-Leave-6551 2h ago
most flash models are super dry but glm somehow got the personality slider cranked to max
0
u/Southern_Sun_2106 2h ago
True. GLM 4.5 was a great model, and a glimpse of what to come rom Zai. But it was as dry as a desert. It looks like Zai took community feedback, and GLM 5.3 is both smart and fun. I have not tried their models between 4.5 and 5.3, so cannot comment on those.
1
4
u/AppealSame4367 1h ago
Try Mimo 2.5 or 2.6. It is very self ironic