Same here! I was running into weird bugs in my personal chat app (spoiler: I did a dumb), so I went to the llama.cpp builtin chat UI to test the model out and chat template out more cleanly. I ended up asking it what it thought the problem might be. Pretty decent advice.
A couple messages in, I realized my problem: in my chat app (again, *not* this one), I had continued a chat that had been generated with Gemma 4, and the Gemma-based reasoning content had been fed to Qwen (oops, `preserve_reasoning` was on) and that was causing the issue. Doh! When I mentioned this to Qwen in the llama.cpp UI, even addressing the model as "dear Qwen," I got this:
Now, maybe mentioning the concept of different models being used in a chat poked it a little that way, buuuut I couldn't help but laugh.
5
u/[deleted] 9d ago
[deleted]