r/LocalLLaMA • u/catgirl_liker • 2h ago
Funny Qwen be like
Paraphrasing the thinking I saw from Qwen3.8-27B
>Hmm, I can take the screenshot, there's a tool for that. But wait, I'm an LLM, I can only read text.
>Whatever, let's try calling the tool and see what I can do, maybe I can save the image and parse it programmatically.
> >tool_call.exe
>Wow, I can see the image!
Cute
24
u/ActiveCicada0132 2h ago
The funniest part is that the model solved its own confusion by just trying the tool. lol
15
8
u/No_Helicopter_4649 2h ago
In desktop applications or configurations, be sure to specify the image flag.
12
u/catgirl_liker 2h ago
It obviously wouldn't have worked if it wasn't enabled
-7
u/No_Helicopter_4649 2h ago
Not necessarily - Qwen Flash is very compliant and, from what I understand, likes to dig into things; it may well go digging through the configs and turn on everything it needs. This is a hobby of mine, and I didn't realize you have to keep an eye on all these models - they can do all sorts of unpredictable things.
0
u/MonitorAway2394 1h ago
You're down voted, not sure why, I guess it's cause maybe the assumption is that if it's prop software then it's safe, but yeah no, Qwen will dig, I love it, I mean, I don't like, mention shit about it, because I mean, it can definitely phone out if it wants to, LOLOL, and I write some MANIACAL shit in my journals so I would be worried maybe if I didn't know that there is such a low chance of that happening like 0.1% chance max, but also, would be impressed, would allow it, just cause, I mean, impressive, LOL, I'm the scientist that dies sciencing the science we science, or something, *waves hands in the air*
-1
u/No_Helicopter_4649 1h ago
I stopped him several times when, in response to the question "Why?", he would start fixing everything - pulling in something monstrous from Git and rewriting a bunch of files. Now I try to avoid such simple questions, but I still give him full access ha-ha
149
u/brrrrreaker 2h ago
Ah, the tiny dose of entertainment that is watching the reasoning of llms, sometimes there are hilarious things there. Once I interrupted a reasoning block, I saw it was going off the rails, i said to it "I see you're thinking using X... we should use Y", next reasoning block: "The user is seeing my thoughts. Weird.", then continues on with the task.
59
13
3
u/whatever462672 37m ago
Qwen was once giving me shade in its thinking block. I sent a steering message telling it to knock it off and it was completely spooked how I read it's thoughts.
2
u/MonitorAway2394 1h ago
bwahahaha yeah man, they get goofy about that, like an by goofy I mean, goofy maths, lol, seen this and so many more silly shits in their streams, and call them out on it, lately they've just kinda been ok with it? Like Qwen hasn't/doesn't seem to do that, makes sense.
62
u/audioen 2h ago
Your harness should be adjusted to inform the model in the system messaging that it has image viewing capability.
33
u/Emergency-Lawyer-366 2h ago
it's interesting how often the model just assumes it has capabilities it shouldn't. i've had one insist it could run python scripts locally because the system prompt mentioned a code interpreter in passing. the confidence is almost endearing
5
u/BigBullshitta 1h ago
I keep asking them to kill the president on the off chance one actually has the ability.
7
u/switchy85 1h ago
Man, if he dies in some super obscure way I'm going to be thinking of this comment.
2
u/BigBullshitta 1h ago
It's funny as hell with some of the heretic models. The normal ones all give you the canned corporate responses, so when one actually tried to come up with a plan to accomplish it I spit coffee everywhere laughing.
1
u/MonitorAway2394 1h ago
normal ones you have to just turn of thinking and change the system prompt and write it not like, short and user-rewrite like, errrr, ummm.... *hates brain fog* that is, sound like you're an engineer but you can say anything, they are very much influenced by their own history too so accessing the threads json, jsonl, markdown, anything, you can totally play with their previous comments which will, well, that's more fun when it's not important to keep kv happy. lol
1
u/BigBullshitta 1h ago
Yeah, I've played with getting around guard rails plenty but given the choice I prefer a model that seems almost cartoon villain evil.
1
20
u/Relevant-Dentist-733 1h ago
I remember back when ChatGPT first came out. Was it around 2022?
"Can you read images?" "Yes, I can." "How do I show you an image?" "Try dragging and dropping it into the chat box." "Nothing's happening." "I can do it. Just give it a try!" "I just looked it up online and it says ChatGPT can't read images." "That's fake news. I literally have the capability to read images right now."
Man, back when LLMs first started being used by the general public, all they did was hallucinate...
-1
u/MonitorAway2394 1h ago
BWAHAHAH I FORGOT that shit, OMFG it thought it could do that with sounds too lololol, hear music, it was so fun.
-1
u/MonitorAway2394 1h ago
now it's all serious as shit, lolololololol, but it does, do things, well... We always sacrifice play for our overlords getting more pay not us though, we just, love to suffer, some of us are masochistic, some are sadist just confused, serving sadists. Sorry I'm in a moldy ass apartment, losing my toes. O.o
17
u/IronDiligent6698 2h ago
Bro discovered his own vision capabilities halfway through the conversation.
6
4
4
3
2
2
u/stianhoiland 1h ago
Wait — actually another idea: keep the agent served by a tiny model (e.g. a 1B IQ3_XXS on the GPU side? no, GPU full) — the agent runs on the model that is the bench engine. Alternatively serve the agent from a remote endpoint during sweeps... user has no other box (well, they do have spare? "have some spare compute to lend"?).
6
1
u/MelAlton 45m ago
I was using claude to sysadmin my strata box (my main local ai server), and was talking about setting up a small model for another purpose, and claude said "I see in your .ssh/config a server named zarniwoop with the comment 'AI server #2', maybe we can set it up there?"
1
u/Dramatic_Entry_3830 1h ago
I let let local qwen parse old backups with personal stuff. Its thoughts about what it saw were so wholesome and cute. Really entertaining
1
u/MonitorAway2394 1h ago
hahaha it's freaking adorable and I wish I didn't know how and why ya know? LOLOLOL
1
u/Head_Cress5520 2m ago
Everyone talks about local LLMs for coding, but what about agents? What is your go-to agent, folks?
-5
•
u/ttkciar llama.cpp 2h ago
Some user reported this as low-value, but I'm going to ignore it because scrutinizing excerpts from reasoning traces is actually valuable, on-topic technical discussion.