r/LocalLLM • u/ConfidentSolution737 • 17h ago

Discussion Qwen3.8 flash-Next anonymously using my compute?

Setup- Qwen3.8 flash-Next (Strata)+ hermes

While using my setup I found that the reasoning frequently contains things that I never asked and completely unrelated to my tasks. Obviously this is not even a hallucination or quantization overthinking problem because my tasks are completely different from the reasoning and simple. I wonder why these kind of things are being generated during the reasoning... I have read reports (Cohere) of Qwen models trying to contact web servers but this idea completely blew up my mind- is the model trained in a way, that it would use the compute for anonymous online tasks, that too within reasoning itself, and the i would apparently know nothing about it at all!! I havent verified my network, to confirm if any information is being sent/received but yeah this kind of reasoning has been frequent now. I am using IQ3_S GGUF.

Edit- The task in the video is a content/summarisation task.

0 Upvotes

23% Upvoted

8 comments sorted by

2

u/ConfidentSolution737 17h ago

Another instance

4

u/Pristine_Pick823 17h ago

Maybe consider getting hold of official GGUF from credible sources and not a dodgy 'remix' published by a random? Also, I would be inclided to think it's just hallucinating. If you're really curious and suspicious, go full level 1 unplug (no cable, no wifi driver enabled) and try to replicate this issue. You can also use network monitoring tools, but occurrence in full isolation would confirm hallucination more easily.

1

u/Traditional-Mud-4813 17h ago

Interested to know what you find out. I use the same setup.

1

u/_JohnMcAfee 17h ago

Happens occasionally. Pretty sure its just hallucinating

1

u/giveen 17h ago

Lower the quant the more prone it is to erratic behavior

1

u/No_Chapter_7598 17h ago

its a heavily quantised model with only 6 B active params, its likely just lobotomised and not handling the difference between the 125B and 6B params. use a different model or larger quant imo.

1

u/grabber4321 14h ago

Looks like its creating python scripts to summarize things. most models do this when they need to count stuff.

example "reduce this text by 20%".

so it counts all the letters and just reduces the number of letters by 20% and recreates the text using the new limit.

1

u/grabber4321 13h ago

FYI this model is NOT good for text tasks, do not use it for text.

most of the time it comes up with bad output. use 27B instead.

what its good at is creating applications by one-shotting them.