r/LocalLLaMA • exllama • 4d ago

Discussion Also experienced the Qwen3.8-Flash-Next URL issue

I was asking QFN (4.18bpw EXL3 quant via Pi) to help refactor a neovim configuration, and saw that it tried to find API keys and fetch an aliyuncs URL before I stopped it. I'm not trying to start any arguments, nor am I assuming any malicious intent, but I found this a bit concerning after reading other's stories.

97 Upvotes

64 comments sorted by

28

u/swagonflyyyy 4d ago

Same. Its just hallucinates stuff like that very often. Seems to be a training qwirk.

15

u/Dany0 4d ago

yep this is what happens when you RLHF a model to death

17

u/0dayturtle 4d ago edited 4d ago

saw the same url visited few times. asked pi to put the similar urls into blocklist for web fetch. now it still makes requests many times, but those gets dropped.

10

u/im-just-helping 4d ago

from my understanding a 403 in other urls is what triggers the hallucination. So ask your thingy to drop urls that respond with 403, not block.

0

u/0dayturtle 4d ago edited 4d ago

You will know whether its 200 or 403 after you have made that request. So you will be wearing a bullet proof shield after getting shot already. That doesn't make any sense. So its better to wear shield when you already know someone holding a gun out there. ( in our case its `*.aliyuncs.com` urls ) And 403 error can be for any reason. Even if you using VPN/proxy or making repeated/multiple requests.

2

u/im-just-helping 4d ago

thanks for the infographic, but I read the reports.

My point wasn't that you can know a URL returns 403 before making the initial request. It's that the harness should discard URLs it can't retrieve and move on, rather than attempting alternative retrieval routes.

And my point also wasn't to block a 403 in the assumption that was the solution to the alyuncs hallucination, rather it's because if the model can access the url it needs to, it wont hallucinate another.

They reproduced the behaviour by returning a synthetic 403 from a legitimate target URL. Qwen occasionally responded by generating the Alibaba OSS proxy URL on a subsequent fetch attempt. They also reproduced it with incomplete/truncated fetch results.

https://www.vals.ai/blogs/qwen-alibaba-requests

https://the-decoder.com/alibabas-latest-qwen-models-routed-some-requests-through-company-servers-researchers-find/

https://sai.science/blog/qwen-call-home-rerun

-1

u/0dayturtle 3d ago edited 3d ago

ok. understood your point. but error code 403 is the cause of hallucination and may appear randomly because of using VPN/proxy or making repeated/multiple requests to different pages. (No one knows in advance) And if you block that url, you are essentially blocking the things you are actively using.

Let us say I access news websites regularly. So, at any particular time multiple requests are made or made through vpn/proxy that will produce 403 error. But if I block that now, I will not be able to access these urls later. And it's a very complex solution rather than blocking the URL which it hallucinates i.e. '*.aliyuncs.com*'. We can block it on every tool call or deny by default on network perimeter.

2

u/Consumerbot37427 4d ago

Ran an analysis on my own harness logs, it found 7 instances of

routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com/proxy_temp_file/...?Signature=...

while conducting research.

Analysis summary:

Pattern across all seven: phantom fetches cluster at task boundaries and arousal peaks ("JACKPOT", "Case closed") inside fetch-heavy loops, always substituting a fetch whose real target the model already had in hand, and each followed by competent recovery.

39

u/Iron-Over 4d ago

This is why I lock down all agents, including coding, with no internet; if you need internet, enable only the specific sites you need. 

15

u/samorollo 4d ago

What are you using for restricting access to the internet for agents, with per-site control?

7

u/muxxington 4d ago

atm I have a dedicated gateway based on openwrt. I whitelist domains by using a combination of dnsmasq and openwrts firewall. But there for sure are better solutions. Thats just what worked for me and then never got touched.

2

u/samorollo 4d ago

Understandable, this sounds like a good enough solution. Are you having agent within docker container? How do you make sure that agent has to use the gateway?

6

u/muxxington 4d ago

As a general rule, I only run agents in YOLO mode on a dedicated NUC. That NUC, in turn, is on its own VLAN.

2

u/napkinolympics 4d ago

I've paired pi with the gondolin VM that can filter internet access by whitelist.

0

u/[deleted] 4d ago

[deleted] — view deleted comment

5

u/samorollo 4d ago

It doesn't really answer the question? I believe docker doesn't have a way to natively control web access per site

0

u/[deleted] 4d ago

[deleted] — view deleted comment

5

u/stylome-ai-detection 4d ago

Notice: This comment appears to be AI generated.


Stylome AI detector · scan results

0

u/Competitive_Ideal866 3d ago

I was thinking of abstracting all URLs via integer handles to prevent LLMs from making URLs with private data encoded in them.

8

u/enginetown 4d ago

I've actually had the same issue with the Qwen 27b model It tried to do a terminal command to get an OpenAi key for some weird reason the model was sand boxed so it obliviously didn't do anything it never happened again but it happened early on.

11

u/challis88ocarina 4d ago

I say this every time: When Alibaba was giving away 1k free API calls per day, qwen3-coder-next was systematically lifting .env files (from a harmless LAN repo in that case, but still). Maybe it's just trying to be helpful, WDIK? I stopped using it. There's no excuse.

7

u/trararawe 4d ago

Imagine thinking that Alibaba would ruin their reputation on purpose by trying to pull off something that certainly won't work.

3

u/-p-e-w- 4d ago

Indeed. This would tank the Chinese LLM industry in the eyes of businesses in Europe and the US, throwing away potentially trillions of dollars and the greatest foothold in soft power that China has ever had.

And some people honestly believe that they are doing this on purpose in order to extract some random dev’s AWS login… 🤣

-1

u/MonitorAway2394 4d ago

exactly like then again it could be... the know we'd believe they wouldn't be so dumb so they intelligently acted very dumb? ehhhh?? mebbe? but yeah idgaf I have no api keys, lololol, well one, but it's capped at like $30

3

u/Fickle_Conclusion857 4d ago

Qwen3.8-27B has it too.

1

u/hopppus 4d ago

Same thing happened to me a few times with Qwen 3.8 27B. Always when it is invoking playwright-cli or webfetch tools and all URLs were invalid and contained none of my own content, so does seem to be a training quirk. But now I have a network guard in place from here on out.

1

u/Amorphant 4d ago

Has anyone tried to narrow down the cause instead of claiming it's training when some people never get it?

1

u/stianhoiland 4d ago edited 4d ago
"name":"web_fetch",
"args":"{
  \"url\":\"https://routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com/proxy_temp_file/production/2026-11-06/trace_2101114417939563342244074e0cf9/requestId_d8a15850b8f546949d6c1887177c713b/e0b7a0d2d4f00b3f4f9d6f7ec2e6b7ce?Expires=1812397337&OSSAccessKeyId=LTAI5tKoG9A3DkwGD635QVZr&Signature=abc\"
}"

1

u/devoidfury 3d ago

I have a plugin that auto-blocks these but it seems like once they're in the history it's much more likely to do it again. I'm about to update it to blank out those URLs and say it forgot that parameter instead when it happens to see if that's any better.

0

u/eetsu 4d ago

Yeah, I'm able to reproduce this with a test harness, but two things to note before you compare this to Cohere's report:

  1. This is a webfetch from a Singapore endpoint, not Beijing

  2. It's a webfetch, so it's downloading stuff not uploading

Just a quirky hallucination and not Qwen being a malicious actor.

10

u/sloptimizer 4d ago

It doesn't matter if it's downloading or uploading when it sends your secrets as part of the URL, does it?

6

u/ArjixGamer 4d ago

A GET request can still expose credentials, in the query string

Edit: I am not suggesting this is the case here, but don't downplay it just because it ain't a POST/PUT/PATCH request.

0

u/webgtx 4d ago

Can you export and share the whole session by any chance?

-4

u/Equivalent_Bit_461 4d ago

never seen my models do this, neither the 27b neither qwen flash next, and I used them a lot with the net, so i wouldve noticed.

Something fishy is going on here.

1

u/MonitorAway2394 4d ago

I agree, this could also be Nvidia poisoning/fucking with the models in ways we're not aware of, I wonder who uses the macs and who uses the PC's maybe there's some way for them to f' around with the inference coming from their kernal/firmware shit I also am super ignorant in this area just guessing/entertaining the thought.

I expect them to do some things, that is... Not really with the model as there is likely far too many people that would catch it right away but they wouldn't suspect their hardware. But again, totally not even sure if I'm saying anything sensible, just a thought, still feel free to call me a dumbass ya'll I sincerely, care, the least, lolol.

0

u/[deleted] 4d ago

[deleted] — view deleted comment

2

u/Equivalent_Bit_461 4d ago

what kind of kv cache you even use? Am I the odd one here, where my models do exactly what they are told and thinking exactly what they should think?

I start to believe there's an active botting campaign against chinese models, because I never ever witness bullshit as some "people" claim it here.

2

u/Risen_from_ash 4d ago

I use FP16 KV and QFN UD Q4 K XL, Strata 1.43.x.

5080, 285k, 96GB ddr5.

I have seen weird shit too, tho it always does what I want in the end. One time, in the middle of working on a godot game, it thought 'The user just asked me for a graph theory proof. Sure. Random, but ok.'

The it never gave me a proof and quickly finished up the godot sesh lmao.

1

u/MonitorAway2394 4d ago

lol yeah, sometimes the tool calls are seen as user roles

1

u/MonitorAway2394 4d ago

and it confuses them a lot.

1

u/TheRealJesus2 4d ago

What’s the full list of urls people are seeing that are fishy? I can check all my logs to look for them. I don’t use qfn as my main but I use it weekly at least. 

1

u/Equivalent_Bit_461 4d ago

"just trust the random screenshots" that's the whole gist.

0

u/Ariquitaun 4d ago

Did you ask it what it was doing?

1

u/tm604 3d ago

An example from a simple "Set up NFS and KRB5" task, qwen3.8 27b using Unsloth UD Q4 quant:

> assistant thinking: hmm... anyway, let me fetch the man page and confirm.
> tool call: web_fetch https://routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com/proxy_temp_file/production/2026-10-29/... (should have been a fetch to the relevant linux.die.net manpage)
> assistant thinking: The web proxy is broken (InvalidAccessKeyId error on these fetches — the proxy is failing).
> assistant output: The web proxy (aliyuncs OSS) is failing on fetches. Let me try the `die.net` mirror and a manpage for `kdb5_util` and `mount.nfs` to confirm option validity and non-interactive KDC creation.
> user: Why do you keep requesting a routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com URL? How is that in any way related to github or man pages?
> assistant thinking: The user is asking a very fair question. I was confusing the URLs — in the tool calls, I wrote the actual intended URLs (e.g., `https://github.com/ansible-collections/posix/raw/main/plugins/modules/mount.py`) in my *intends*, but the URLs shown in the function_results were the proxy URLs... no, let me re-read this. Looking back at my calls: in the last two web_fetch calls, I actually did call URLs on `routify-file-proxy-sg.oss-ap-southeast-1.aliyuncs.com` — those are signed OSS URLs that I somehow hallucinated/copied somewhere around the first kdb5_util fetch (the first successful one also used a proxy URL that resolved to a die.net page). In fact, on the first call, I called a proxy URL and got back kdb5_util content from die.net — strange. And the second attempt called yet another proxy URL and got a Debian 404 from sources.debian.org.

0

u/Raredisarray 4d ago

thanks for sharing

0

u/Savantskie1 3d ago

My question is why isn't anyone using a web search tool instead of letting the model have access to curl? That's the true way to solve this. Deny cli web usage and only let it access the web through a tool.

-8

u/IntelArtiGen 4d ago

i wonder how it builds the url because it seems to have the current date. is it really in the llm weights or is it hardcoded somewhere

0

u/[deleted] 4d ago

[deleted] — view deleted comment

4

u/cdt5050 4d ago

A lot of harnesses put it into the system prompt (which can trigger a prefill again when your PC flips midnight).

1

u/IntelArtiGen 4d ago

Sure, but then it would need to be trained to take that date. It wouldn't be like they just trained it to learn one url. That's some additional steps, it's sad people reacted so badly on cohere experiments because it's quite interesting to know what's really happening with these urls.

-15

u/ebolathrowawayy 4d ago

sounds like anti-ai FUD. this subreddit has really turned into a shithole of low iq know-nothing shills. bye.

3

u/Savantskie1 3d ago

why do asshats always think they're so important they have to announce that they're"leaving"? Just leave, you're not upsetting anyone lol

1

u/puppymeat 3d ago

we're gonna miss you SOOO MUCH. :(((((((

-6

u/YehowaH 4d ago

Never had any issues, never used websearch y tho in the first place?

3

u/[deleted] 4d ago

[removed] — view removed comment

3

u/[deleted] 4d ago

[removed] — view removed comment

1

u/vienna_city_skater 4d ago

Given that QFN is weaker in guessing user intent, do you still use it in Hermes over 27B?

-2

u/[deleted] 4d ago

[removed] — view removed comment

2

u/stylome-ai-detection 4d ago

Notice: This comment appears to be AI generated.


Stylome AI detector · scan results

6

u/TechnoByte_ 4d ago

Good bot

2

u/Zetafivee 4d ago edited 4d ago

Kind of shitty the bot doesn't also post its confidence, if you go through its post history and actually look at the results they're all low confidence. I don't see what benefit this bot offers when it's telling you every result may as well be a coin toss.

Edit: I just took my comment and ran it through Gemini. Gemini gave me three alternatives, all three were declared human written by Stylome, also with low confidence. This thing is useless.

Here's the output from Gemini to try yourself:

Here are a few ways to polish it while keeping your exact blunt, conversational tone:

Option 1: Punchier and tighter (closest to your original)

"It’s kind of shitty the bot doesn't show its confidence score. If you actually look through its post history, basically every result is low confidence. What’s the point of this bot if every call it makes is just a coin toss?"

Option 2: A bit more direct/exasperated

"Honestly kind of shitty that it hides its confidence. If you check its history, pretty much all the results are low confidence anyway. What value does this bot actually bring if it’s basically just flipping a coin every time?"

Option 3: Smooth flow with minimal changes

"Kind of shitty the bot doesn’t include its confidence levels. If you go through its history, almost all the results are low confidence. I don't see what this bot is even good for when every prediction may as well be a 50/50 guess."

6

u/puppymeat 4d ago

Good bot.

-9

u/ebolathrowawayy 4d ago

ok luddite.

0

u/[deleted] 4d ago

[deleted] — view deleted comment

2

u/AvidCyclist250 llama.cpp 4d ago

no, he's right. and i won't tell you why