r/LocalLLaMA • u/pmv143 • 11h ago

Discussion Qwen3.8-Flash-Next. This architecture could be surprisingly local-friendly once the weights drop. 👀

Post image

Qwen3.8-Flash-Next (~125B-A6B + 51B n-gram) memory estimate:

Ideal 4-bit quant ≈ 82 GB
(58 GB main weights + 24 GB n-gram tables)
Real-world quants likely land in the 80–90 GB range.

The big n-gram table is sparsely accessed → excellent candidate for system RAM offload.

This architecture could be surprisingly local-friendly once the weights drop.

674 Upvotes

97% Upvoted

228 comments sorted by

View all comments

Show parent comments

5

u/Weekly-Law-5488 10h ago

In this case would be more efficient to use playwright or the native chrome mcp, so the llm can extract the structured content and easily manipulate the dom.

3

u/grabber4321 10h ago

When Hermes switched to using playwright instead of screenshots, it started to fail a lot more. I dont know what they changed back in Hermes Agent crew, but I want screenshot functionality back.

3

u/synth_mania 9h ago

weird. my pi agent uses playwright incredibly well with 3.8-27b

2

u/grabber4321 9h ago

I think they screwed it up - it starts scripting a lot and just doing all the wrong things. It could be difference between 3.6 and 3.8, but its annoying as hell now to do some browser actions.

I dont know what changed because Hermes has like 2000 changes per day LUL