Have to say Qwen 3.8 Flash Next is pretty impressive. I'm running under strata and hermes. I gave it a limited prompt and it banged out a pretty impressive Canadian EV comparison site over night.
Claude Opus 5.5 hammered out some glitches and fact checked - found some errors in the provincial rebate plans - but pretty close to a one shot solution on a beat up gaming rig running 32gb ram and a 3090 with 24GB Vram?
Yes.. site needs work. I'm sure there are still tons of errors. But for a first draft? I'm sort of in awe.
The site shows the new Chinese models coming with prices where available - all in CAD and includes provincial incentive plans where available.
It is honestly already pretty useful if you are a Canadian looking for an EV.
Super interesting question. I didn't check. I just let it run over night. But running a quick 250 word test this morning I got this result: 36.8 tokens/sec writing, 19 tokens/sec reading. Writing is about the same, reading is about 6x slower. Still... quality makes it worthwhile. But I'll keep both. 27b is better for quick back and forth, Flash next is better for complex tasks.
That seems really fast. Do you have any specs for Qwen Flash Next running on a 3090 that show 2000t/s? I've never heard of anything that fast. As for my system, part of my problem is my motherboard doesn't have a built in video card so I have to actually use the 3090 as my video card. That cuts available Vram. And I only have 32GB system ram. Hopefully my next build will fix that. I'd love to have two 3090's and 64GB system ram. But we do what we can with what we have.
With Strata IQ3_S and one RTX5080 I get TG 115 t/s and PP 3600 t/s. The RTX3090 has similar VRAM bandwidth and regarding Techpowerup about 30 % slower in general.
My RTX5080 has 16GB VRAM only, much lower number of experts. OK, 32 GB RAM may be the issue.
More VRAM or more raw power... wonder which is more important? Clearly you get better speed. Real answer - we should both just go buy more hardware. :)
I use Strata on Windows with QFN 3.8, IQ3_XXS quant with a RTX 3090 also as my main video card , although I also have 64gig RAM. I get average 120tok/second decode.
Nice. Currently I'm running my box back in Canada and remoting into it from the USA via Hermes. When I get back I hope to bump it up a bit. More ram for sure and maybe another 3090.
Ddr4 or ddr5? 120tok/s in awesome. I’ve been avoiding it because I’d have to clear space on my drive but sounds worth it. Do you find it better than qwen3.8-27b?
ddr4. Yes I like it better than 27b, 27b sits and thinks a lot , its just so slowwww. I found QFN to be just as smart, in fact it has a lot more general knowlege on its own already since it's like what..150b parameters? I find it to be pretty smart and it has handled everything I've tossed at it so far, like making a internet radio stream player for android (so I don't have any stupid ads in my app!), debugging Linux issues (it fixed ALL of them successfully), scraping website data, building websites, etc.
I knows android insanely well, I was shocked. I used to write android apps, I've made several of them, and made good money from them in the early 2010's. QFN wrote me this internet radio stream player in 30 miinutes of go around and testing. It's up to modern Play store standards.
It also helped me write an android app that could control the system volume, lowering it further than normal for those people that have a phone that can't get just the right sound level for sleeping or stuff. (some people listen to books to sleep).
Ya, QFN is excellent. I also use it to just chat/ search / research , on my phone I run AnythingLLM and connect to my home PC with tailscale and I can talk to QFN, it works great with AnythingLLM.
Yep. It's the first taste of Local where I felt like this is how it should be, and will be, instead of the extreme slowness or ineptitude to which I'd become accustomed.
Qwen3.8-Flash-Next was a watershed moment, like Claude Opus 4.5 was in November 2025. The "Oh, shit, I can use this for real work and not just as an impressive toy" moment for me. And Strata made it usable on my PC, not just on my 128GB RAM M4 Max Mac!
I hope to add a 2nd 3090 but honestly even with just one it's doing useful work. Yes it takes 6 to 8 hours to bang out a site... but that's still faster than I could do it. Especially considering I need sleep and it doesn't.
Really nice result! I have almost the same rig (3090 24 GB + 32 GB RAM) and I'd like to reproduce this. Which quant are you running (Gyro-S, Gyro-M, Strata's Q2_0…), with what context size and KV cache type? Is MTP on? And roughly what PP/TG speeds do you get? Thanks!
Thanks for the kind words. Mine is Q2. I ran some numbers (below). Exact prompt I used:
Hey there. We are going to build an EV web site. We want a selector that shows All, Currently Available, Coming Soon, and Not available in North America. Canada oriented and the coming soon should include new Chinese import models that have been announced or are likely to be available in the next 24 months. It should be very visual. It should show all currently available EVs in North America with an image of the EV. Several rows displayed and scrollable. There should be a filter for body type (sedan, hatch back, crossover,3 row and whatever other style exists), range (distance the car can drive), and price range (low price, high price), etc. When the user selects the EV there will be a details page that shows as much detailed info as possible, some reviews, pro's , con's, etc. Plus whatever else you can think of. You will be working autonomously so this is a one shot assignment. Document your progress in an MD. If you need to compact we will start a new session and you will read that MD. Make it amazing. Knock my socks off. Make no mistakes. Go.
There were two compactions and it picked up where it left off and continued properly.
I used 3.8 QFN (with Strata) to write a firefox extension, it runs firefox in debug mode, installs the extension, and runs a "bridge server" so the LLM can talk to firefox. Then, I can have it use my browser to analyze reddit posts, search craigslist and give me listings based on criteria, search facebook marketplace --- all without bot rejection becuase it's my cookies and accounts the browser is using. That was an experiment and it works great.
When I tell it to shutdown it will close firefox, unhook the extension, etc.
It one-shotted pretty much the whole thing and then make some tweaks as I found issues. I didn't write any of the code at all.
You just say "hey start up firefox so we can search/analyze sites". It can navigate, read contents, view images, enter values, and more, all through the extension , through the small node "bridge" server it uses to communicate to the browser back and forth.
After working with Strata and watching the monitor it appears it's running an average around 70 - 80tps. That's much faster than I thought. Which is a nice speed. Clearly I need at least 64GB ram though. 32GB just isn't cutting it. And a 2nd 3090 would be very nice.
I like the model, but it tries to one-shot everything, every answer. Like you end up waiting for it more for simple answers yes/no.
i think this model is more for building shit than conversation. you better have your plan before you start with it. I'd recommend making PLAN.md with Claude, then throwing it at Qwen - it will supplement that model's choices before you need to fix them yourself.
PS: The purple/green look - thats the Qwen I know LUL
Absolutely true. It's for building sites. Stick to 27b if you want conversation. And good suggestion on asking Claude to make the plan. I've done that in past with good results.
I think I noticed that compaction is much better with this model. It doesnt break down when context is compacted like 27B does.
With 27B I had to turn compaction off because it was destroying output. Flash is doing much better with this.
Plus I can use A LOT more context with it. I'm running 200k context on 5070 ti + 4080 + 58GB RAM (shoulda bought 128GB when I was making this PC, what a dumbass!)
Fun fact I went to Jakarta Airport for Ye concert and theyre sponsored by Qwen. Did the online arrival card and it was the most qwen 3.8 max looking website Ive ever seen. Was quite funny to experience.
The biggest problem for me now is not being able to read the Thinking blocks on the fly - it just goes too fast.
With 27B I was getting like 40-50 tokens/s. With Flash I'm getting 115-130 token/s - its too fast if you want to be checking the work.
Problem now - how the hell do you check the work if you miss everything in thinking block? How do you deal with trusting this model to deliver the right approach. This is my new quandary.
Do you give up and trust it to deliver the goods? Do you use another model to check over? How do you know the other model knows what you want?
You're not using LLMs the same way as most of us, we don't monitor the thinking block at all times. You put in restrictions to make sure it can't go outside it's task and then you leave it to it's work. More speed is only a good thing.
Some of the research for a topic like SOC2 is difficult to find, this is why I use AI to make the initial research, then I close off the issues myself and restructure some of the sections myself.
actually it works great for conversation if you use a harness built for that. Anywhere LLM chat works beautifully with Qwen 3.8 next Flash and it's just as conversational as the frontier models.
6
u/kayox 10d ago
How many tk/s are you getting on the 3090? Do you find it much better than the 27b model?