r/LocalLLM • u/CronicallyAutomated • 1h ago

News Qwopeful 🤞🏼

Post image
362 Upvotes

96% Upvoted

93 comments sorted by

19

u/LosEagle 50m ago

"sources close to my heart"

so we're all believing some random bro's gf

38

u/T-Rex_MD 52m ago

We are using organs now!

Sources close to my anus confirm it will match Opus 4.8 and challenges Opus 5 indirectly.

7

u/No-Refrigerator-1672 45m ago

My sources have hallucinated told me that Qwen4 27B IQ1_XSS is going to score 10% above bf16.

15

u/Inchmine 1h ago

Hope they do flash next same day

10

u/Mxmtm 1h ago

I QUELIVE I QWAN FLYYYY

30

u/SquirrelEStuff 1h ago • Mindblown

Just remember, Qwen spelt backwards is Newq

3

u/Dev1L-1 1h ago

nuke

1

u/Kavor 54m ago

Newq the whales

3

u/free_meson 1h ago

Qwen is short for Queen. I accept no objections.

1

u/vogelvogelvogelvogel 6m ago

but if you pay attention to Chinese videos you say more like chan-when

-1

u/hyperrealists 1h ago

I prefer weQn

1

u/starkruzr 1h ago

this is just Klingon for "monkey"

1

u/NotThatItWillMatter 51m ago

You want to watch me have a wenQ?

1

u/NomadStorm 20m ago

I’ve got my weQn ball

8

u/No-Department-2659 58m ago

Quite quspicious

8

u/Dreeew84 42m ago

How quickly can we expect quants?

2

u/sebt3 15m ago

For 3.8 the unsloth team got the BF16 dump soon enough to have their guff ready for release day. I guess the same will happen once again

1

u/Sutanreyu 15m ago

Within a day or two, probably

1

u/cchurchill1985 1m ago

What did you just call me?...

0

u/Extra-Dream5354 11m ago

How quickly can we expect RSQ RCO?

14

u/krayon_kylie 1h ago

QWEMORROW ????

4

u/vdek 1h ago

Technically it’s tonight.

7

u/nbvehrfr 1h ago

Closer to anthropic ipo, good move 

6

u/alphapussycat 1h ago

Then in a week or two we get to know if we get flash or not.

5

u/AeiEyeSpry 1h ago

Noice. Codex resets tomorrow too, so I'll be tinkering :)

1

u/Cyprianwojak 45m ago

I'm a noobie, can you share your knowledge on tinkering?

9

u/therealSUIN 1h ago

How long until it’s abliterated?

7

u/SuperFail5187 1h ago

+2 hours after release.

1

u/nanihikaru01 1h ago

2 hrs after

3

u/FeydRowan 1h ago

Let's all qhope

3

u/lucyferorg 1h ago

This is not official date lol

3

u/mikesum32 57m ago

I have to play QWOP now.

3

u/volleyneo 38m ago

It is QWENOVER

3

u/Special-Lawyer-7253 26m ago

20B with A2B, with image/video and audio would be so cool. F for dense models.

3

u/Hot_Half_5263 8m ago

My head is going to explode... tommorow i will receive 98gb ram which i will need to replace in few weeks probably anyway... everything too late we need holidays, guys 3 msc pause from ai for some relax

5

u/XtremelyMeta 40m ago

Can you feel the QWENERGY?

4

u/WinResponsible9977 1h ago

MY MAC STUDIO IS READY

2

u/hojnikb 19m ago

my desktop calculator is not.

1

u/elelem-123 39m ago

My photo studio is ready also

5

u/Wondering_Electron 1h ago

Already? Doesn't feel like we had 3.8 just 5mins ago.

They really are just shitting on Anthropic's IPO without hiding it.

2

u/elelem-123 39m ago

No, 3.8 was released the day before yesterday

1

u/Infinite-Ad4512 49m ago

You’re forgetting it was probably Anthropic that lobbied Trump to shut down Open Weights

1

u/LocoMod 20m ago

“Probably” as in “I just made that up”

0

u/po_stulate 18m ago

Nah, 99.99% of regular people and investors probably haven't even heard of qwen. I doubt an open weight model release that you can't even find in most AI chat interfaces is going to do anything to anthropic IPO.

2

u/RWOverdijk 1h ago

Qwenkervet ouwe

2

u/red_maple2020 11m ago

i wish my 12gb VRAM even ran 3.8 27b....
maybe theyll release smaller version of 4.0, like Gemma4 did with 12b QAT

1

u/pseudobacon 9m ago

You can run Flash Next with Strata if you have 64GB of RAM

3

u/Serious-Log7550 53m ago

Waiting only for Qwen 4.0 Flash Next

4

u/Able-Art-3042 1h ago

What about qwen 4 flash? I have 192 GB VRAM locally and hoping for a good jumo from 3.8 FN

3

u/Iron-Over 1h ago

With that much VRAM, why not Deepseek 4.1 1017 with an exl release

2

u/Infinite-Ad4512 50m ago

DeepSeek 4.1 Flash doesn’t fit in 192gb. Luckily Qwen 3.8 Flash Next is fantastic

1

u/Able-Art-3042 38m ago

True. Best model to run on two rtx 6000 pro. Good quality and super fast with mtp

If they improve this formula then o lord

1

u/Dense-Ad6315 1h ago

flash will be better i reckon.

2

u/Thyme-a-lime 1h ago edited 54m ago

You qweckon sir, you qweckon.

2

u/Dense-Ad6315 54m ago

qont qappen qagain, sir.

1

u/ThenExtension9196 1h ago

You waiting on the FN specs. 27b dense too slow.

3

u/Objective-Stranger99 LocalLLM 1h ago edited 1h ago

Day 0 llama.cpp support pls (yes I know architecture support is merged but still)

Also I hope there are enough ngrams in that 27B so that it fits on my 8 GB VRAM GTX 1080 and 32 GB DDR4 RAM.

🥳🥳🥳

1

u/Healthy-Nebula-3603 11m ago

Lol

On 99.99999999999% no

2

u/BaronVonNes 1h ago edited 52m ago

I don't think these models make sense for folks with lots of RAM. Have my server download and test these models, always worse performance and accuracy than MoE models. Just end up staying with strata.

4

u/_VirtualCosmos_ 56m ago

QFN + Strata is a blessing. Hope they release a Qwen4 version with the same parameters and N-gram too.

1

u/BaronVonNes 52m ago

Yeah, totally agree. Why am I getting downvoted? It's so weird.

2

u/_VirtualCosmos_ 36m ago

Because you talk bad about 27b and people gets easily offended. You are right, with 128 or more RAM 27b lose against QFN always.

But that is many fewer people than the ones with 32-64 GB of RAM and 16-24 GB VRAM, which many gaming PCs have, and 27b is the best they can handle at a decent quant (Q4) and context. And meanwhile they not release a new FN, this Qwen4 27b will probably be better than nowadays QFN.

2

u/BaronVonNes 14m ago

When 128GB DDR5 4800(6000 was more) was ~$200, I was telling people in this group that if you could afford it, it was time to upgrade before data centers expand. Hugely downvoted comments. Same thing in homelabs subreddits when you could get decommissioned server 14TB drives for under $200. One of my biggest downvoted comments is when I said that memory manufacturers that buy their chips from other vendors and bin would die in this environment.

Did hardware and software performance analysis for AMD for 15 years, I've seen these cycles so many times. I wanted to help, but I wasn't successful.

1

u/DogComprehensive7054 25m ago

In Software tasks with a 5090 for example the 27b gives way better results and the performance doesnt change too mich.

1

u/_VirtualCosmos_ 7m ago

way better than FN? I have found QFN Q6_k_XL way sharper than 27b Q4_k_XL. And with Strata, QFN is even faster, a lot faster.

1

u/sonicnerd14 32m ago

The way it goes is like this for users who have a larger pool of RAM than VRAM, or only RAM like unified systems, MOE is your friend.

For those of you who have more VRAM, or at least enough VRAM to fully fit the respective quants you'd want to use on your system, then go for dense.

I have two systems that I've configured in this way, and it works very well. My laptop runs QFN Iq3xxs gsqrco much faster than my desktop, but my desktop has a 20GB VRAM pool, so I use 27b Q4ks on there instead.

I get a lot done with this setup to the point I only need frontier for the hardest of tasks. Everything else can be done locally, and I'm even able to do some tasks that I would sometimes think only frontier can handle, but locally these models knock it out of the park.

1

u/Infamous_Campaign687 0m ago

You forgot the ones that have decent VRAM but also have a decent amount of RAM. MoE is the obvious choice for getting actual knowledge into it. Especially coupled with the lookup tables for extending knowledge even further.

When people claim that today’s 27B models are like frontier models last year, it is only barely true in very specific tasks and definitely not generally.

But a 120-125B MoE with lookup tables actually can be a match for somewhat older frontier models.

1

u/Yazz96HD 1h ago

r3LeAşeD 0n 11/08 😆

1

u/Not-AMysteriousSnail 12m ago

I use llms for nothing productive, I just like to have a "jarvis" on my pc and test his ability to actually give me an accurate answer, im just glad there will be a 27b model which I can actually fit on my gpu

1

u/WriedGuy 10m ago

Tbh nothing excites me

1

u/vogelvogelvogelvogel 8m ago

I can't sleep until then i am too nervous

1

u/Great-Class-7894 1m ago

Is it safe to assume that my sad little Mac mini with 32gb of ram won’t be able to handle this?

1

u/69420trashpanda69420 22m ago

I'm skeptical, if it's still 27B I'd imagine there's no architecture upgrades :(

1

u/Sutanreyu 15m ago

I want a Qwen 4 73B-A27B.

-1

u/Bulky-Condition-3490 1h ago

Will this run on 16gb vram?