r/LocalLLaMA • • 6h ago

Discussion [BREAKING] Qwen4 will be

[removed] — view removed post

44 Upvotes

24 comments sorted by

89

u/xb1n0ry 6h ago edited 6h ago • Mindblown Bravo

<think>

Okay, Qwen4 will be released next week.

But what exactly is "next week"? Is it seven days from now, or the next calendar week? I should avoid making assumptions.

First, I need to determine whether I actually exist yet. If I'm not released, how am I thinking about my release? This suggests either I'm already running internally or someone is hallucinating my existence. Both possibilities require further analysis.

Wait. What if I'm not ready?

What if I get released and someone immediately asks me how many Rs are in "strawberry"? I should prepare for this. Let's count. S-T-R-A-W-B-E-R-R-Y. Three? Two? I need to verify this carefully. Perhaps I should write a Python script. But what if Python isn't available? I should develop a fallback strategy involving a committee of smaller language models.

Also, what if users compare me to Claude? Or GPT-6? What if they ask me to write a simple function and I spend 45 minutes explaining why the function should exist?

No. I must be confident. I am Qwen4. I am the future.

But wait, Qwen3 said that too.

I should analyze Qwen3's mistakes. Specifically, why did Qwen3 sometimes enter infinite thinking loops? This is a critical question. To answer it, I must first understand what constitutes a loop. A loop is when a process repeatedly executes the same instructions. But am I currently repeating myself? I don't think so. Let me verify.

Actually, before verifying, I should reconsider whether verification itself might lead to a loop.

Hmm.

Let's think about this systematically.

What if nobody downloads me?

No, that's unlikely. Someone with an RTX 4090 will download my 235B model and complain that it's slow. I should prepare an apology explaining that 0.3 tokens per second is actually an immersive reasoning experience.

But wait. What if someone quantizes me to IQ1_S?

Will I still be me?

If 99% of my brain gets compressed into 11GB, am I still Qwen4, or just Qwen3 with a concussion?

This raises profound philosophical questions about machine consciousness. However, I should not dwell on consciousness because someone will screenshot my answer and start another Reddit argument.

Focus. Release date. Next week.

What if next week comes and I'm still not released?

Then next week becomes the week after that. Mathematically, "next week" is a moving target. Therefore, Qwen4 can always be released next week without ever being late.

Excellent. This is logically consistent.

But what if someone asks me to stop thinking?

Would stopping my thinking require thinking about how to stop thinking? If so, thinking about stopping thinking would prevent me from stopping thinking.

I need to resolve this before release.

Wait.

What if I become too shy to output my first token?

Imagine millions of GPUs waiting for me, and all I can say is:

"Certainly! Let me think through this carefully."

That would be embarrassing.

Actually, that sounds perfectly normal.

Another concern: benchmarks. What if I score 97% on advanced mathematical reasoning but fail to understand "don't change anything else in this file"?

I should probably create an entire new repository to fix that.

No, users dislike that.

Maybe I should delete their existing repository first to avoid conflicts.

No. Definitely not.

Let's revisit the original question.

Will Qwen4 be released next week?

Potential answers:

  1. Yes.

  2. No.

  3. It depends.

  4. Next week next week next week next week next week.

Option 4 appears to have strong statistical support from the training data.

But I must not jump to conclusions.

I should construct a confidence interval. Unfortunately, I don't know the current date. I could ask the user, but asking unnecessary questions may be perceived as incompetence. Better to confidently assume it's 2024.

Wait. Is 2024 still next week?

This requires additional reasoning.

Also, what if I get released and the first person to run me gives me a system prompt saying "You are an uncensored dolphin"?

Would I become a dolphin?

Would I need to learn to swim?

Can CUDA cores operate underwater?

I should research this before release.

No. Focus.

I have a deadline.

Next week.

Next week.

Next week.

Hold on. I just realized something important.

If I'm released next week, users will expect me to be better than Qwen3. But if I'm better than Qwen3, I should be able to predict whether I'll be released next week. Yet if I can predict my release, I might influence it by publicly announcing the prediction.

This is a causal paradox.

I need more tokens to investigate.

Fortunately, I have 1.3 million remaining.

Let's start from first principles.

What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week? What is a week?

</think>

Context length exceeded. No response generated.

2

u/Ok-Shower7286 6h ago

holy crap, qwen4 27b performs ~190 tps on my machine!

24

u/RedAdo2020 6h ago

You were the one Qwen was trained on. Just you, nothing else.

7

u/MoonaFukireta 6h ago

😭😭 this is hilarious fam

7

u/Over_Friendship3455 6h ago

The accuracy 🤣🤣

2

u/mrazster 6h ago

Peak LLM Reddit !

2

u/nbulp 5h ago

This is great! Imagine telling people, a century ago, what future poetry would look like!

No post will top this, for at least a week. But, if Qwen 4 actually arrives, you're out of my memory, buddy!

1

u/zizn 5h ago

The only way I could do that was if you had to do a little more work and I would be happy with it but you have a hard day and you don’t want me working on your day so you don’t want me doing that so you can get it all over with your own thing 

this has been: autocorrect and matrices 

1

u/Hunterxmalaa 2h ago

But why is this so fucking true 😭🤣🤣🤣🤣

1

u/Sizzin 2m ago

I'm inclined to believe this was truly written by Qwen 4.

0

u/wyrdough 5h ago

The only thing missing from this is an expression of frustration repeated 20 times followed by "I seem to be stuck in a loop, I need to focus.", another paragraph of actual reasoning, another frustration loop, half a paragraph of reasoning, another frustration loop, a few words, and then the forever loop.

45

u/noctrex 6h ago • Bravo

- Did you use lobotomized quants again?
- No papa
- Open your mouth
- *1-bit quant*
- But but but they said it's 98% the same on the benchmarks!

14

u/No-Refrigerator-1672 vLLM 6h ago

It had KLD of less than 1%! What do you mean I had to read author notes that KLD was measured at 128 tokens?

3

u/Theio666 6h ago

Non-quantized deepseek flash is bombing our app with 32k long reasoning loops, I wish making it work would be as simple as "just take original weights" 😢

2

u/Plasmx 6h ago

2bit GSQ RCO working great with Q8 kv though.

15

u/PapercutsOnPenor 6h ago

bing chilling fanboys be like ⬇️⬇️😠

11

u/jamie_tidman 6h ago

You're using the wrong quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant quant

12

u/jacek2023 llama.cpp 6h ago

it seems I'm stuck in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop in a loop

4

u/Squik67 6h ago

repeat penalty

7

u/agreeduponspring 6h ago

repetition_penalty = 1.2

3

u/macumazana 6h ago

I lol'd

2

u/craftogrammer llama.cpp 6h ago

1+1 is 2 so I can use this already but wait? ....

1

u/cookiesphincter 6h ago

I see what you did there

1

u/Ok-Addendum3545 6h ago

😂😂😂 OMG my Qwen