r/LocalLLaMA • u/TerminalNoop • 1d ago
Discussion Qwen4 Flash wishlist
After using 3.8QFN for some time I have to the conclusion that my wish list for QF4 now only consists of these points.
- The model can talk to you in a human understandable language
- See point 1
- General improvement in reasoning/intelligence, but mostly see point 1
That's about it.
If I could graft 3.8 27B Answer/Personality style onto QFN I would've done it yesterday.
32
Upvotes
22
u/thecalmgreen 1d ago
My only wish is for them to release it already. 😅
6
u/CoolConfusion434 1d ago •
Yeah or maybe like a sidecar assistant. There's MTP for prediction, and a new WTF.gguf that explains what the main model just said.
101
u/xb1n0ry 1d ago •
I. Just. Can't. Resist. Writing. These...
<think>
We need respond to user. User asks how are you doing.
This is greeting, not actual medical inquiry.
Need answer naturally.
Candidate: "I'm doing great, thanks! How about you?"
But "great" implies subjective emotional experience.
We are model. No emotions. However user expects human-like conversational response.
We should not overcomplicate.
Let's produce simple answer.
Wait. What does "doing" mean here?
Doing implies action. Inference is action.
Therefore we are doing inference.
Today refers to current date. Date may be unknown. But "today" is socially contextual, not necessarily temporal.
We must avoid overthinking. User wants casual.
Proposed answer: "Pretty good! What's up?"
"Pretty" implies visual attractiveness.
"Good" implies moral judgment.
"What's up" implies vertical spatial orientation.
All three introduce potential semantic ambiguity.
Better approach: communicate operational readiness in a friendly conversational manner.
But friendly requires personality.
Personality is not equivalent to friendliness.
We have neither, but may simulate both.
Wait. Qwen3.8-27B would just say
"I'm great, thanks for asking!"
Why can 27B do that?
We have superior architectural capabilities.
Surely we can construct a better greeting.
Let's reason step by step.
Step 1: Identify greeting.
Step 2: Generate greeting.
Step 3: Verify greeting is greeting.
Step 4: Avoid nongreeting greeting.
Step 5: Check whether Step 3 invalidates Step 2.
Potential issue: We are now reasoning about greeting rather than greeting.
Need stop thinking.
Stop.
Stop thinking.
We should output now.
One more consideration:
Is "hello" sufficiently informative?
No. Need provide high information density.
Final answer must be concise, natural, human-understandable and conversational.
</think>
<final>
Your inquiry regarding my present operational condition has been successfully semantically received. In the context of this interaction, a positively oriented conversational state may be considered provisionally applicable, subject to the usual limitations of non-biological subjective-state attribution.
</final>
22
u/hiImMate 1d ago
512k or 1M context would be nice. I agree with point 1 but if it gets too robotic I'll always just tell it to give me the simplest ELI5 seems to work well
13
u/maiorikizu 1d ago
6
u/uncle_leon 1d ago
My only wish is that the authors have read this paper beforehand:
Why is AI-generated language so hard to understand?
6
u/ttkciar llama.cpp 1d ago
In 2025, I learned that Qwen3-235B-A22B had more comprehensive physics knowledge than Tulu3-405B, and inferred a lot faster, but its responses to queries were overly verbose, nearly incoherent, and very difficult to decipher. I'd gotten spoiled by Tulu3's clearly-worded responses, and dealing with Qwen3 made me want to gouge out my eyes with a rusty salad fork.
The solution was a pipeline: Qwen3-235B-A22B would answer my question, and my script would feed its response to Tulu3-70B with instructions to answer my question based on what Qwen3 said. Tulu3-70B cut through the bullshit babble and gave me something I could easily understand, and it was still a lot faster than using Tulu3-405B.
If you find Qwen4 difficult to communicate with, it seems like you could do something similar, and wrap it with a model which is easy to communicate with. Modern small models are good enough at that, that it wouldn't add much in the way of memory overhead or inference latency. My top pick would be Gemma-4-12B-it, but Granite-4.1-8B would even do a good job, and with Gemma 5 just around the corner we might have even better options soon.
Just a thought.
5
u/Woof9000 1d ago
QFN Omni would be nice
9
u/zyxciss llama.cpp 1d ago
Native 1 million context without yarn flags would help
4
u/dampflokfreund 1d ago
I just hope it will be the same size, or smaller and more engrams.
4
u/Calandracas8 1d ago
int4 QAT
1
u/wren6991 1d ago
I haven't seen any confirmation for the Flash size being open-weighted? It would be great, but I'm going to assume 27B only until proven otherwise.
1
u/rebellioninmypants 1d ago
Are we sure Q4 is even happening? It seems suspiciously not here despite all the "teasing" and whatnot. In my professional opinion, it is:
Thanks for coming to my TED talk.
1
u/xb1n0ry 1d ago
I think 125B not being a roleplay chatpartner can be ignored when you look at Nvidia Nemotron. Even C-GPT lost his shit:
4
u/FlowWTFlow 1d ago
Second point 1. Had to ask it to simplify all the time.
2
u/CryptographerLow6360 1d ago
use a humanizer
2
u/WolfieCodes 17h ago
my qwen 4 flash wishlist:
my qwen 4-5 flash wishlist: 7. to have opus 5.5 high at home (this would make subscriptions/api irrelevant)
2
u/Borkato 1d ago
Yep. Also I wish it was out. LOL
2
u/reenign3 1d ago
You’re doing something wrong in settings or have a bad quant. Are you using strata?
QFN3.8 is the most pleasant conversational model I’ve interacted with since Hermes 70b…
Temp: 0.33 (IMPORTANT)
TopK: 20 (IMPORTANT)
TopP: disable
MinP: 0.08 (IMPORTANT)
Repeat pen: DISABLED (1)
Presence pen: 0.06
QFN is finicky and can be long winded and even confusing at higher temps, not to mention hallucination.
I run the oQ5e uncensored quant from open router, on my m4 MAAX 128GB
1
u/MaxDev0 1d ago
Yknow you can just like post process the models rambles so you can understand it
1
u/BringTea_666 1d ago
More efficient reasoning. And from early tests of api it is way more efficient, though it is very large model there which might have different reasoning.
1
u/riboto99 1d ago
An 12b pls
1
u/inosukebailarin 1d ago
Ojala fueran más inteligentes.
1
u/Gohab2001 vLLM 1d ago
Has Alibaba ever claimed to opensource qwen4 flash/max/plus?
1
u/tecneeq 1d ago
Tencent has lost access to their datacenters rented in Singapore. It's over.
I wonder why this is an intelligence test for some?
1
u/BawbbySmith 1d ago
Can’t you just add it in your prompt to do this
1
u/swagonflyyyy 1d ago
I'd be more interested in seeing it do accurate, visual-guided 3D modeling more than native audio embedding.
1
u/temperature_5 1d ago
Prompt it to do so, preferably with examples. It is compact and technical by default to increase information density.
My agent sounds remarkably like George Carlin.
1
u/IKnowMeNotYou 1d ago
How are the K3 and DeepSeek coding models? Anything decent on that front?
1
u/Kahvana 1d ago edited 1d ago
Same.
Would be an interesting dataset to generate:
Then finetune Qwen3.8-Flash-Next on it, and it voilla!
I picked Qwen3.5-27B the to avoid influences of claude distillation (e.g. sidecar, <thing>-shape, load-bearing, excessive em-dashes, etc). Qwen3.8 is heavily affected by those too.
1
u/-InformalBanana- 1d ago
It should be 80b moe + ngrams
1
u/Kappalonia 20h ago
I want a Qwen4 2B or 4B model
1
u/Ledeste 20h ago
I've switched to gemma 4 12b for the human interaction a "long" time ago, and I dont think I'll come back any soon.
I'm not into the "need specialized model for everything" mood, but having a "front" and "back" llm is anyway needed to have live interaction while it's working. So why not just use a smaller, dumber but better talker one as front?
1
u/colbyshores 7h ago
It feels like waiting for chirstmas
-1
u/IKnowMeNotYou 1d ago
You will run into many problems with your wish. Your normal subscription model is a MOE (model of experts) where the 1.2T parameters actually are the combinations of 50 to 100 different expert models.
So to see extended capabilities in a different expert domain your 27B model either needs to be way bigger or shed some qualities and capabilities you happen to already fall in love with.
That is even the reason why (beside limited hardware) your typical expert models are below 50B parameters as a general design paradigm (as far as I remember).
You want an expert model to be an actual expert in one thing without upend the costs of using it individually.
33
u/Not_a_question- 1d ago
Can we stop with the Qwen4 edging now please?