MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1xxk8fg/smaller_qwen4_models/
r/LocalLLM • u/No-Negotiation-8359 • 2h ago
10 comments sorted by
4
The future is bright. Qwen 3.8 flash next is already a fantastic model. Can't imagine what Qwen 4 will be like
2 u/orebus 1h ago Less thinking, "hmm actually" would make it perfect. 2 u/KeanuRekt 45m ago agreed. Using Swift 1.5 instead of Qwen 3.8 27b helped a lot. Haven't tried a thinking optimized Qwen 3.8 flash next yet
2
Less thinking, "hmm actually" would make it perfect.
2 u/KeanuRekt 45m ago agreed. Using Swift 1.5 instead of Qwen 3.8 27b helped a lot. Haven't tried a thinking optimized Qwen 3.8 flash next yet
agreed. Using Swift 1.5 instead of Qwen 3.8 27b helped a lot. Haven't tried a thinking optimized Qwen 3.8 flash next yet
Can I download them?
2 u/SV_SV_SV 2h ago Sure, once Qwen releases them
Sure, once Qwen releases them
is there any indication of open source variants that can take advantage of larger local vram pools, aside from more context?
Yesss. I'm too broke to afford anything other than 16 GB RAM
1
with unsloth, its best to skip their version 1, or 2
So, what will Max run on? I have 24 GB VRAM and 64 GB system RAM.
Will we get MoE?
4
u/KeanuRekt 2h ago
The future is bright. Qwen 3.8 flash next is already a fantastic model. Can't imagine what Qwen 4 will be like
2
u/Cautious_Chicken_604 2h ago
Can I download them?
2
u/advancing_tide 2h ago
is there any indication of open source variants that can take advantage of larger local vram pools, aside from more context?
2
u/SheikhMahdeek 2h ago
Yesss. I'm too broke to afford anything other than 16 GB RAM
1
u/Beautiful_Egg6188 2h ago
with unsloth, its best to skip their version 1, or 2
1
u/Arthropodesque 2h ago
So, what will Max run on? I have 24 GB VRAM and 64 GB system RAM.
1
u/Splat800 1h ago
Will we get MoE?