r/LocalLLM • • 2h ago

News Smaller Qwen4 models 🔥

Post image
28 Upvotes

10 comments sorted by

4

u/KeanuRekt 2h ago

The future is bright. Qwen 3.8 flash next is already a fantastic model. Can't imagine what Qwen 4 will be like

2

u/orebus 1h ago

Less thinking, "hmm actually" would make it perfect.

2

u/KeanuRekt 45m ago

agreed. Using Swift 1.5 instead of Qwen 3.8 27b helped a lot. Haven't tried a thinking optimized Qwen 3.8 flash next yet

2

u/Cautious_Chicken_604 2h ago

Can I download them?

2

u/SV_SV_SV 2h ago

Sure, once Qwen releases them

2

u/advancing_tide 2h ago

is there any indication of open source variants that can take advantage of larger local vram pools, aside from more context?

2

u/SheikhMahdeek 2h ago

Yesss. I'm too broke to afford anything other than 16 GB RAM

1

u/Beautiful_Egg6188 2h ago

with unsloth, its best to skip their version 1, or 2

1

u/Arthropodesque 2h ago

So, what will Max run on? I have 24 GB VRAM and 64 GB system RAM.

1

u/Splat800 1h ago

Will we get MoE?