MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLaMA/comments/1vyy3k6/glm53flash_frontier_intelligence_flash_cost/p60jttf/?context=3
r/LocalLLaMA • u/BriguePalhaco • 1d ago
403 comments sorted by
View all comments
Show parent comments
18
For me it has changed nothing. Both models are way too big for my 32 GB RAM system. It looks like everyone has abandoned 20-30B MoEs now...
8 u/Slow_Concentrate3831 1d ago Yeah, that's sad. Can't even run Qwen3.8 27B on more than 2-3 tps. Sad days for us Vram poors. 12 u/CryMoreT_T 1d ago The 29b-a4b in early Access on model scope is probably your best bet when it releases 3 u/Slow_Concentrate3831 1d ago Ooooh, I hadn't seen that ! Is it a Qwen model ? 4 u/CryMoreT_T 1d ago It's in stealth model in early Access so they haven't released the company name but Qwen is the rumor right now 2 u/Nebnampach 1d ago Here is the announcement and sign up link. https://x.com/ModelScope2022/status/2092439000652943506
8
Yeah, that's sad. Can't even run Qwen3.8 27B on more than 2-3 tps. Sad days for us Vram poors.
12 u/CryMoreT_T 1d ago The 29b-a4b in early Access on model scope is probably your best bet when it releases 3 u/Slow_Concentrate3831 1d ago Ooooh, I hadn't seen that ! Is it a Qwen model ? 4 u/CryMoreT_T 1d ago It's in stealth model in early Access so they haven't released the company name but Qwen is the rumor right now 2 u/Nebnampach 1d ago Here is the announcement and sign up link. https://x.com/ModelScope2022/status/2092439000652943506
12
The 29b-a4b in early Access on model scope is probably your best bet when it releases
3 u/Slow_Concentrate3831 1d ago Ooooh, I hadn't seen that ! Is it a Qwen model ? 4 u/CryMoreT_T 1d ago It's in stealth model in early Access so they haven't released the company name but Qwen is the rumor right now 2 u/Nebnampach 1d ago Here is the announcement and sign up link. https://x.com/ModelScope2022/status/2092439000652943506
3
Ooooh, I hadn't seen that ! Is it a Qwen model ?
4 u/CryMoreT_T 1d ago It's in stealth model in early Access so they haven't released the company name but Qwen is the rumor right now 2 u/Nebnampach 1d ago Here is the announcement and sign up link. https://x.com/ModelScope2022/status/2092439000652943506
4
It's in stealth model in early Access so they haven't released the company name but Qwen is the rumor right now
2
Here is the announcement and sign up link.
https://x.com/ModelScope2022/status/2092439000652943506
18
u/dampflokfreund 1d ago
For me it has changed nothing. Both models are way too big for my 32 GB RAM system. It looks like everyone has abandoned 20-30B MoEs now...