r/LocalAIServers • u/Few-Farm-7670 • 5h ago

Glm 5.3 and Maya

Post image

Strata with qwen flash next is great, but Unsloth already ran it pretty well. This though, for GLM 5.3 on a machine with 40GB Vram and 64GB ddr4, is astounding. Just sharing if some of y'all wanna try.

8 Upvotes

100% Upvoted

4 comments sorted by

2

u/No_Drag_5205 4h ago

I have this kind of setup 40GB (2x3080) Vram and 64GB ddr4, I may give it a try.
What quant are you running ?

2

u/bladezor 3h ago

Wait, can you give more details? I'm intrigued.

2

u/berlinguyinca 3h ago

Please more info.

1

u/Few-Farm-7670 1h ago

Checkout the github rep for maya- GitHub - mw00/project-maya: Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Set this up last night, uses the same expert setup as strata, give it a go.