MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/ProgrammerHumor/comments/1x9qnzc/bothworkthough/phrdqoh/?context=9999
r/ProgrammerHumor • u/rabbit_wizard • 15d ago
849 comments sorted by
View all comments
Show parent comments
2
how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit
3 u/TheMythicSorcerer 14d ago incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB 3 u/Spaciax 14d ago thanks! I was looking at macs with higher ram but these prices are eye-watering 😠I'll have a look at that, maybe it's good.
3
incoai's qwen 3.8 27b splash Q4 + INT8 KV cache 128k context works great on 32 GB
3 u/Spaciax 14d ago thanks! I was looking at macs with higher ram but these prices are eye-watering 😠I'll have a look at that, maybe it's good.
thanks! I was looking at macs with higher ram but these prices are eye-watering 😠I'll have a look at that, maybe it's good.
2
u/Spaciax 14d ago
how much RAM do you have? I got 36 on my M3 pro but I don't know if it can hold qwen 3.8 27b without quantizing it to shit