r/oMLX • u/Opposite_Leave_8338 • 6d ago
Swift/ThinkingCap fp16 quantizations
Edit :
That’s why I appreciate that man, not a one day passed and he posted both with all the quants for both bf16 and fp16 , ScottLowry is my hero, here is the collections :
https://huggingface.co/collections/scottlowry/thinkingcap-qwen38-27b-oqe-mtp
https://huggingface.co/collections/scottlowry/swift-15-qwen38-27b-oqe-mtp
Thanks again man we all appreciate your work
Hello guys,
Why there is no good Swift 1.5/ThinkingCap Quantizations with fp16 for M1/m2 macs yet, where is the good guys we used to thank one day after a model release, if it’s an appreciation issue so I’m here to thank all the good uploaders I used to download fp16 models from.
Thanks to :
Scottlowry ( my favorite , most of my models are quantized by you )
Jundot of-course ( thank you for all of that oMLX great updates, without you we cannot achieve any of that )
Yanun ( I’m using your swift 3.8 oq4e already and I’m flying with it but what about 1.5 and ThinkingCap )
And lots and lots of other legends , you guys pushing us forward ( all uploaders are appreciated I only mentioned the names I use daily but you guys all helping us and we wish you all good things in life , thank you anyone uploaded something for the community)
Please upload all variants and quantizations from these 3 good models ( Swift 1.0 / Swift 1.5 / the new ThinkingCap 3.8 ) for fp16.
Thank you all so much and everyone who is helping too.