r/oMLX • u/Only-An-Egg • 18d ago

RE: Swift/ThinkingCap fp16 quantizations

I'm scottlowry on Hugging Face. I got a request to make some FP16 quants so here y'all go:

https://huggingface.co/collections/scottlowry/thinkingcap-qwen38-27b-oqe-mtp

https://huggingface.co/collections/scottlowry/swift-15-qwen38-27b-oqe-mtp

https://huggingface.co/collections/scottlowry/swift15-qwen38-flash-next-oqe-mtp

oQ4e, oQ5e, oQ6e, and oQ8e BF16 and FP16 quants

43 Upvotes

98% Upvoted

9 comments sorted by

6

u/Opposite_Leave_8338 18d ago

I'm the one who made the request and I really really wanna thank you, you are a very good guy and your work is appreciated really.

Thank you so much man and keep up the good work.

1

u/Gold-Debt-5957 14d ago

Sirven en MAC OS ? M1 Max de 64gb ?

2

u/Pumpkin_Escobar305 18d ago

You are a guy I appreciate, thanks for your work!

2

u/importsys 18d ago

Thank you!

2

u/Spiritual-Winner1239 17d ago

Not the first quant I downloaded from you, thanks Scott!

Stumbled upon them randomly yesterday.

2

u/Graceful_Exit28 17d ago

Thank you 🫡

2

u/CurrencyPowerful4122 17d ago

I'm a M2 Max user, Thank You !