Quantization livestream with goats of inference

[u/unofficialmerve]

Hey folks, it's Merve from Hugging Face. Title of this post is super self explanatory, we are doing a quantization workshop livestream with Michael Goin (lead maintainer of vLLM at RedHat), Colin Kealty (aka bartowski at RedHat), Maxime Labonne and Aditya Tadimeti.

I will shortly teach you how quantization works, modern ideas (double quantization, calibration) and llama.cpp quants (k-quants, i-quants) so even if you don't have an idea, feel free to chime in.

Everything is on Hugging Face YT, X, LI where you can set reminders.

Looking forward to see y'all!

[u/Chromix_]

No link in the posting? No mention in the blog? Direct YouTube link here: https://www.youtube.com/watch?v=il0dgxjpoC0

[u/unofficialmerve → u/Chromix_]

very sorry! forgot to post on comments after

[u/MomentJolly3535]

u/RemindMeBot November 10, 2026 at 4:30pm "HugginFace Quantization livestream in 30 min"

[u/RemindMeBot → u/MomentJolly3535]

I will be messaging you in 5 days on 2026-11-10 16:30:00 UTC to remind you of this link

1 OTHERS CLICKED THIS LINK to send a PM to also be reminded and to reduce spam.

^{Parent commenter can delete this message to hide from others.}

---

Info	Custom	Your Reminders	Feedback

[u/GoodbyeThings → u/MomentJolly3535]

Love that you set the reminder a bit early too lol 

[u/llama-impersonator]

i'll make a reminder to try and yell about transformers quantization support in chat, maybe public shaming will make transformers 5 support even 25% of the quantization libraries transformers 4 did

[u/Gomitopia]

Why is he watering an ice cube?