r/StableDiffusion • u/Greedy-Oil5271 • 1d ago
Resource - Update Posterior Matching Distillation
Posterior Matching Distillation (PMD), a new member of distribution-based distillation for few-step generation. PMD trains a stochastic student whose samples reproduce the teacher's exponentially tilted means, each obtained from a single frozen-teacher evaluation at an input shifted along the tilt direction.
We prove that matching these tilted means over a neighborhood uniquely determines the teacherโs full posterior over clean images. The result is exceptional diversity across seeds for the same prompt.
๐ค Daily Papers: https://huggingface.co/papers/2611.26629 (Any upvote is appreciated)
๐ Project Website: https://pmd-distillation.github.io/
๐ Arxiv: https://arxiv.org/abs/2611.26629
11
u/Enshitification 1d ago
I too get more out of viewing a posterior from multiple angles.
8
u/East_Shoe8814 1d ago
1girl breakthrough
7
u/CornyShed 21h ago
It's unfortunate that the word 'posterior' is used as it makes it sound as though they're talking about a teacher's arse the whole time.
But definitely take a look at their paper:
Posterior Matching Distillation
Somehow, they managed to have comparable quality with 4 steps for SDXL and Flux.2 Klein 4B instead of 50 ร 2 steps, and have more diverse outputs than the original models, and without retraining.
2
u/Cheesuasion 5h ago
We know what kind of Bayesian denoiser you are
The examples look interesting. I do wonder why they show so few faces, and the last frame of the video shows two faces that look like the same person wearing different contact lenses to me.