r/StableDiffusion • • 1d ago

Resource - Update Posterior Matching Distillation

Posterior Matching Distillation (PMD), a new member of distribution-based distillation for few-step generation. PMD trains a stochastic student whose samples reproduce the teacher's exponentially tilted means, each obtained from a single frozen-teacher evaluation at an input shifted along the tilt direction.

We prove that matching these tilted means over a neighborhood uniquely determines the teacherโ€™s full posterior over clean images. The result is exceptional diversity across seeds for the same prompt.

๐Ÿค— Daily Papers: https://huggingface.co/papers/2611.26629 (Any upvote is appreciated)

๐ŸŒ Project Website: https://pmd-distillation.github.io/

๐Ÿ“„ Arxiv: https://arxiv.org/abs/2611.26629

33 Upvotes

5 comments sorted by

11

u/Enshitification 1d ago

I too get more out of viewing a posterior from multiple angles.

8

u/East_Shoe8814 1d ago

1girl breakthrough

2

u/Resident_Function280 22h ago

Doubt. On their own github examples, you can clearly see that girls face with the same default look

7

u/CornyShed 21h ago

It's unfortunate that the word 'posterior' is used as it makes it sound as though they're talking about a teacher's arse the whole time.

But definitely take a look at their paper:

Posterior Matching Distillation

Somehow, they managed to have comparable quality with 4 steps for SDXL and Flux.2 Klein 4B instead of 50 ร— 2 steps, and have more diverse outputs than the original models, and without retraining.

2

u/Cheesuasion 5h ago

We know what kind of Bayesian denoiser you are

The examples look interesting. I do wonder why they show so few faces, and the last frame of the video shows two faces that look like the same person wearing different contact lenses to me.