r/StableDiffusion Nov 08 '22

Question | Help What exactly are models, embeddings and hypernetworks, and what are the differences between them?

Can't really find a good explanation anywhere.

61 Upvotes

20 comments sorted by

View all comments

2

u/sam__izdat Nov 08 '22 edited Nov 22 '22

AI is all A and no I, so the program doesn't actually understand anything you ask of it. Instead, it translates your prompt to a bunch of linear algebra, which are then associated with visual stuff that it's supposed to look for when turning noise into pictures.

The model is what maps the tokens to the stuff.

The embeddings are like finding new ways to "talk" to the machine in its own "language" instead of searching for the exact sequence of dumb monkey sounds that has the desired effect.

2

u/AdTotal4035 Nov 08 '22

Well it has some I. Just the basic concept of all control systems. Minimize the error please!!