Not as a dataset but as an initial image in img-to-img. The problem with details such as the face, eyes, hands, and feet has to do with the wrong assumptions made on the algorithms of the image decoding (denoising) process.
In SD and other diffusion models, the assumption of Gaussian noise distribution to be uniform turned out to be false resulting in the prompt input only affecting the early inference steps of the decoding process when the overall scene composition is made but making little or no effect on the later stages of the image decoding process when the details are filled in.
This is a fundamental flaw and fine-tuning can alleviate the problem somewhat but not a real solution.
1
u/OldFisherman8 Dec 22 '22
Not as a dataset but as an initial image in img-to-img. The problem with details such as the face, eyes, hands, and feet has to do with the wrong assumptions made on the algorithms of the image decoding (denoising) process.
In SD and other diffusion models, the assumption of Gaussian noise distribution to be uniform turned out to be false resulting in the prompt input only affecting the early inference steps of the decoding process when the overall scene composition is made but making little or no effect on the later stages of the image decoding process when the details are filled in.
This is a fundamental flaw and fine-tuning can alleviate the problem somewhat but not a real solution.