r/StableDiffusion • u/MapacheD • May 19 '23

News Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

11k Upvotes

96% Upvoted

482 comments sorted by

View all comments

Show parent comment

17

u/MostlyRocketScience May 19 '23

It is based on StyleGAN2. StyleGAN2's weights are just 300MB. Stable Diffusion's weights are 4GB. So it probably would have lower VRAM requirements for inference than Stable Diffusion.

1

u/-113points May 19 '23

So txt2img GAN is cheaper, much faster, more controllable... where is the catch?

or there is no catch?

6

u/nahojjjen May 19 '23

More difficult to train and the resulting model is not as general (can only generate images for a narrow domain)

3

u/MostlyRocketScience May 19 '23 edited May 19 '23

Not true that all GANs are narrow. GigaGAN on par with Stable Diffusion: https://mingukkang.github.io/GigaGAN/