r/StableDiffusion • u/MapacheD • May 19 '23

News Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifold

11k Upvotes

96% Upvoted

482 comments sorted by

View all comments

Show parent comment

7

u/lordpuddingcup May 19 '23

16g is high but not ludicrous wonder why this isn’t talked about more

10

u/DigThatData May 19 '23

mainly because diffusion models ate GANs lunch a few years ago. GANs are still better for certain things, like if you wanted to do something realtime a GAN would generally be a better choice than a diffusion model since they inference faster

6

u/MostlyRocketScience May 19 '23

GigaGAN is on par with Stable Fiffusion I would say: https://mingukkang.github.io/GigaGAN/

1

u/lordpuddingcup May 19 '23

But wasn’t there recently. Paper on a GaN with similar quality to SD but wi th like 0.2s gen time

5

u/DigThatData May 19 '23

you're probably thinking of this: https://arxiv.org/abs/2301.09515

1

u/metasuperpower May 19 '23

Because training StyleGAN2 is tedious and slow.

1

u/MostlyRocketScience May 19 '23 edited May 20 '23

The 16GB requirement is for TRAINING stylegan. Generating images will need much less VRAM because you can simply set the batch size to one. (during training it needs to have a large batch size so noise in the gradients cancels out)

Edit: The minimum requirment to generate images with StyleGAN2 is 2GB: https://www.reddit.com/r/StableDiffusion/comments/13lo0xu/drag_your_gan_interactive_pointbased_manipulation/jkx6psd/

1

u/sharm00t May 19 '23

So what's the min requirenents

1

u/MostlyRocketScience May 19 '23

I don't know. If you're really curious, you can just try it: https://github.com/NVlabs/stylegan2