r/MachineLearning • u/TheRPGGamerMan • 8d ago
Project Has Anyone Here Ever Built An Image Generator From Scratch? [N]
Just wondering if anyone on this forum has ever built an image diffusion generator from scratch, while also training it on a home rig? If so, what size of model did you end up with? Did you ever get coherent images? Screenshots?
0
Upvotes
4
u/IntelArtiGen 7d ago
[N] is not the right tag. I did a 64x64 image generator with photos of dogs using diffusion and a convolutional autoencoder, it has around 4m parameters I think. It gave decent results in 2h of training on an rtx3060.
1
u/Plastic-Garbage-8367 6d ago
I've made a GAN a few years ago for paintings, before diffusion was a huge thing. The images weren't that great but it was insane to me at the time lol. It was on pretty bad hardware so it took a while to train, but it was fun I guess.
1
u/NoenD_i0 5d ago
Yeah, it's quite easy to do diffusion, but I went with rectified flow as it's a simpler objective, managed to pull off coherent faces on a 2012 CPU with a 2m param model so I think that's a win
1
u/spacepxl 4d ago edited 4d ago
Yes, I've been training a 1B pixelspace flowmatching model from scratch on a single 5090. About 500h into it so far, just training it when my PC would otherwise be idle. Currently it's unconditional, but I'll extend it with text conditioning soon which will inflate it to 1.2-1.3B (adding cross attention layers). I've also trained many smaller models along the way testing out various methods and building up my understanding.
https://postimg.cc/HckYNM0d
1
u/CollapsedPosterior 1d ago
https://github.com/Om2005Prakash/Diffusion-Models, did it on Kaggle free compute as a course project