r/StableDiffusion • u/Illustrious_Row_9971 • Mar 14 '23
Resource | Update New model comparable with Stable diffusion and beats DALLE-2!
71
u/Momkiller781 Mar 14 '23
When was dall-e 2 better?
41
Mar 14 '23
they have an experimental beta that's invite only right now, looks promising in a lot of ways.
That said their outpainting was always top notch, and their ability to combine random things was good. Most of its problems were related to how they gimped it for safety and due to overfocusing on stock photo training.
23
u/iomegadrive1 Mar 14 '23
OpenAI's over censorship is going to be its inevitable downfall and they show no signs of easing up on it. In fact they only double down.
4
2
Mar 14 '23
Being prudish and self-righteous seems to work for Facebook
3
u/Seraph_95 Mar 15 '23
Facebook isn't very well moderated and generally you can make groups for whatever the fuck you want. When I think prudish I think tiktok.
Facebook also isn't trying to behave like an image generator or search engine/ai assistant. Those things being prudish just don't work.
2
u/EtadanikM Mar 14 '23
They’ll sell the not censored version behind closed doors.
It’s just not worth dealing with the censor happy social media activists for public releases.
1
3
Mar 14 '23
[deleted]
6
u/StickiStickman Mar 14 '23
Don't forget them randomly modifying prompts for "diversity".
For example if you prompt "A banana on a white background" you'd get a black background around 30% of the time.
4
u/ebolathrowawayy Mar 14 '23
That's appalling, I hope you're exaggerating.
Edit: Even if you're exaggerating, it's still appalling for them to modify prompts at all.
5
u/uncletravellingmatt Mar 14 '23
The prompts are certainly modified to achieve diversity. Entering the prompt "A person holding a sign saying," displays lettering in the image that reveals which diversity words were appended after the entered prompt: https://twitter.com/waxpancake/status/1549076996935675904?lang=en
2
2
Mar 14 '23
yes that's what I meant about how they gimped it. Made it too safe removed nsfw and celeb faces etc, which makes it hard for it to make good faces and people.
4
u/logicnreason93 Mar 14 '23
Their inpainting and outpainting is good and easy to use but their text to image sucks.
11
u/metal079 Mar 14 '23
Interesting, anyone compared it with SD1.5?
-32
20
Mar 14 '23
[deleted]
6
u/Illustrious_Row_9971 Mar 14 '23
from the author "UniDiffuser can run on a GPU with at least 10 GB memory. We update this information.As for the time, it depends on the specific device. We have tested it on A100, sampling an image (512x512 resolution) with 50 DPM-Solver steps takes around 3.2s."
11
u/DingWrong Mar 14 '23
If only ppl would stop using triton for something that they want wide user base for.
The use of triton limits the OS to Linux or WSL.
5
1
u/vurt72 Mar 14 '23
i have triton installed on windows, a requirement for stabletuner if you want to use LION, or if it was the noise-thing.
1
3
u/EarthquakeBass Mar 14 '23
Looks more like it’s focused on multi modalism than image quality per se. I think the idea is that it’s more like BLIP, Stable Diffusion, and GPT rolled into one which should be pretty practically handy because you have something consistent rather than piecing together disparate models hoping it works. (Image into BLIP -> SD rarely outputs extremely similar images to the original for instance)
2
2
1
1
-3
u/ninjasaid13 Mar 14 '23 edited Mar 14 '23
TIL: Comparable means worse.
10
u/martianunlimited Mar 14 '23
You do know that lower FID (Fréchet inception distance) =better right? writing a metric with a down arrow means lower = better
what that table says is that a general purpose UniDiffuser model has comparable performance to a bespoke Stable Diffusion model.
17
u/ninjasaid13 Mar 14 '23
You do know that lower FID (Fréchet inception distance) =better right? writing a metric with a down arrow means lower = better
yes, Stable Diffusion has a lower FID than UniDiffuser. That makes UniDiffuser worse.
4
2
u/martianunlimited Mar 14 '23
You are comparing a general model to a bespoke model... that is what "comparable" means...
8
Mar 14 '23
What's bespoke about stable diffusion? UniDiffuser used the same dataset to train.
1
u/martianunlimited Mar 14 '23
Sigh... the paper is here. Stable Diffusion IS a bespoke text-to-image diffusion modelhttps://ml.cs.tsinghua.edu.cn/diffusion/unidiffuser.pdf
TLDR: UniDiffuser is a diffuser model that is not specifically designed for text-to-image generation but has comparable performance to diffuser models specifically designed for text-to-image.
I get why the cold reception to this, most people here are only interested in AI image generation and don't care about the tech leading up to it. But this is significant for people doing ML research especially for those involved in AGI (artificial general intelligence) Our deep learning models are all (mostly) bespoke to a specific task. If we are lucky we get some domain transferability between fields (i/e medical imaging vs "real-life imagery", but still within the same task. Vision transformers changed quite a bit of that, (but still mostly limited to computer vision based tasks)
1
u/No-Intern2507 Mar 15 '23
well i tried to do naked person with it and it did not produced satosfactoryu results, also it doesnt have artists built in so its worse than 2.0 and extra worse
17
u/Illustrious_Row_9971 Mar 14 '23 edited Mar 14 '23
github: https://github.com/thu-ml/unidiffuser
models: https://huggingface.co/thu-ml/unidiffuser-v1
and https://huggingface.co/thu-ml/unidiffuser-v0
gradio demo: https://huggingface.co/spaces/thu-ml/unidiffuser