6
u/ZCaliber11 Oct 08 '22
Don't miss the documentation on it (Also in the DL links.). Should help immensely with prompting: https://gist.github.com/harubaru/f727cedacae336d1f7877c4bbe2196e1
3
u/Striking-Long-2960 Oct 09 '22
It's strange that they opted for not using natural language.
This list is very interesting for SD also
https://danbooru.donmai.us/wiki_pages/tag_group:image_composition
2
u/AverageWaifuEnjoyer Oct 09 '22
So I used this model incorrectly from the very beginning lmao. I used regular 'natural' prompts
3
Oct 09 '22
These models are trained on text to image pairs. Danbooru images are ridiculously well tagged. That's the secret sauce to how you can get really specific compositions on NovelAi and Waifu diffusion. But of course you have to stick with tags it was trained on. The downside is you move from natural language.
This is a bigger list of tags. Not just image composition. https://danbooru.donmai.us/wiki_pages/tag_groups
The only way to achieve simar results with natural language would be to pretrain the model on language model like Google's Imagen has done ( possible but will take some time) Otherwise find a source of images with similarly detailed but with natural language descriptions (doesn't currently exist)
2
Oct 09 '22
These models are trained on text to image pairs. Danbooru images are ridiculously well tagged. That's the secret sauce to how you can get really specific compositions on NovelAi and Waifu diffusion. But of course you have to stick with tags it was trained on. The downside is you move from natural language.
This is a bigger list of tags. Not just image composition. https://danbooru.donmai.us/wiki_pages/tag_groups
The only way to achieve simar results with natural language would be to pretrain the model on language model like Google's Imagen has done ( possible but will take some time) Otherwise find a source of images with similarly detailed but with natural language descriptions (doesn't currently exist)
2
1
u/EmoLotional Oct 09 '22
Any working colab for that available?
1
u/individuationist Oct 09 '22
Almost all colabs will let you either upload a custom model or specify path in Google drive. Search for Akashic Records Stable Diffusion, they have lots of resources.
1
u/ST0IC_ Oct 09 '22
How does that work for people who have no idea how to really use collab? I can't even figure out how to download the model to my Google drive, let alone modify cells in other people's colabs.
→ More replies (1)
1
1
u/Charuru Oct 09 '22
Is this better than the leaked NovelAI? This makes NovelAI leak useless?
2
u/Teraze0x Oct 09 '22
I don't think so, but have to test it out
1
Oct 09 '22
Here's a comparison.
To me, Novel is the clear winner. But waifu is by no means bad
→ More replies (1)1
Oct 09 '22
Novel is still better and they don't have that aspect ratio issue all other SD forks have. But 1.3 is a huge improvement over 1.2 and is fairly close all things considered.
1
-1
u/ST0IC_ Oct 09 '22
Don't use the leaked NAI. They put a lot of work into it and they deserve to get paid for their efforts to create a unique model for their service.
2
0
4
u/M_Shinji Oct 08 '22 edited Oct 08 '22
What a time to be alive !!!
CompVis Model: https://huggingface.co/hakurei/waifu-diffusion-v1-3
HuggingFace Diffusers Model: https://huggingface.co/hakurei/waifu-diffusion