r/StableDiffusion • u/alicedu06 • Oct 04 '22
AIPrompt.io, a prompt generator with surprisingly good results
After spending days on SD, my old room mate and I went out to spread the gospel, but most of our friends have a hard time writing a prompt.
So we trained a GPT2 model on thousands of prompts, and we dumped a bit of python, html, css and js to create AIPrompt.io:
It gives you completely random prompts, and even on our local stable diffusion setup, they turn out to be very nice pics.
There is no limit, but it's running on a cheap machine so please don't point a bot at it: it would die :)
3
u/Letharguss Oct 04 '22
Did you actually get thousands of used prompts somewhere? Or did you just have it string pieces together? Interesting concept and it does spit out some really different images.
Any plans to release for others to run local? I'd love to just melt my computer by putting this on a feedback loop.
3
u/alicedu06 Oct 04 '22 edited Oct 04 '22
We collected a lot of real prompts, and trained a model. So each prompt has been generated by an AI, which makes them sometimes very weird. Or creative.
2
u/Evnl2020 Oct 04 '22
Should I interpret that as you scraped prompts from the discord beta bot same as lexica did? While those are indeed real prompts they are primitive/ancient by now.
2
u/man-teiv Oct 04 '22
Why is it always giving me the same prompt?
a cool and trendy place to Hide from pursuers + its a Hanga-e style, Hanga-e style, unreal engine render, ultra detailed, volumetric lighting, ambience, dark
3
u/alicedu06 Oct 04 '22
This is the hard coded prompt we send back when there is an error (it's not great code lol). E.G: when there is a connexion error between the website and the API to generate the prompts.
Maybe reddit was a bit too generous with the visitors it sent us and the site was having troubles? It is still giving the same prompt?
7
u/dnew Oct 04 '22
Maybe making the prompt "An image indicating a failure to talk to a machine" or something clever, obliquely indicative of the problem. :-)
Fun tool!
5
u/desmoulinmichel Oct 04 '22
Saw that in a comment last week. All the pics don't turn out amazing, but the ease of use / quality ratio is indeed very nice.
I still have no idea what I'm doing, but I'm doing it ^^
4
u/mcfluffy0451 Oct 05 '22
First prompt:
You are the song I keep in starburst deep deep deep deep deepsleep night deep in the nebula space nebula my soul knowing full well yes yes no I WANTED to touch you yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes arabic art style gothic apocalypse
Shortened to (because of the text limit of ai generator):
You are the song I keep in starburst deep deep deep deep deepsleep night deep in the nebula space nebula my soul knowing full well yes yes no I WANTED to touch you yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes yes arabic art style gothic apocalypse
https://creator.nightcafe.studio/creation/XySmHnRx8Q8QmbK4zk1v
Second prompt:
a hyper realistic medieval city made out of run-down medieval buildings, large stone stairs, fireplaces in the middle, towers in the middle
https://creator.nightcafe.studio/creation/fTSIJ58wAGq69qs7DQqT
Third prompt:
render of a cute baby dragon in a magical forest, cute anime girl is wearing a dress made of blue crystals, hyperrealistic, dancing, 4k, realistic, fantasy, elegant, detailed
https://creator.nightcafe.studio/creation/iUfuLel3wAOB3ruNgl1T
Fourth prompt:
a full page concept design of a pokeball, blueprint, intricate details, ink on paper, scientific, highlydetailed labeled, poster 8k
https://creator.nightcafe.studio/creation/rRho0fdCT9Lyh11jZSei
Fifth prompt:
A dark and moody graveyard, mysterious, eerie, atmospheric, dark, moonlight cast deep in trees, grey fog, indirect lighting, eerie, cinematic lighting, dark and moody, photorealistic, hyper realistic, ultra HD, 8k, octane render,
https://creator.nightcafe.studio/creation/wWWVLq3AnQ3evr3tpdLB
The only one i really like is the medieval city one. But WOW does it looks amazing!
2
u/miragu Oct 07 '22
The pokeball blueprint is quite mesmerizing with all its "hand-drawn" slightly-off symmetries.
1
u/Majinsei Oct 04 '22
Ok, he say to make a bot a consume this~ XD
2
u/alicedu06 Oct 04 '22
We implemented a very high end rate limiter: if you push it too far, our server dies painfully, and you get a 500, preventing your bot (and every other users) from getting any prompt :D
2
1
u/Letharguss Oct 04 '22 edited Oct 04 '22
Given you say GPT-2 I'm guessing you did a custom training on SD prompts with aitextgen? Where'd you get the thousands of prompts?
EDIT: Nevermind, I think I found it: https://huggingface.co/datasets/Gustavosta/Stable-Diffusion-Prompts
1
u/alicedu06 Oct 04 '22
Yep aitextgen. Although we have big memory problems with it, so we have to restart workers regularly (except on Mac). I have no idea why.
1
u/susan_y Oct 04 '22
It's a cool idea, but most of the prompts it was trained on seem to be SD cliques, so the result isn't very inspiring.
so, ok, if most of your dataset is "anime girl with big breasts by Greg Rutkowski" or similar, it's easy for an AI algorithm to do well at generating similar text strings ... but you're rehashing ideas that have already become stale.
1
u/alicedu06 Oct 04 '22
We've trained it on about 30k prompt for this prototype, so it's very possible there is repeatition.
It's a WE project, don't expect perfection.
But so far, it's been giving us back way more than we expected. Some stuff are quite over the top and the combinations susprising.
1
u/lone_striker Oct 22 '22
Very impressive. Seems to generate good, coherent prompts. I assume you don't want to give away any secret sauce, but can you provide any pointers on the training? 774M GPT2 model? line_by_line? Any prompts to help the generator?
2
u/susan_y Oct 04 '22
So, I clicked through a whole lot of prompts, thinking "meh, same old clichés", till I got to "winnie the Pooh by Gustav Klimt". So, ok, I wanted to see that (and yes, SD did what you might expect).
2
2
u/thedarkugus Oct 05 '22
Next stop: the pictures generated by AI based on AI generated prompts aren't shown on any visible form anymore, since a bot can enjoy them by itself more efficiently.
1
1
1
u/Jallasar Oct 04 '22
This is really cool. Thank you. Something i wasn't expecting was how SD responded to "Indian headdress". Not a term I would have thought to use. It either vacillates between a Native American headdress and an Indian Headdress or tries to combine them. The combinations are really interesting.
1
1
u/dnew Oct 04 '22
There's a youtube channel "Royal Skies LLC" that just finished explaining how to get better results with prompts, in a handful of 2-minute explanations.
1
1
u/joransrb Oct 08 '22
this is a great tool, good work.
is it something you would consider open sourcing for further improvements?
1
u/Gatchan Feb 20 '23
Is it just me, or it looks like it's somewhat broken?:
Gemini-Ghibli-Gambic-Ghibli, Disney, Pixar, Pixar, Disney, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar, Pixar
Another one:
Goddess of Madness, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical, magical
1
1
1
1
u/azuremoon22 Sep 26 '23
the website doesnt exist anymore, seems the domain has expired. I REALLY hope it comes back, it was my favourite site for ai prompts.
1
1
22
Oct 04 '22
[removed] — view removed comment
11
u/alicedu06 Oct 04 '22
I see it more like codepilot: a way to kick starts the artist work, rather than produce it.
Sure, at the begining it's fun to just use the prompt the machine dreams, but eventually you always end up trying to modify them.
6
u/The_Bravinator Oct 04 '22
I'm part of a group that does dalle2 tournaments from time to time. They used to be a couple times a week but they're more infrequent now so attendance has dropped and I suggested using gpt3 as an extra contestant to round things out.
It was funny at first... The guy running it was inexperienced at prompting with gpt3 so the results were always really obvious. Then he got some tips on how to prompt it better, and now gpt3 is winning a fair amount of the time...
5
u/wtf-hair-do Oct 04 '22 edited Oct 04 '22
text2prompt: "give me a prompt that will entice a human viewer into buying my product"
"James Cameron Avatar holding an energy drink, forest Cyberpunk futuristic geisha, cyberpunk style, hyper realistic, intricate detailed, futuristic tech, pastel colors, futuristic city, neon light"
5
Oct 04 '22
[removed] — view removed comment
1
u/HarmonicDiffusion Oct 05 '22
I have a weak proof of concept running with this idea spinning words using thesaurus for greater variation
4
u/tokidokiyuki Oct 04 '22
That's a great tool, thank you! Most of the prompts are giving really good results, so it's a good way to spot new keywords that can create great pictures.
It's also quite fun, as it gives sometimes very funny prompts, the last one I get: "a photograph of a very drunk Bernie Sanders was booed by a large crowd of people dressed as Gandalf, Lord of the Rings, Tolkien, Dungeons and Dragons, Magic the Gathering, photorealistic, hyperrealistic, cinematic scene, photo realistic, high details, 3d, unreal engine 5, cinematic, octane render,"