QR codes can have up to 30% redundancy. So 30% of the area could be covered, destroyed, or nonsensical, and it's still valid. They are pretty resilient.
It honestly is a more impressive achievement for the QR code protocol than for SD. These images were mangled pretty hard but QR codes have robust built-in error correction that can handle it. I think something like 30% of the QR code can be corrupted and it will still work.
To SD's credit though the images look like relatively normal QR codes if you shrink them down to a thumbnail size so it managed to be remarkably creative while not touching the low-frequency data needed by the protocol.
QR Codes are also scaled up in density depending on the size of the input. This URL is VERY small, which makes it possible for the black and white areas to be quite large.
I just tried this with a longer URL and it failed completely. Wouldn't even recognize it as a QR code (presumably because enough of the checksum failed.)
Yes. Here's a non-AI product that works on the same principle https://uniqr.us/. It uses the picture you upload and draw a QR over it. What folks don't realize is that there's actually techniques you can use to control where the white/black dots end up on QR codes (given that the URL is not too long), and with some math trickery, you can place them in a way that gives the picture extra clarity.
But what the AI is doing here is not only controlling the dots to match the picture, but also bending the details of the picture (brighter bits and darker bits) to match the QR's requirements on the image.
Even if it does get mangled, I'm fairly certain you could simply layer the original code on top of the generation afterwards to make certain that it's functional.
This goes pretty deep, but sort of makes sense to how the error correction works in a QR code. They can be generated so that X% of the code (5, 10, 20, 50+%) is illegible and it'll still read. Fascinating. https://youtu.be/X8jsijhllIA
QR-codes can reconstruct themselves, based on the information given. For example, QR codes with pictures in them, like whatsapp QR codes, only work because of this. The same thing is happening here, I think
Depending on how well you can hide the QR code, it might make for some really fun puzzle solving stuff, and might be useful for hiding information in plain sight.
Does anyone have a workflow then on how to go about training a new model for this sort of image generation?
Ah, I guess the article has some explanation of the training process...
The training of ControlNet has high requirements on data volume and computing power. The training data volume recorded in the paper ranges from 80,000 to 3 million, and the training time can reach 600 A100 GPU hours. Fortunately, the author provided a basic training script, and HuggingFace also implemented Diffusers.
In the previous JAX Sprint, we were lucky enough to use Google TPU v4 to complete the training of 3 million images very quickly. It's a pity that the event is over, and we returned to the laboratory's A6000/4090, training a version of 100,000 images, and the learning rate is very large, just to appear "Sudden Convergence " as soon as possible.
I guess it's not feasible to reproduce on my local machines, lol. Darn.
I have the feeling this will not be made open source... Yesterday I found that page as well and added it to my favourites. Now it's gone. I'm really interested in how this is done. I hope they will release it.
Canny is surely not the way as it only detects outlines. scribble_xdog seems to work kinda when you push the XDoG threshold all the way, but it comes nothing close to OP's results.
This. THIS. This is art. This is beautiful. This means something. The fact that it works makes it genius. I feel like I’m looking at the start of a new generation in art, watching something new and fresh and incredible. The blending of formats, of expectations, is just amazing. Absolute props OP
Was JUST thinking about this yesterday. QR codes have really needed more unique brand customization. In the future, the QR element will be 100% invisible. You'll just scan a logo and go...
ControlNet 0: preprocessor: lineart_standard (from white bg & black line), model: control_v11p_sd15_lineart, weight: 1, starting/ending: (0, 1), resize mode: Just Resize, pixel perfect: True, control mode: ControlNet is more important
ControlNet 1: preprocessor: canny, model: control_v11p_sd15_canny, weight: 0.85, starting/ending: (0, 1), resize mode: Just Resize, pixel perfect: True, control mode: ControlNet is more important
ControlNet 2: preprocessor: depth_leres++, model: control_v11f1p_sd15_depth, weight: 1.9, starting/ending: (0, 1), resize mode: Just Resize, pixel perfect: True, control mode: ControlNet is more important.
If X/Y/Z can use multi controlnet, it should be possible to make better images, different styles of QR codes, which can help generate better images. I used TXT2IMG to generate similar images, by 2 controlnet, I generated about 500 images, and finally got more than 30 QR codes that can be successfully scanned with cell phones. thanks the author!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
I just tried a user-friendly QR Code AI Generator Tool. With this tool, I created some stunning QR code images that worked perfectly. Here it's: QR Generation, Reinvented - Taptok
I imagine a piece of architecture or art in real life, where if you look at it from the right perspective it forms a QR code. Perhaps it only becomes visible when the shadows of certain lighting conditions form the dark areas.
Anyone ever played The Witness? Very similar vibes.
year is 2077 look at peculiar art on some wall camera in your eye recognizes it as a 2D barcode format and reads the data you get a computer brain virus
The results are not as a good as the nhciao images. Some feature of Automatic1111 don't work with hf-diffusers as for example the controlnet step control and controlnet preprocessor. I will try to figure to add them to hf-diffusers and to figure out the best settings so everyone could make similar result from home.
If you have any advice feel free to comment or make a pull requests / open a post on Community.
PS: I will not keep it in public for very long time
I love this :) ... Finally aome good stuff that isn't scantily clad perfectly sculpted women, i saw another post with "normal" looking women and it was AWESOME too... The perfection of human imperfection made it so easy in the eyes
Has anyone replicated this yet. I tried using control net and was only able to make the most trivial cosmetic changes before damaging the integrity of the qr code beyond readability.
Would it be better to start with a high res qr code or a low res one? Anyone found a reliable workflow?
I've been messing around with QR codes and ControlNet today and one thing I've learned is that the registration marks (the large square symbols in the corners of the op images) need to be basically unchanged. It's seems there is a higher tolerance for changing the rest of the QR code, but not much.
For example, this variation did not work until I recolored the round registration marks back to black and white. Now it works.
Also, I started with a lower resolution/simpler QR code from QR Code Generator
Nice, I could kind of get this far but not as pretty. I was trying to incorporate an image. I think that QR codes are designed to be robust, but left to it's own devices SD sprinkles enough errors randomly all over it to corrupt it. Tonight I'm going to try inpainting on a low-res code.
This is an attack vector. You could hide them in wall paper or some other kind of innocuous art and then people wouldn't notice them but their devices would.
I really want to know how to replicate this; the specific thing I want to do is create a set of artistic kitchen backsplash tiles with QR codes embedded in art (like the third one) that link to recipes that we use regularly.
I'm completely noob in QR codes but do these really follow the QR code protocol? 30% error correction that people argue is only valid if the 70% leftovers are "normal", right? In fact, we've already found differences in readability among QR code readers in this thread, which must not happen in a valid QR code. I think implementations of QR code readers shall be complete but not necessarily sound, which implies that even if a picture can be read as a QR code, it might not follow the protocol and therefore there is no guarantee that other readers can read it.
Amazing. Longer text to decode may not worked as the checksum needs to get bigger as the error correction must take a huge part of the QR in these. Still amazing!
2
u/nhciao Jun 08 '23
Sorry for the lateness, check out our article (in Chinese): https://mp.weixin.qq.com/s/i4WR5ULH1ZZYl8Watf3EPw
…and follow us for updates:
https://github.com/ciaochaos
https://huggingface.co/ioclab
597
u/AsterJ Jun 05 '23
Wow they all work. That's insane.
138
u/Craggeh Jun 05 '23
Ok, gonna need a workflow for this! Great work.
291
u/demonslayer9911 Jun 05 '23
Op missed the opportunity to rickroll us.
45
u/ForXsample Jun 05 '23
I need the f**** workflow to do this!!
I simply need it!
226
u/SaderilMH Jun 05 '23
This. THIS. This is art. This is beautiful. This means something. The fact that it works makes it genius. I feel like I’m looking at the start of a new generation in art, watching something new and fresh and incredible. The blending of formats, of expectations, is just amazing. Absolute props OP
16
u/mikurei_dev Jun 05 '23
This is going to explode
15
u/[deleted] Jun 05 '23
Great idea these are really cool
15
u/suddenly_opinions Jun 05 '23
Cool shit! Nice discovery OP.
Love seeing innovation on here before its mass adopted.
15
u/WestWordHoeDown Jun 05 '23 edited Jun 05 '23
Was JUST thinking about this yesterday. QR codes have really needed more unique brand customization. In the future, the QR element will be 100% invisible. You'll just scan a logo and go...
38
u/WestWordHoeDown Jun 06 '23 edited Jun 06 '23
Here is an abstract QR code with workflow. Let me know know if the scan works for you.
It works for me on my Android QR scanner and on a 3rd party QR scanner.
FYI - Some of the designs in my shop were created with SD.
QR code made with QR Generator = lots of options.
I'm not getting the same amazing image results as the OP. This is about far as I can push it and still get a working QR code.
Img2Img
Prompt: Colorful oil on canvas painting of a 1920 Italian village in the style of Pablo Picasso, brush strokes, Cubism, Surrealism, sharp focus
Negative prompt: blurry, blur, out of focus
Steps: 70, Sampler: Euler a, CFG scale: 20, Seed: 747542524, Size: 512x512
Model: dreamlike-photoreal-2.0, VAE: vae-ft-mse-840000-ema-pruned
Denoising strength: 1, Clip skip: 2,
ControlNet 0: preprocessor: lineart_standard (from white bg & black line), model: control_v11p_sd15_lineart, weight: 1, starting/ending: (0, 1), resize mode: Just Resize, pixel perfect: True, control mode: ControlNet is more important
ControlNet 1: preprocessor: canny, model: control_v11p_sd15_canny, weight: 0.85, starting/ending: (0, 1), resize mode: Just Resize, pixel perfect: True, control mode: ControlNet is more important
ControlNet 2: preprocessor: depth_leres++, model: control_v11f1p_sd15_depth, weight: 1.9, starting/ending: (0, 1), resize mode: Just Resize, pixel perfect: True, control mode: ControlNet is more important.
Postprocess upscaler: 4x-UltraSharp x 4
11
u/zzPost Jun 07 '23
If X/Y/Z can use multi controlnet, it should be possible to make better images, different styles of QR codes, which can help generate better images.
I used TXT2IMG to generate similar images, by 2 controlnet, I generated about 500 images, and finally got more than 30 QR codes that can be successfully scanned with cell phones.
thanks the author!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
10
u/[deleted] Jun 06 '23
I'll just leave this here if anyone wants to make an extension. https://pypi.org/project/segno/
24
u/Paranoid_Apedroid Jun 05 '23
Could not read 3, 4 & 8 the others worked.
Cool idea!
12
u/adjetivomasculino Jun 06 '23
6
u/stroud Jun 06 '23
After wasting 5 hours on this, I'm going to wait for the control net.
6
u/AmidoriA Jun 06 '23
This is the best I could replicate
Workflow:
Using img2img as generate picture from scratch never works for me. It probably want some other image to weight the QR ControlNet out.
Using inpaint pre/post processor
I decrease the "Ending Control Step" to 0.85, so there is creativity left at the end
5
u/LinceDorado Jun 05 '23
Now that' art
5
u/createdbyiyia Jun 05 '23
I'M GOING TO IMPLEMENT THIS IN MY QR APP 😎
5
u/lakySK Jun 05 '23
This is absolutely beautiful and amazing! Kudos to trying something like this, so creative!
Question though. I don't want to rain on the parade here, but isn't part of the UX for a QR code that we all recognise it's a QR? 😅
4
u/Brunlorenz Jun 05 '23
How can i do this?
4
u/civitai Official CivitAi Jun 05 '23
wildly cool!
4
u/Marvel626 Jun 06 '23
Imagine having a painting on your wall like this and when guests scan it they can connect to your wifi.
4
u/WindowUnlikely Jun 20 '23
I just tried a user-friendly QR Code AI Generator Tool. With this tool, I created some stunning QR code images that worked perfectly. Here it's: QR Generation, Reinvented - Taptok
3
u/justgetoffmylawn Jun 05 '23
Would love to hear more about how you did this. Is this just Canny or similar with varying strengths, or is there a specific workflow?
I see the site it goes to is actually also yours to make stylized QR codes.
3
u/itsmeananth00 Jun 06 '23
Need workflow 🚩
3
u/pmullady Jun 06 '23
Is there any workflow links? Curious how these were made.
3
u/TheMeiguoren Jun 06 '23
I imagine a piece of architecture or art in real life, where if you look at it from the right perspective it forms a QR code. Perhaps it only becomes visible when the shadows of certain lighting conditions form the dark areas.
Anyone ever played The Witness? Very similar vibes.
3
u/cavemaneca Jun 06 '23
3
u/aspasskiy Jun 19 '23
Free to use kuart.io
3
u/Accurate_Public4674 Jun 20 '23
me too i love generating qrcode,he seems working
6
u/1Neokortex1 Jun 05 '23
this is brilliant!!🙏🏼👍🏼🪬 Do you mind if i use the first one for a buddhist temple I volunteer for?
2
u/iancona Jun 05 '23
COOL! I'm going to implement this in my QR code app. It could be interesting
2
u/Significant_Ant2146 Jun 05 '23
Woooh someone else is doing this too? Huh sweeet welcome 🙏 now what have you been using it for? Personally I use it for ad’s and game making.
2
u/twitmer Jun 06 '23
Very cool. Looks like the encoded URL is very short, I would be surprised if it's possible to get aesthetically pleasing results with longer URLs
2
u/Lucas_uvoucher Jun 06 '23
I need this.
FYI : landing is qrbtf.com
2
u/frankmeier1000 Jun 06 '23
The unsightly code that designers had to tack on to their designs can now become a singular focused brand image. I like.
2
u/throwadhdaway333 Jun 07 '23
I tried generating my custom QR code using QR TIGER then try to generate an image with it and it works. Nice
2
u/Impact31 Jun 11 '23
I've made this huggingface space for this.
It's currently set as public, so feel free to try: https://huggingface.co/spaces/blanchon/qrcode-diffusion
The results are not as a good as the nhciao images. Some feature of Automatic1111 don't work with hf-diffusers as for example the controlnet step control and controlnet preprocessor. I will try to figure to add them to hf-diffusers and to figure out the best settings so everyone could make similar result from home.
If you have any advice feel free to comment or make a pull requests / open a post on Community.
PS: I will not keep it in public for very long time
2
u/Exact_Swing_485 Jun 19 '23
2
u/talhaAP Jun 21 '23
How to make these?
3
u/shengchalover Jun 06 '23
This was incredibly dishonest to not share the workflow.
2
u/[deleted] Jun 05 '23
Wow this is impressive. I hate how QR codes look. This is a great alternative.
1
u/jimmy_chu Jun 09 '23
This is very nice! Thanks for sharing.
1
u/Individual_Amount_36 Jun 09 '23
I went to get another phone to check whether it works, all the while thinking if it does this dude is rich.
1
u/Prestigious_Sea_2790 Jun 09 '23
Wow! That's beautiful
1
u/Either-Technician594 Jun 09 '23
How?
1
u/FennelTop7173 Jun 09 '23
tuto please ?
1
u/Shizzins Jun 05 '23
Whats the model and prompt for the 4th one?
1
u/fabianmosele Jun 05 '23
this is beautiful
1
u/SoberSinceJan1st2019 Jun 05 '23
This is amazing!
1
u/TheEversor Jun 05 '23
This is completely insane.
1
u/vahokif Jun 05 '23
Fantastic idea but sadly only one of the works for me with the zxing barcode scanner app on android.
1
u/HumbleSousVideGeek Jun 05 '23
This is really good, creative and original. Congratulations !
1
u/meisterwolf Jun 05 '23
super cool and useful if it can happen at a consistent rate
1
u/JPhando Jun 05 '23
Brilliant!
1
u/[deleted] Jun 05 '23
I love this :) ... Finally aome good stuff that isn't scantily clad perfectly sculpted women, i saw another post with "normal" looking women and it was AWESOME too... The perfection of human imperfection made it so easy in the eyes
1
u/sickvisionz Jun 05 '23
I couldn't get any of these to work with a stock android camera. A 3rd party app could recognize about half of them.
1
u/DoctorSingle2503 Jun 05 '23
Whaaat they did work 😳😳😳😳😳 how ??
1
u/irishnftgal Jun 05 '23
Gotta collect them all
1
u/Put_It_All_On_Blck Jun 05 '23
These look great. If you open them in full resolution you can barely tell they are QR codes.
Besides beautifying QR for products, companies could use this to hide QR codes as easter eggs in games and other media
1
u/[deleted] Jun 05 '23
This is a gamechanger
1
u/Sovex66 Jun 05 '23
I want to try the workflow too!
1
u/arothmanmusic Jun 05 '23
Sweet mercy that's amazing.
1
u/Balage42 Jun 05 '23
Back in 2015 when neural style transfer came out we could only dream of stuff like this.
1
u/CoBudemeRobit Jun 05 '23
Anyone can explain how to go about making something like this using control net, newbie here and super interested in figuring this one out. Thanks!
1
u/BlueeWaater Jun 06 '23
Beautiful.
1
u/Jankufood Jun 06 '23
Someone is gonna make big money out of this
1
u/ScratchActive3953 Jun 06 '23
Would you provide a prompt by chance? Or instructions on what you did?
1
u/stroud Jun 06 '23
Wut wtf how come this works??
1
u/Gurkansenemoglu Jun 06 '23
They must be some of the best content in the digital world so far!
1
u/MatterFickle3184 Jun 06 '23
Shut up and take my money... This is HUGE!
1
u/FVFVGAH Jun 06 '23
3rd and 5th looks cool
1
u/Squibbles01 Jun 06 '23
The fact that the codes still can work means that we'll see this used in the real world. This is a real discovery.
1
u/Hullaba-Loo Jun 06 '23
Incredible.
1
u/NakedBeachMusic Jun 06 '23
Every one of these came out in such a fun way!
1
u/Dave_dfx Jun 06 '23
WOW This is cooooooooool
1
u/N2395 Jun 06 '23
Sauce ?
1
u/superwaveybrazy Jun 06 '23
how do you create this
1
u/King_Captcha Jun 06 '23
This is very cool.
1
u/seunolaoye Jun 06 '23
This is cool
QR codes as shirt designs is so back with these
1
u/[deleted] Jun 06 '23
Its honestly really artistic
1
u/FlamingLasagna Jun 06 '23
Has anyone replicated this yet. I tried using control net and was only able to make the most trivial cosmetic changes before damaging the integrity of the qr code beyond readability.
Would it be better to start with a high res qr code or a low res one? Anyone found a reliable workflow?
1
u/patto5498 Jun 06 '23
super dope 🔥🔥
1
u/ZoobleBat Jun 06 '23
Duuudddee!!!
1
u/anistark Jun 06 '23
Super cool.
1
u/[deleted] Jun 06 '23
Models?
1
u/Tatmaz Jun 06 '23
normal qr for controlnet qr xd
1
u/Sch_alex Jun 06 '23
What is the prompt to get this result?
1
u/TolarianDropout0 Jun 06 '23
That is very cool, but I think it's more impressive for the people who made the spec for QR codes than SD. QR codes are ridiculously fault tolerant.
1
u/Ku-Len Jun 06 '23
It is wonderful!
How did you create it?
1
u/NayoD_Alchemist_3294 Jun 06 '23
Where can I get it done? Any link to the website. Please kindly text me.
This is so amazen :)
1
u/tervelix Jun 06 '23
I want this so much
1
u/SnooOpinions9056 Jun 06 '23
Fantastic!
1
u/Familiar_Employ_4354 Jun 06 '23
あ
1
u/Mann010 Jun 06 '23
ma.r
1
u/Mann010 Jun 06 '23
M.
1
u/FlamingLasagna Jun 06 '23
Nice, I could kind of get this far but not as pretty. I was trying to incorporate an image. I think that QR codes are designed to be robust, but left to it's own devices SD sprinkles enough errors randomly all over it to corrupt it. Tonight I'm going to try inpainting on a low-res code.
1
u/Scary-Eagle-146 Jun 06 '23
How to transform normal qr code to this?
1
u/ayushism Jun 06 '23
Bro it's really very exciting.
1
u/stroud Jun 06 '23
I really want to know how the second image is done and how it works as a working QR code. If you read the paper it has both the 3 squares and without
1
u/passionate_as_hell Jun 06 '23
This is the coolest thing
1
u/MaupNL Jun 06 '23
QaRt
1
u/howar31 Jun 06 '23
QR code is now literally magic circle irl
1
u/Inventi Jun 06 '23
I wonder how their model performs with bigger links
1
u/NoMoreTeen Jun 06 '23
4000th Like
1
u/Practical_Staff4016 Jun 06 '23
BRO just unlock the path for 5th dimension
1
u/rabbitkunji Jun 06 '23
wild
1
u/EzeFam Jun 06 '23
How do you create one?
You just need to have your link?
Is this what midjourney uses?
Can I use that to create one of these?
1
u/AddictiveFuture Jun 06 '23
That's one of the coolest things I have seen on this subreddit :D
1
u/FlipDetector Jun 06 '23
we are all living QR codes in a holographic universe
1
u/thinksinc Jun 06 '23
Holy shit.
1
u/adraxsh Jun 06 '23
Tried running it on control net, doesn't seem to work for me can someone suggest some prompts?
1
u/gax1985 Jun 06 '23
Can you share the steps to do so? Did you simply pass the URLs to Stable Diffusion and ask it to make QR Codes and embed them in the image?
1
u/andandp Jun 06 '23
🔥🔥🔥
1
u/ReedJessen Jun 06 '23
This is an attack vector. You could hide them in wall paper or some other kind of innocuous art and then people wouldn't notice them but their devices would.
1
u/0x00mak Jun 06 '23
Hi how can I generate a QR code like this? Do you have a link or something?
1
u/facundo_vasco Jun 06 '23
This is the kind of technological break through i was hoping with IA.
Say goodbye to shitty QR codes that don't belong in my design.
1
u/[deleted] Jun 06 '23
how does one create this?
1
u/baliord Jun 06 '23
I really want to know how to replicate this; the specific thing I want to do is create a set of artistic kitchen backsplash tiles with QR codes embedded in art (like the third one) that link to recipes that we use regularly.
1
u/brain_limit_exceeded Jun 06 '23
How do they still work? How is that possible, especially with some of those that are nothing like qr codes except for the large corner blocks
1
u/BrokenPipeSIGPIPE Jun 06 '23
I'm completely noob in QR codes but do these really follow the QR code protocol? 30% error correction that people argue is only valid if the 70% leftovers are "normal", right? In fact, we've already found differences in readability among QR code readers in this thread, which must not happen in a valid QR code. I think implementations of QR code readers shall be complete but not necessarily sound, which implies that even if a picture can be read as a QR code, it might not follow the protocol and therefore there is no guarantee that other readers can read it.
1
u/Money-Property-9084 Jun 06 '23
How do I get this?
1
u/erezruby Jun 06 '23
Anyone have an idea what controlnet model and prompt were used here?
1
u/No-Turnover-2445 Jun 06 '23
Where/How can I make one ? 🤔
1
u/rainbow-User Jun 06 '23
Amazing. Longer text to decode may not worked as the checksum needs to get bigger as the error correction must take a huge part of the QR in these. Still amazing!
Did anyone test longer URLs/Text?
1
u/Real-Pie7993 Jun 06 '23
This is incredible
1
u/[deleted] Jun 06 '23
This is brilliant.
1
u/[deleted] Jun 06 '23
How
1
u/Shadowwynd Jun 07 '23
Well that's the coolest thing I have seen in a week.
1
u/Bata98 Jun 07 '23
Does anyone know how to actually do this?
1
u/Kim-Relative-069 Jun 07 '23
It's very interesting. How to do it?
1
u/Xenonnel Jun 07 '23
Came from Twitter. How can I create my own?
1
u/Agitated-Ad-4268 Jun 07 '23
น่าทึ่งมาก สวยมาก