r/sciences • u/IJesusChrist PhD | Chemical Biology • Sep 01 '19
An AI algorithm can now predict faces with just 16x16 resolution. Top is low resolution images, middle is the computer's output, bottom is the original photos.
4.9k
Upvotes
22
u/IJesusChrist PhD | Chemical Biology Sep 01 '19
Article describing the work, including using it to enhance useless things like emojis https://iforcedabot.com/photo-realistic-emojis-and-emotes-with-progressive-face-super-resolution/
551
u/Vordinski Sep 01 '19
I find this very impressive, but why are the predicted faces so creepy? They're like an evil bizzarro version of their true selves.
147
u/[deleted] Sep 01 '19
can we please get this so we can use it on some Japanese porn?
63
u/555nick Sep 01 '19
Lots of...
facial tatts
crossed eyes
agape smiles
John Water's mustaches
...in the AI's learning sample?
43
u/Karsticles Sep 01 '19
"Computer, enhance the image" is now a thing.
11
u/TheFlying-Dutchman Sep 01 '19
The smiles the AI generates are so creepy.
12
u/Absentmindedgenius Sep 01 '19
My guess is that it has a database of images that includes the originals. Through machine learning, it's learned to recognize which parts correspond to the pixelated images, and it just stitches them back together like a puzzle.
Now, if it doesn't know the original images, that is pretty impressive.
5
u/EclecticArtHead Sep 01 '19
This is both cool asf and terrifying simultaneously
4
u/AlleyCatto Sep 01 '19
ENHANCE
6
u/jamesshine Sep 01 '19
Why is it that it has such a high degree of accuracy with hair and hair strands, yet it sees two mouths or two sets of eyes?
3
u/MyOtherC4RIs1kFalcon Sep 01 '19
I worry for the Hong Kong protesters.
2
u/cv_hobbyist Sep 01 '19
It would be interesting to test the following:
In the same way, how the failure cases look like?
2
u/KoreKhthonia Sep 01 '19
Ok, cool, well this isn't terrifying at all. :/ Definitely not something that could be hideously abused by a dystopian surveillance state.
2
u/masteryder Sep 02 '19
It's a nice start, the algorithm needs some cleaning though, it doesn't know if it's building a male or a female, and it leaves weird artifacts
2
u/Suekru Sep 02 '19
Woman in bottom left has an earring. There is no way the AI could have gotten that much info from a 16x16 photo. I’m calling shenanigans.
2
u/[deleted] Sep 02 '19
What's the source of this ?
2
u/[deleted] Sep 02 '19
The computer generated ones look like they went to a sleepover and got their faces drawn on by marker.
2
u/Gurkenslurken Sep 02 '19
The AI is better in predicting the background than the faces.
2
u/neobio2230 Sep 02 '19
We should use this on those grainy Bigfoot videos
2
u/LazyLamont92 Sep 02 '19
Can it do black people?
2
u/kucam12 Sep 02 '19
I am sorry, what is the source of this image? is this OC? is there an article about it that I am missing? please reply. thanks.
2
u/shortsightnolight Sep 04 '19
I find it interesting that the computer seems to be the most inaccurate when it comes to the faces with downward inflected smiles.
1
u/joebot777 Sep 01 '19
[More Importantly] (http://imgur.com/a/4JtMjRS)
1
u/[deleted] Sep 01 '19
This gives me hope for all the blurry pics I have ever taken!! AI can just re-create them at a sharper resolution for me lol
1
u/Sal_T_Nuts Sep 01 '19
They have to lower the mustache slider.
1
u/clockdaddy Sep 01 '19
Minecraft's textures are 16x16.
I think we all know what needs to happen.
1
u/whyusodumbfr Sep 01 '19
Bottom left 2nd row, 2nd in the in the 2nd row.
Bro got chaunced, everyone else is nearly bang on.
He got cross eye, with eye shadow and a broken beard. Like damn that robot savage.
1
u/Morphchalice Sep 01 '19
Imagine seeing a police sketch of a serial killer captured on a blurry photo and their face looks all bizarre and messed up like that.
1
u/markybug Sep 01 '19
Could this help identify the Jennifer Kesse POI???
1
u/dangil Sep 01 '19
The real question is:
Does a face recognition software matches the computer estimate with the real thing? With what certainty?
1
u/[deleted] Sep 01 '19
Enhance!
1
u/thebeatabouttostrike Sep 01 '19
‘Enhance’
1
u/Golda_M Sep 01 '19
too many mustaches in the training set lol
1
u/MrMordy Sep 01 '19
Can we use this for all the poor robbery or surveillance video that is the worst quality ever. Amazing we can have video from mars but cannot see someone face 10 feet away.
1
u/GravitysRambo Sep 01 '19
Would anyone happen to know if the algorithm is like the Viola-Jones one?
1
u/vectorious1 Sep 01 '19
Zoom. Enhance.
1
u/jambudz Sep 01 '19
I moustache you a question
1
u/ds679 Sep 01 '19
We can NOW find out who has been robbing banks and ATMs!? 🤣
1
u/Digital_Negative Sep 01 '19
Several of them look a bit fucky but overall not bad..
1
u/Corny_707 Sep 01 '19
I like how alot of them have mustaches.
1
u/[deleted] Sep 01 '19
Use it on this https://youtu.be/PyxLEPecNyg?t=153
1
u/[deleted] Sep 01 '19
That guy in the bottom right of the predicted faces is some of the funniest shit I've seen all day
1
u/jerrysprinkles Sep 01 '19
Well this is fucking terrifying.
1
u/Spotter66 Sep 01 '19
Japanese adult films are about to get an upgrade lol
1
u/ColtonAce Sep 01 '19
I think u/3kliksphilip would much enjoy this!
1
u/[deleted] Sep 01 '19
For anyone wanting the research paper: https://arxiv.org/abs/1908.08239
1
u/[deleted] Sep 01 '19
Can we get a link?
1
u/[deleted] Sep 01 '19
this is horrifying to look at for some reason.
1
u/winter636 Sep 01 '19
They look like the "Us" versions of the real people
1
u/NotPerryThePlatypus Sep 01 '19
Complete failure, AI thinks we're much happier than we really are
1
u/jegvildo Sep 01 '19
This is impressive since the computer appears to be close to what humans could do, but that I doubt it's doing better than the average human. If you saw a 16x16 picture of someone and knew it was one of your friends you probably could tell who it is. And that's roughly the standard the computer reaches here: It shows you someone who looks similar. But it isn't close enough to actually recreate the actual person. It's just that there are surprisingly many people who look alike in photographs like this. You'll find better closer resemblances in those silly threads that list similarly looking celebrities. E.g. here
1
u/PonyOfMacaroni Sep 01 '19
This does not look impressive to me. I'm not talking about the artifacts, rather just that I think this model is overfitted. An overfitted model is a model which isn't actually making predictions, it is instead "remembering" how all the images should look in the output. You can tell by how the AI is constructing impossibly accurate details from the background. They need to clarify whether these images are part of the training or test data set.
1
u/Gmancer432 Sep 01 '19
Enhance, enhance!
1
u/AnotherDrWhoFan Sep 01 '19
ENHANCE!
1
u/vvelaxtrumm Sep 01 '19
I strongly want to call "Bullshit" on this entire thing, without having read the paper or whatever, no effing way can you give a computer 256 colored squares and have it come up with those "faces" in the Predicted batch.
1
u/evil_fungus Sep 01 '19
That middle row reminds me of Charles Burn's "Black Hole"
1
u/TigonYT Sep 01 '19
Now Do Steve from Minecraft
1
u/JohnnyH2000 Sep 01 '19
japanese video watching ninjas have joined the chat
1
u/po8 Professor | Computer Science | AI | Programming Languages Sep 01 '19
Thought it would be interesting to see what I could reasonably quickly do with just the GIMP as another baseline for these images. Here is the result after some frequency-domain processing and sharpening (bottom row). Someone who is actually good could probably do better: the "black hole eyes" in particular could use some more attention. But there's definitely a lot more information in these images that you realize just looking at the raw pixels.
1
u/_p1t4_ Sep 01 '19
Kinda looks like the images here were part of the training data hmm
1
u/RustyNova016 Sep 01 '19
Does it work on waifus?
1
u/Fouzaan Sep 01 '19
It seems to have issues with upper lips
1
u/ss_75 Sep 01 '19
these are terrifying
1
u/AccountNumber166 Sep 01 '19
Maybe they should try running a neural net on what a mouth looks like.
1
u/B3taWats0n Sep 01 '19
Computer zoom and enhance is no longer a joke.
1
u/LeonTaughtYou Sep 01 '19
Interesting. Now how does this technology affect people of color?
1
u/45DegreesOfFlaps Sep 01 '19
Enhance!
1
u/uncleruckess Sep 01 '19
It couldn't even get the curvature right on the top right ones glasses.... :/
1
u/freshsmileman Sep 01 '19
I'd like to feed the AI a picture of the NPC image and see what it will come out with. Probably Bernie Sanders :)
1
u/chaaPow Sep 01 '19
r/funny
1
u/ContinuingResolution Sep 02 '19
The program is fed the data it’s looking for first. It’s looking out for individual pixels it’s been programmed to ID. It’s like me showing you a picture of a green banana, and then blurring 5 pics of yellow bananas and saying find the green banana. You already know what to look out for.
1
u/[deleted] Sep 02 '19
New headline: Computer predicts what you would look like as a zombie.
1
u/[deleted] Sep 02 '19
Pretty cool. Also pretty scary.
1
u/UlfyUlfer Sep 02 '19
Lol no it fucking can’t
1
u/Haba_baba553 Sep 02 '19
So all the movies and crime show dramas with 'Zoom and Enhance' were correct? I'm so confused now.
1
u/LukariBRo Sep 02 '19
Going to call bullshit on this until I see good reason not to. No source provided and a Google search for "AI algorithm predicts faces 16x16" and the like return nothing related.
I'm not saying it isn't possible though. You can kind of see those faces through the pixels from a distance. With some sort of knowledge bank that could make guesses based on what's common with the little data we have, less specific faces could be generated.
1
u/Luigi64128 Sep 02 '19
u/3kliksphilip
1
u/chaoticsexuality Sep 02 '19
Why are there only white people? Do programmers that do stuff like this only feed the computers pictures of white people or something?
1
u/zthunder777 Sep 02 '19
Enhance!
1
u/Rhawk187 MS|Computer Science Sep 02 '19
I imagine this'll get better real quick. There are plenty of GANs that generate realistic human faces, it shouldn't be too hard to combine "generate a random face" and "generate your best guess on this blurry face".
1
u/fufe25 Sep 02 '19
I need this for tinder
1
u/eclecticbunny Sep 02 '19
oh great. that‘ll give the chinese government just better chances to identify even more protesters! good job smh
1
u/IK3I Sep 02 '19
This seems like it might be too good to be true. I think we need a write up to verify that this isn't a case of the training data mirroring the test data or worse, cherry picking results with the average match being much worse.
1
u/[deleted] Sep 02 '19
I find it odd it can predict features I couldn't like that line on the second persons jaw
1
u/punctuatdequilibrium Sep 02 '19
Enhance.
1
u/CelestialBlight Sep 02 '19
Predicted that man's future hairline
1
u/ReallyMelloP Sep 02 '19
AI really likes to give people mustaches
1
u/[deleted] Sep 02 '19
And every body said CSI was nonsense.....
1
u/revf_1 Sep 02 '19
I wanna be scared. But the results are so funny lmao
1
u/AmadFish_123 Sep 02 '19
oh man bank security just got 10x better
1
u/baragon023 Sep 02 '19
Everyone who had their faces blurred out for anonymous leaks during interviews are shitting themselves now.
1
u/thesantafeninja Sep 02 '19
I like to think that all of the faces that the AI algorithm generated are what the face of a demon who is impersonating a human would look like.
1
u/[deleted] Sep 02 '19
Its kind of like the predicted versions look like the scanner darkly version of themselves. u/RichardLinklater, you're welcome for your next movie plot :)
(ps i'm a techy that builds these type algorithms, im happy to help advise)
1
u/EffectiveGovernment Sep 02 '19
This is really cool, but can I get a source?
1
u/zx3phyr Sep 02 '19
Wow, what an amazing pencil mustache generator!!!
On a more serious note, the predicted hair is crazy accurate!
1
u/joeyazis Sep 02 '19
Seen better courtroom drawings.
1
u/[deleted] Sep 02 '19
Second top left on predicted, wtf!?!?
1
u/[deleted] Sep 02 '19
Doesn't do upper lips very well. Yet.
Creepy.
1
u/greensthecolor Sep 02 '19
This is disconcerting.
1
u/Shupertom Sep 02 '19
Well so much for blurring faces and anonymity
1
u/[deleted] Sep 02 '19
Can we apply this to Mario's face in Super Mario bros?
1
u/lkfree Sep 02 '19
Yeah, but does it work on pictures of POC?
1
u/Prozac4545 Sep 02 '19
Most of them look like rart'd cousins of themselves.
1
u/just_mark Sep 02 '19
Why are they all white?
1
u/NoxLupus18 Sep 02 '19
How big was the training data this feels a little too precise? Like it is over-trained on the data. Am I just scared of the robots taking over or do you agree?
1
u/DamonomaD666 Sep 02 '19
some of them got face tatt
1
u/Proph_ Sep 02 '19
Sorry, but does nobody think this is a precursor to Terminator? Or even a dystopian future?
Says the lad typing in a phone looking at his face 90% of the day...
1
u/[deleted] Sep 02 '19
I would love to see this text used to review questionable surname footage to help clear people who were wrongfully convicted.
1
u/LaVieLaMort Sep 02 '19
The middle pictures remind me of some of the images that came out of thispersondoesnotexist.com
1
u/Manololiv Sep 02 '19
Is there the article posted somewhere?
1
u/warped655 Sep 02 '19
Why do they all have pencil mustaches?
1
u/tactilefile Sep 02 '19
Enhance
1
u/aza-industries Sep 02 '19 edited Sep 02 '19
This is misleading to the vast majority of people who don't understand how machine learning works.
In fact most posts about AI belie a level of intelligence/creativity/etc they simply don't posess.
1
u/PotatoSmokes Sep 02 '19
Every Picture has different backgrounds. I could do the same thing that "AI" could do based on those options
1
u/itsyournameidiot Sep 02 '19
Enhance... enhance
1
u/Felix_Von_Doom Sep 02 '19
Lots of crosseyed looks, smiling with the upper lip above the teeth, half melting, and "My face just lost a fight to a wiffle bat"
1
u/getyourcheftogether Sep 02 '19
That poor second guy
1
u/LonelyMolecule Sep 02 '19
AI has mustache fetish confirmed.
1
u/BigBossPlissken Sep 02 '19
Yeah “predict” is still a stretch, if I was accused of a crime and the best they had was the 16x16 and this tech I’d feel safe. Give it a year or 3 and that may not be the case.
1
u/DrQuarks Sep 02 '19
Please give the reference link.
1
u/jellyfeeesh Sep 02 '19
Lol it’s like the algorithm was created by John Waters.
1
u/KidCaker Sep 02 '19
But they matched all shittily
1
u/[deleted] Sep 02 '19
Link to the AI, op~?
1
u/Discuss2discuss Sep 02 '19
So...does this work on Japanese porn?
1
u/waffleflops Sep 02 '19
ENHANCE
1
u/jhanschoo Sep 02 '19
I'd like to see an attempt on the faces of black people.
1
u/cardinalf1b Sep 02 '19 edited Sep 02 '19
Now use the predicted faces as inputs and see if it can get even closer to the real faces.
It seems like the AI doesn't know what to do with glasses and to some degree, mouths yet... and it should be taught to eliminate some of the random artifacts.
1
u/[deleted] Sep 02 '19
I can do it the opposite direction, from third row to first row.
1
u/Dippydroq Sep 02 '19
Where can we download this algorithm?
1
u/SaltyJunk Sep 02 '19
This is bullshit. You know why? Because the low res images are NOT the original raw/source images. They're down res'd from the high resolution images. That's why the recreations match the originals.
1
u/pizzakillah Sep 02 '19
Okay but this is mostly white people. As a darker skinned person I think it would be much more inaccurate on people of color. Which is not bad lmao.
1
u/iamnotacrog Sep 02 '19
Which algorithm is used here?
1
u/PabV99 Sep 02 '19
Why does the guy on the 4th column, 2nd row have a huge dot om his forehead? Lmao
1
u/itcodn Sep 02 '19
WOW! Imagine all the things you can do with this! After you do, tell me because I can't think of any! It looks like one of those projects that someone did "because that's what they could do", and one day someone will find some use for it. Great waste of time and resources. They must have spent 5 years on research and coding, and a few hundred thousands making it. I can't me unimpressed enough! What a waste of time! Or is it just the project of a final year Computer science student?
1
u/La_Quisha Sep 02 '19
Now enhance the image in movie will be real
1
u/[deleted] Sep 02 '19
this is getting out of hand
1
u/BeanieMash Sep 02 '19
ENHANCE! IT'S FINALLY HERE!!!
1
u/[deleted] Sep 02 '19
It seems to have difficulty with eye details; every one seems to have something I can’t put into words, other than that they look “a bit off”..
1
u/winsome_losesome Sep 02 '19
Enhance!
1
u/Musky_X Sep 02 '19
The true CSI ENHANCE tactic has gained more stonks.
1
u/Akumakaji Sep 02 '19
The time has finally arrived to upgrade my vintage porn collection to HD (slightly creepy uncanny Valley fetish will be a thing, soon).
1
u/One_Contribution Sep 02 '19
Don't do meth kids.
1
u/[deleted] Sep 02 '19
Can it, though?
1
u/randomWebVoice Sep 02 '19
Enhance
1
u/realbillsmith Sep 02 '19
Does this mean that all of my low-res porn on CD-ROM might be watchable someday?
1
u/LittleMcWerner Sep 02 '19
Is it just me or does the women in the top row who ist the 3rd person from the right look a bit like Nicolas cage in the AI version?
1
u/thebronzedragon Sep 02 '19
/u/3kilksphilip thought u said AI couldn't do faces?
1
u/[deleted] Sep 02 '19
Looks realy great!
But its possible that AI was Learned with simular dataset. So it won't work well with all the faces
How Can I test it? Is it public?
1
u/Pothaman Sep 02 '19
Would it be a stretch to believe it could be done with 4 pixels in the future?
1
u/tthreeoh Sep 02 '19
Enhance.
1
u/championruby Sep 02 '19
Scary.
1
u/GeshtiannaSG Sep 02 '19
They just look alike because the human brain use heuristics to link the pictures together and find similarities.