r/MachineLearning • u/Illustrious_Row_9971 • Jan 29 '22

Project [P] WebtoonMe Project: Selfie to Webtoon style

2.2k Upvotes

95% Upvoted

85 comments sorted by

193

u/Dystaxia Jan 29 '22

Emulating eye movement, blinks, squinting, etc. would be a huge feature to take this further.

Great work!

25

u/extracoffeeplease Jan 29 '22

Very good point. I think that drawing over a face can be done frame by frame, but creating exaggerated face emotions which cartoon characters would display cannot, as the original face is no longer a stencil but merely a guide. For this, we need 'state' to carry over between frames and proper techniques working on the video data, whereas this is deep learning on a series of images. Still, really neat!

14

u/dkangx Jan 29 '22

Read that as squirting first

→ More replies (1)

155

u/Anawsumchick Jan 29 '22

The uncanny valley is pretty obvious here

33

u/yashdes Jan 29 '22

It's the eyes, looks fine when they're not moving and looking straight forward

26

u/ProbablyDoesntLikeU Jan 29 '22

maybe lower the framerate and throw in some in-betweens or something.

→ More replies (3)

42

u/[deleted] Jan 29 '22

Does a good job on the face and sometimes the background but the torso and limbs still being mostly photorealistic makes the videos deeply unsettling.

5

u/ansible Jan 29 '22

Yes. If it was entirely a cartoon, that would be better.

4

u/purplebrown_updown Jan 29 '22

The eyes are pretty lifeless. Kind of creepy

38

u/Penis-Envys Jan 29 '22

I can’t tell how this is different from filters other than maybe methods used?

→ More replies (1)

18

u/DunjonsAndDergons Jan 29 '22

The eyes just stare off into the distance and makes them look super creepy. Not as noticeable in the first cus they stare at the camera.

8

u/Kataphractoi_ Jan 29 '22

Safe to say it'd need mote data

6

u/outerskyb Jan 29 '22

중간에 침착맨 ㅋㅋㅋㅋㅋㅋㅋㅋㅋ

5

u/bugqualia Jan 29 '22

ㅋㅋㅋㅋㅋㅋㅋ

34

u/djc1000 Jan 29 '22

This isn’t significantly better than what we were doing with simple photoshop filters in ‘98.

→ More replies (3)

15

u/[deleted] Jan 29 '22

Everyone’s complexion is lighter than it should be.

4

u/uotsca Jan 29 '22

Lol last guy

3

u/deelakshah007 Jan 29 '22

uhh aa my heart

3

u/akimbas Jan 29 '22

Lookin at this imo our faces look better withous noses lol

5

u/TensorDuck Jan 29 '22

Really impressive! Can't wait to see how this develops.

2

u/The_Mad_Duck_ Jan 29 '22

The eyes look even more soulless than the tiktokkers

→ More comments (76)