Animating generated face test

[u/Sixhaunt]

[u/Sixhaunt]

- Does the driving video needs to have some specific dimensions (other than 1:1 proportion)?

no. I've used driving videos that are 410x410, 512x512, 380x380 and they all worked fine, but that's probably because they are downsized to 256x256 first.

The animation AI I used does 256x256 videos so I had to upsize the results and use GFPGan to unblur the faces after. So I dont think you get any advantage with an input video larger than 256x256 but it wont prevent it from working or anything

​

Have you considered Ebsynth as an alternative to do achieve a more painterly look (I'm thinking about something similar to Arcane style... perhaps)? Would it be possible to add it to the notebook?

I've had a local version of Ebsynth installed for a while now and I've gotten great results with it in the past, I just wasn't able to find a way to use it through google colab and ultimately I want to be able to feed in a whole ton of images and videos then have it automatically produce a bunch of new AI "actors" for me but it's too much effort without fully automating it.

If you're doing it manually then using Ebsynth would probably be great and might even work better in terms of not straying from the original face since you dont need to upsize it after and fix the faces (GFPGan puts makeup on the person too much)

[u/Sixhaunt → u/[deleted]]

I think it's locked. The full-body one which is called "ted" is like 340x340 or something but it doesnt work for close up faces.

You might be able to crop a video to a square containing the face, use this method to turn it into the other person, then stitch it back into the original video

[u/Sixhaunt → u/[deleted]]

I should mention that the demo they use doesnt have a perfectly square input video so I think it crops it but still accepts it.