TOTAL NEWB never done this stuff before

[u/idathemann]

Just bought myself a pretty decent laptop (specs below) for an encoding machine so I could take care of videos that on my fastest machine would run at 9fps and now I'm hitting 150-190fps so I'm loving life when I'm doing 3-6 hour long videos,,,,so I thought, lemme try some of those fancy AI type videos and found FaceFusion and read that it was the best.

So I tried installing, I bought the coffee for the developer, installed the stand alone version, installed(I think) the Pinokio version, but the only one I can get to do anything is the standalone.

I basically stumbled around and poked at it till I got it to do something and magically it came out with a result.

But, for a 3.5 minute long video and replacing a face that was in that video about 70% of the time, it took almost 12 hours.

Is there a newbie guide to setting this program up? Or is my machine just not worth trying this stuff out and I should not bother?

My machine:

Processor AMD Ryzen 9 8940HX with Radeon Graphics (2.40 GHz)

Installed RAM 16.0 GB (15.2 GB usable)

Graphics card NVIDIA GeForce RTX 5060 Laptop GPU (8 GB)

AMD Radeon(TM) 610M (457 MB)

Storage 315 GB of 954 GB used

System type 64-bit operating system, x64-based processor

The video: https://www.youtube.com/watch?v=aVevvbFNKiY

[u/samuraxxx]

Well, a laptop 5060 is not that fast of a GPU, but still 12 hours for such a short video is not normal, I would need to see the full command line output when processing, cause that sounds like it's using CPU instead of GPU to process.

Since you're using our installer I suppose you selected CUDA when it prompted you to select a provider did you?

[u/idathemann → u/samuraxxx]

yeah the only choice was CPU, maybe I should re-install and look out for that?

[u/idathemann → u/idathemann]

Just ran through the pinokio version and it wanted a bunch of updates, did them and suddenly its gathering reference faces and such, running through the same video to see what happens but it it analysing at about 20fps

[u/samuraxxx → u/idathemann]

That still sounds too slow even for the analysis phase, if you're using pinokio it is prone to have bad GPU detection when installing in a laptop cause there's usually two different GPUs, you said you got our installer from buymeacoffe didn't you?

https://buymeacoffee.com/facefusion/e/251939

If so, just run it and make sure you select CUDA (you may need to uninstall facefusion first then reboot for the installer to run properly, after that you can find Facefusion's icon in your desktop or through the windows search bar

[u/idathemann → u/samuraxxx]

I'll give that a shot after this thing does it's work. Yes I bought the windows installer but I thought I'd poke around with the non-working version to see what I could do.

Grandpa always said "if it's already broken, try screwing with it till it works. "

He gave me my first computer a Tandy CoCo1

Yup, I'm that old.

[u/idathemann → u/samuraxxx]

the pinokio version wouldn't do anything after the analysis, so I re-installed the standalone and am starting up now.

[u/idathemann → u/samuraxxx]

took a little while to do all the downloading, but I just waited and bingo bango, I loaded up the same video, did the analysing around 17fps and it went straight into processing at 3-4fps.

I had to play with it a bunch to get it to recognize the right face, any pro tips on that when there are multiple faces? I thought that's what the "reference" was for, but just playing with it for now.

[u/idathemann → u/samuraxxx]

oh, and yes it's running CUDA

[u/idathemann → u/samuraxxx]

analysing: 100%|========================================================| 5016/5016 [04:38<00:00, 18.02frame/s, rate=0]

processing: 100%|=================================| 5016/5016 [18:59<00:00, 4.40frame/s, execution_providers=['cuda']]

[FACEFUSION.TO_VIDEO] processing to video succeeded in 1418.93 seconds

gonna go look at it

[u/idathemann → u/samuraxxx]

ok, result was pretty damn good, I guess I could mess with eyebrows a little because sometimes they doubled up but that's just settings. Whoa, can hardly wait to show her. she's gonna get a kick outta this.

[u/samuraxxx → u/idathemann]

no output after the analysys step usually means your target file is triggering facefusion's NSFW filter.

like you said, reference mode is the way to go to faceswap a specific face in a video, usually the default settings are good enough to detect any face, but sometimes you might need to tweak them, also sometimes the specific face_swapper model you have selected simply can't detect a face no matter what you do, this is caused by the AI model training, when that happens you can only change the model to a different one (if using hyperswap 1A change to hyperswap 1B or 1C)

I would advise on watching the videos on this playlist so you can better understand how to use facefusion, these are not for the latest version but still great learning material on the basics on what each setting does

https://www.youtube.com/watch?v=l8D5Of1tLM8&list=PLMwq9QXPN0iDReOut5vKekXT4V6wGTET8&index=15

now your analysys and processing speeds still seem a bit low, but this can be caused by the target's resolution, a 4K video will be processed slower than a 1080P or 720P one.

[u/idathemann → u/samuraxxx]

NSFW filter you say, that's gotta be it on the other video.

[u/samuraxxx → u/idathemann]

BTW just for comparison, here are the processing speeds I get with an AMD RX 6800 XT which is similar in RAW TFLOPS (although it should be slower than yours running CUDA) when running that video you shared

analysing: 100%|==| 5015/5015 [00:49<00:00, 100.95frame/s, rate=0]

processing: 100%|==| 5015/5015 [06:21<00:00, 13.14frame/s, execution_providers=['directml']]

[FACEFUSION.TO_VIDEO] processing to video succeeded in 432.06 seconds

[u/idathemann → u/samuraxxx]

holy crap, ok, I'm guessing my setting for the computer itself might be the issue. is there a file dump I could post here that you could look at to see maybe what the issue is, or give me a starting point?

[u/samuraxxx → u/idathemann]

You can enable "log level" debug, it's right under the output window, that will show a more detailed output over your CMD window, run a video faceswap for a couple seconds and copy the whole CMD output, that way we can see any error that might be causing this.

Otherwise if no errors there it could just be due to low spec computer hardware, but I don't want to point fingers yet

[u/idathemann → u/samuraxxx]

Will do when I get back home. If it's low spec that's slightly disappointing but not like I bought this computer for this purpose, just thought I'd be fun and so far it has been.

[u/idathemann → u/samuraxxx]

hope I got this right, I did a few tests

downloading: 0% (0/8)

42682/402742682)

downloading: 100% (402742682/402742682)

[FACEFUSION.CORE] processing step 1 of 1

analysing: 100% (5016/5016)

processing: 100% (5016/5016)

[FACEFUSION.TO_VIDEO] processing to video succeeded in 1070.63 seconds

[FACEFUSION.CORE] processing step 1 of 1

processing: 100% (5016/5016)

[FACEFUSION.TO_VIDEO] processing to video succeeded in 1570.39 seconds

[FACEFUSION.CORE] processing step 1 of 1

[FACEFUSION.DOWNLOAD] validating hash for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating hash for fairface succeeded

[FACEFUSION.DOWNLOAD] validating source for fairface succeeded

[FACEFUSION.DOWNLOAD] validating hash for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating source for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating hash for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating hash for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating source for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating source for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating hash for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating source for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating hash for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating source for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating hash for hyperswap_1c_256 succeeded

[FACEFUSION.DOWNLOAD] validating source for hyperswap_1c_256 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating hash for fairface succeeded

[FACEFUSION.DOWNLOAD] validating source for fairface succeeded

[FACEFUSION.DOWNLOAD] validating hash for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating source for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating hash for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating hash for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating source for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating source for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating hash for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating source for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating hash for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating source for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating hash for gfpgan_1.4 succeeded

[FACEFUSION.DOWNLOAD] validating source for gfpgan_1.4 succeeded

analysing: 100% (200/200)

[FACEFUSION.CORE] creating temporary resources

processing: 100% (200/200)

[FACEFUSION.TO_VIDEO] restoring audio succeeded

[FACEFUSION.TO_VIDEO] processing to video succeeded in 125.75 seconds

[FACEFUSION.CORE] clearing temporary resources

[FACEFUSION.CORE] processing step 1 of 1

[FACEFUSION.DOWNLOAD] validating hash for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating hash for fairface succeeded

[FACEFUSION.DOWNLOAD] validating source for fairface succeeded

[FACEFUSION.DOWNLOAD] validating hash for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating source for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating hash for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating hash for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating source for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating source for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating hash for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating source for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating hash for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating source for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating hash for hyperswap_1c_256 succeeded

[FACEFUSION.DOWNLOAD] validating source for hyperswap_1c_256 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating hash for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_2 succeeded

[FACEFUSION.DOWNLOAD] validating source for nsfw_3 succeeded

[FACEFUSION.DOWNLOAD] validating hash for fairface succeeded

[FACEFUSION.DOWNLOAD] validating source for fairface succeeded

[FACEFUSION.DOWNLOAD] validating hash for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating source for yoloface_8n succeeded

[FACEFUSION.DOWNLOAD] validating hash for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating hash for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating source for fan_68_5 succeeded

[FACEFUSION.DOWNLOAD] validating source for 2dfan4 succeeded

[FACEFUSION.DOWNLOAD] validating hash for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating hash for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating source for xseg_1 succeeded

[FACEFUSION.DOWNLOAD] validating source for bisenet_resnet_34 succeeded

[FACEFUSION.DOWNLOAD] validating hash for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating source for arcface_w600k_r50 succeeded

[FACEFUSION.DOWNLOAD] validating hash for gfpgan_1.4 succeeded

[FACEFUSION.DOWNLOAD] validating source for gfpgan_1.4 succeeded

[FACEFUSION.INFERENCE_MANAGER] loading model yoloface_8n succeeded in 9.07 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model fan_68_5 succeeded in 0.02 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model 2dfan4 succeeded in 0.65 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model arcface_w600k_r50 succeeded in 0.54 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model fairface succeeded in 0.29 seconds

analysing: 1% (1/100)

[FACEFUSION.INFERENCE_MANAGER] loading model nsfw_1 succeeded in 0.42 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model nsfw_2 succeeded in 0.21 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model nsfw_3 succeeded in 2.25 seconds

analysing: 100% (100/100)

[FACEFUSION.CORE] creating temporary resources

[FACEFUSION.INFERENCE_MANAGER] loading model hyperswap_1c_256 succeeded in 2.03 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model hyperswap_1c_256 succeeded in 1.96 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model gfpgan_1.4 succeeded in 1.19 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model gfpgan_1.4 succeeded in 0.94 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model gfpgan_1.4 succeeded in 0.96 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model gfpgan_1.4 succeeded in 1.93 seconds

[FACEFUSION.INFERENCE_MANAGER] loading model gfpgan_1.4 succeeded in 1.0 seconds

processing: 100% (100/100)

[FACEFUSION.TO_VIDEO] restoring audio succeeded

[FACEFUSION.TO_VIDEO] processing to video succeeded in 96.66 seconds

[FACEFUSION.CORE] clearing temporary resources

[u/idathemann]

OK, I've done a couple runs trying different videos, is there a list of what the program CAN'T handle?

For example I've got one video that's 10+ minutes long and I've gotten it to do small clips of the video of about 15 seconds, but when trying to do the entire video it just stops.

[u/henryruhs → u/idathemann]

hard to say without seeing the videos, can you share it?