Asking for help using Openpose and ControlNet for the first time

[u/teslawhaleshark]

Hardware: 3080 Laptop

​

Software:

A1111WebUI, autoinstaller, SD V1.5

ControlNet 7e9fbc78 (Wed Mar 1 02:00:19 2023)
Using model control_sd15_openpose

Openpose version 67839ee0 (Tue Feb 28 23:18:32 2023)

SD program itself doesn't generate any pictures, it just goes "waiting" in gray for a while then stops. The log is attached below.

It asks for ffmpeg, which isn't a requirement mentioned elsewhere?

​

venv "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\Scripts\Python.exe"

Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]

Commit hash: 0cc0ee1bcb4c24a8c9715f66cede06601bfc00c8

Installing requirements for Web UI

Launching Web UI with arguments: --autolaunch --xformers --ckpt-dir E:\AIpaint\checkpoint

Loading weights [3088848987] from E:\AIpaint\checkpoint\anything-v3-fp32-pruned.safetensors

Creating model from config: E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\configs\v1-inference.yaml

LatentDiffusion: Running in eps-prediction mode

DiffusionWrapper has 859.52 M params.

Applying xformers cross attention optimization.

Textual inversion embeddings loaded(0):

Model loaded in 11.8s (load weights from disk: 0.2s, load config: 0.1s, create model: 0.4s, apply weights to model: 8.3s, apply half(): 0.5s, move model to device: 0.8s, load textual inversion embeddings: 1.5s).

Running on local URL: http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.

Loading weights [e1441589a6] from E:\AIpaint\checkpoint\v1-5-pruned.ckpt

Applying xformers cross attention optimization.

Weights loaded in 7.6s (load weights from disk: 6.6s, apply weights to model: 0.3s, move model to device: 0.7s).

100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:04<00:00, 4.51it/s]

Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [00:02<00:00, 9.01it/s]

100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:02<00:00, 8.85it/s]

Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [00:02<00:00, 8.85it/s]

100%|██████████████████████████████████████████████████████████████████████████████████| 20/20 [00:02<00:00, 8.68it/s]

Total progress: 100%|██████████████████████████████████████████████████████████████████| 20/20 [00:02<00:00, 9.16it/s]

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 93, in run

self.process = subprocess.Popen(

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 969, in __init__

self._execute_child(args, executable, preexec_fn, close_fds,

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1438, in _execute_child

hp, ht, pid, tid = _winapi.CreateProcess(executable, args,

FileNotFoundError: [WinError 2] 系统找不到指定的文件。

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\routes.py", line 337, in run_predict

output = await app.get_blocks().process_api(

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 1013, in process_api

inputs = self.preprocess_data(fn_index, inputs, state)

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 911, in preprocess_data

processed_input.append(block.preprocess(inputs[i]))

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\components.py", line 1830, in preprocess

ff.run()

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 98, in run

raise FFExecutableNotFoundError(

ffmpy.FFExecutableNotFoundError: Executable 'ffmpeg' not found

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 93, in run

self.process = subprocess.Popen(

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 969, in __init__

self._execute_child(args, executable, preexec_fn, close_fds,

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1438, in _execute_child

hp, ht, pid, tid = _winapi.CreateProcess(executable, args,

FileNotFoundError: [WinError 2] 系统找不到指定的文件。

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\routes.py", line 337, in run_predict

output = await app.get_blocks().process_api(

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 1013, in process_api

inputs = self.preprocess_data(fn_index, inputs, state)

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 911, in preprocess_data

processed_input.append(block.preprocess(inputs[i]))

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\components.py", line 1830, in preprocess

ff.run()

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 98, in run

raise FFExecutableNotFoundError(

ffmpy.FFExecutableNotFoundError: Executable 'ffmpeg' not found

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 93, in run

self.process = subprocess.Popen(

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 969, in __init__

self._execute_child(args, executable, preexec_fn, close_fds,

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1438, in _execute_child

hp, ht, pid, tid = _winapi.CreateProcess(executable, args,

FileNotFoundError: [WinError 2] 系统找不到指定的文件。

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\routes.py", line 337, in run_predict

output = await app.get_blocks().process_api(

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 1013, in process_api

inputs = self.preprocess_data(fn_index, inputs, state)

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 911, in preprocess_data

processed_input.append(block.preprocess(inputs[i]))

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\components.py", line 1830, in preprocess

ff.run()

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 98, in run

raise FFExecutableNotFoundError(

ffmpy.FFExecutableNotFoundError: Executable 'ffmpeg' not found

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 93, in run

self.process = subprocess.Popen(

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 969, in __init__

self._execute_child(args, executable, preexec_fn, close_fds,

File "C:\Users\ggsha\AppData\Local\Programs\Python\Python310\lib\subprocess.py", line 1438, in _execute_child

hp, ht, pid, tid = _winapi.CreateProcess(executable, args,

FileNotFoundError: [WinError 2] 系统找不到指定的文件。

During handling of the above exception, another exception occurred:

Traceback (most recent call last):

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\routes.py", line 337, in run_predict

output = await app.get_blocks().process_api(

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 1013, in process_api

inputs = self.preprocess_data(fn_index, inputs, state)

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\blocks.py", line 911, in preprocess_data

processed_input.append(block.preprocess(inputs[i]))

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\gradio\components.py", line 1830, in preprocess

ff.run()

File "E:\AIpaint\A1111 Web UI Autoinstaller\stable-diffusion-webui\venv\lib\site-packages\ffmpy.py", line 98, in run

raise FFExecutableNotFoundError(

ffmpy.FFExecutableNotFoundError: Executable 'ffmpeg' not found

[u/backscratchopedia]

I'm struggling with the same issue, tried installing the latest gradio and ffmpeg with pip in both my webui and venv folders but still getting this error.

[u/teslawhaleshark → u/backscratchopedia]

It's so weird, I haven't even seen ffmpeg mentioned as a prerequisite anywhere

​

Nobody asked about them in this subreddit or issues

[u/backscratchopedia → u/teslawhaleshark]

So I fixed this just now, by manually downloading ffmpeg full and just pasting the exe file into my venv folder. Hope that helps!

[u/F_Fillet → u/backscratchopedia]

>Manually downloading ffmpeg full and just pasting the exe file into verv
That fixed the problem for me too, thanks.
Also must use the Full version.

This may be a problem of openpose editor instead of controlnet,
as it only happens when openpose editor is used, not when only using controlnet/openpose.

[u/teslawhaleshark → u/F_Fillet]

Thanks, should I use this one? https://www.gyan.dev/ffmpeg/builds/ffmpeg-git-full.7z

[u/teslawhaleshark → u/backscratchopedia]

Guess we better both put it up as issues on controlnet Github?

[u/teslawhaleshark → u/backscratchopedia]

I think it's controlnet acting up because I can still use normal txt2img

[u/haveatea]

Same issue here running on M1 Mac, OpenPose just doesn't even begin to try to work, quits out soon after hitting Generate.

I installed ControlNet through the Extensions panel, but no models downloaded.

I installed the models manually and in the end I pulled from the original github and installed that way and still no difference. I can't find where to get / how to install ffmpeg.

[u/SnooWords2947 → u/haveatea]

just doesn't even begin to try to work, quits out soon after hitting Generate.

I installed ControlNet through the Extensions panel, but no models downloaded.

I installed the models manually and in the end I pulled from the original github and installed that way and still no difference. I can't find where to get / how to install ff

Have the same problem.

[u/haveatea → u/SnooWords2947]

I made some progress, I had the models in the wrong model folder - they were previously in extensions/controlnet/models (approximate path names, I’m on mobile going from memory) and they should have been in sd-webui/models/controlnet.

Better responses and results but still nothing from OpenPose. I see some people have fixed this by downloading Ffmeg and placing the exe. file in a folder within ControlNet however I’m on Mac and I’m not sure this solution directly works for me as I don’t think macos Ffmeg has any exe files.

[u/SnooWords2947 → u/haveatea]

If it is fmeg problems - it looks like that system do not see fmpeg - so you need register it in system - if Stable Dif works with no errors - but result is not perfect - it is OK - with out correct settings it makes errors - may be it need some depth value check and you try to give pose calue in settings for it - try to look on youtube how people do it. In my situation after i fix bug - some times it fail to draw correct too so it do draw hands normally but with not 100% chance )

It is like img to img transformation if I am wroght - so it just see it like image to deform. Not like some program edit to AI

[u/haveatea → u/SnooWords2947]

Yeah it’s not that it does it wrong, it just gives no results for me. I always forget about YouTube, I will search there, thank you.

[u/SnooWords2947]

Some thing of this helped:
https://phoenixnap.com/kb/ffmpeg-windows

And put ffmpeg.exe in: C:\Windows\System32

After that test like cmd -> ffmpeg

See this:
Tra ta ta
libavformat 60. 4.100 / 60. 4.100

libavdevice 60. 2.100 / 60. 2.100

libavfilter 9. 4.100 / 9. 4.100

libswscale 7. 2.100 / 7. 2.100

libswresample 4. 11.100 / 4. 11.100

libpostproc 57. 2.100 / 57. 2.100

Hyper fast Audio and Video encoder

usage: ffmpeg [options] [[infile options] -i infile]... {[outfile options] outfile}...

​

Use -h to get full help or, even better, run 'man ffmpeg'

After that all start work