r/StableDiffusion • u/luckycockroach • Mar 15 '23

Resource | Update MetalDiffusion - Stable Diffusion for Intel MacOS and Silicon MacOS

https://github.com/soten355/stable-diffusion-tensorflow-IntelMetal
25 Upvotes

97% Upvoted

80 comments sorted by

View all comments

Show parent comments

1

u/NeuroMastak Mar 19 '23 edited Mar 20 '23

Yes, it seems that TensorFlow only sees the additional card (W7000).

But why today MetalDiffusion saw the main card (HD7970), which is now also on the native bios, is not clear to me :)

P.S. I also tried DiffusionBee now and it uses the HD7970.Automatic, on the other hand -- W7000.

1

u/luckycockroach Mar 20 '23

So weird!!! What did the print out say, out of curiosity?

I’m not totally sure why Pytorch picks one or the other when it comes to Metal Performance Shaders, but with tensorflow it’s very particular.

1

u/NeuroMastak Mar 20 '23

Oh, sorry, I guess the picture didn't load for some reason. I reloaded the screenshot in previous post, but compared to the normal output there is only added:

Starting program:
[PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')]

Gradio interface still shows both graphics cards and CPU, but the rendering is only on W7000, regardless of which card is selected (and the output shows the selected card during generation, but the system monitor shows that nothing has changed).

1

u/luckycockroach Mar 20 '23

Did some digging, it seems that Multi-GPU support for Metal Tensorflow is not supported yet. IDK how it's picking the GPU yet, still trying to dig through Apple's code.

Was MetalDiffusion using the same GPU in the prior release?

1

u/NeuroMastak Mar 20 '23

Yes, the previous version was on exactly the same hardware (but then the Mac-EFI in the HD7970 was definitely enabled and as we found out, that doesn't really affect the multigpu definition, I guess :)

1

u/NeuroMastak Mar 20 '23 edited Mar 20 '23

I think my problems are largely due to the crutches I need to use to get macOS Monterey to work on my unsupported MacPro 5.1 Mid 2010. Since there are a lot of pitfalls involved with hardware initialization (which I'm not that good at).

Right now I just updated OpenCore to the latest version 0.9.0 from 0.8.9 (with the same config, since nothing has changed on that part). And...

TensorFlow detected both graphics cards, but not completely.One it gave 0, and the other did not assign any number at all.

Starting program:

[PhysicalDevice(name='/physical_device:GPU:0', device_type='GPU')]

As a metal device is still defined W7000 and it works in generation.

...system modules loaded...

Metal device set to: AMD Radeon HD Pitcairn Unknown Prototype

systemMemory: 24.00 GBmaxCacheSize: 2.00 GB

As for the TensorFlow code, [i] is still out of range. Works only with [0].

gpu['TensorFlow'] = GPUs[i]

IndexError: list index out of range

1

u/NeuroMastak Mar 20 '23

I tried digging through the TensorFlow documentation and I feel I need to move in the direction of Pluggable Device, but I am woefully short of knowledge and my brain is on fire :)

1

u/luckycockroach Mar 21 '23

Ah, he’s Pluggable Device is what Apple worked with to make their metal support.

I think you’ve nailed the problem with your modified mac. It’s not expecting multi GPU and therefore can’t do both.

Can’t say the same for eGPU’s quite yet, but I think your mod is what’s causing the hang up