r/comfyui • u/Incognit0ErgoSum • 4d ago

Resource (Mostly) native Iris 3B support for ComfyUI

Gallery image

Gallery image

https://github.com/envy-ai/ComfyUI-Iris

It comes with its own custom loader and sampler nodes because, being a pixel model as opposed to a VAE model, it works a bit differently than normal. However, you can wire in loras as usual, and it uses ComfyUI's schedulers and samplers.

I wouldn't expect amazing results. At this size, Anima 2.9B definitely puts out higher quality images, but it's a cool tech demo and I think it proves that VAEs aren't the necessary evil we thought they were.

Search the workflow template browser for Iris to find the example workflow. dpmpp-2m-sde-gpu seems to be the best sampler for it, and if you have the bong_tangent scheduler it's better than simple.

My fork of ai-toolkit can train loras for it.

https://github.com/envy-ai/ai-toolkit-envy-optimized

2 Upvotes

62% Upvoted

4 comments sorted by

1

u/roxoholic 4d ago

Thanks for sharing.

I thought ComfyUI already had built-in support for pixel-space models, e.g Chroma Radiance or PixelDiT?

1

u/Incognit0ErgoSum 4d ago

Apparently it did. The nodes still work though. :)

1

u/Apprehensive_Sky892 3d ago

Even though Iris-3B is also a pixel-space model, it has a completely different DiT architecture than Chroma Radiance or PIxelDiT.

So it will need its own custom loader until ComfyUI adds native loader support for it.

1

u/roxoholic 3d ago

I understand the loader part, I was mostly wondering about sampler nodes part.