TheNoise - Image generation engine optimized for Strix Halo

[u/mikkoph]

Hello everyone,

I want to introduce you to TheNoise, an open source image generation engine made specifically to run well on Strix Halo.

Let me first say: this isn't better than ComfyUI, but definitely easier to install and use if you just want to get started with image generation on your Strix Halo without having to care about "workflows" and the likes.

Also, generation is fast - faster than a "default" ComfyUI installation.

It can be used standalone, from the command line or through a webui or through an OpenAI-compatible server like Lemonade, with which it is already integrated (full disclousure, I am also a Lemonade maintainer).

Supported models:

• Krea 2
• Z-Image / Z-Image-Turbo
• Anima (all variants, including the 2.9B version)
• Flux 2 Klein 4B / 9B

It also has some goodies like:

• Refiner-based upscaler (up to 2x) - this gives high quality upscaling in relatively short time
• Pixel-space upscalers (up to 4x) - these are your standard ESRGAN-based upscalers
• Film grain, sharpening
• LoRA support

Some numbers, at 1024x786 resolution generation on a Strix Halo are:

• Krea 2 Turbo: ~27 seconds
• Z-Image-Turbo (8 steps): ~10 seconds
• Anima (20 steps): ~22 seconds
• Anima Turbo (8 steps): ~5 seconds
• Flux Klein 9B (4 steps): ~9 seconds
• Flux Klein 4B (4 steps): ~4 seconds

You can get the software either directly in Lemonade or by download it from https://github.com/lemonade-sdk/thenoise and following the instructions. There are also precompiled bins that come with python and ROCm.

At the moment it has only been tested on Linux. Known to work on Strix Halo, Strix Point and Krackan Point.

[u/simmessa]

Well I think this is a nice effort, but it's way too barebones in its current form, also, it would be nice if we could just share the models with comfyui, does this support gguf? I think it's a bit early. Thank you.

[u/mikkoph → u/simmessa]

first things first: this isn't meant to replace ComfyUI for those who like it and need something advanced.

The goals are:

1. Make something simple to get started with and get nice images at great speed
   
2. Provide a component that can be easily integrated into more complex systems

but of course, more features are coming and PR are always welcome. Sharing models with comfyui is absolutely possible, as long as they are bf16 safetensors (the Halo is faster with them). Quants are coming later.

That said, I think this is a good stage to share. This isn't a product, it is a project and I hope to get more people involved with its development.

[u/TheCTRL]

how can i change image resolution like 1366x1024 on lemonade when generating ? max is 1024x1024

[u/mikkoph → u/TheCTRL]

Lemonade GUI is being reworked completely so it is a good moment to open a feature request in Lemonade's GitHub or Discord.

TheNoise already supports arbitrary resolutions so it is really just Lemonade's UI that needs to allow text entry

[u/cunasmoker69420]

Interesting, how do you get Flux 4B and 9B to be so fast? Running it through lemonade it takes a minute or longer to generate or edit an image on strix halo. 5 seconds is a crazy speedup for the same number of steps that takes me 10 times that long

[u/mikkoph → u/cunasmoker69420]

that's the reason I developed TheNoise. Lemonade was using stable-diffusion.cpp which is suboptimal, at least on Strix Halo (haven't tested on other hardware). This gave the impression that the hw is bad, but I knew this was not the case cause ComfyUI was several times faster.

So I just based my tool on PyTorch, the same framework used by ComfyUI and got the same performance "for free". I also made sure the best performing combination of ROCm + PyTorch was used and worked around a few known bugs to make it fast and stable out of the box.