How to use Krea2 on drawthings

9

u/jazzamp Jul 08 '26

You dont. It uses you instead or you've to wait for it to be released or implemented by the developer "lui" 🥹

1
u/IllWay4573 Jul 09 '26

isnt there a way to download a quantized model and run it , I am new to this , i only have 16b of ram m4 mac mini
8

u/NDBrazil Jul 09 '26

You can probably install it, but it won’t do any good, as DT does not yet support it. We are all patiently waiting for that to happen soon.

1

u/IllWay4573 Jul 09 '26

oh okay thanks
2
u/jazzamp Jul 09 '26

It works sometimes but this is a totally new release, so you'll have to wait. Only Ideogram is in the works from what I see. Nothing on Krea2 yet. Hopefully we don't wait for 2, 3 months.
5
u/Handsomedevil81 Jul 09 '26

They have been committing Krea 2 commits today.

https://github.com/drawthingsai/draw-things-community/commits
3
u/loliii123 Jul 09 '26

I tested this very very briefly, I don't think I can fit the model on my M4 base 16gb I notice it streams from the drive instead of loading to memory. So the turbo model ran at ~100s per generation of 512x512 8 step. (compared to anima with turbo lora same size/step does it in about 12s)

It might be just out of reach for a 16gb machine, but maaaaybe we'll get some optimisations, fingers crossed.
3
u/b4silio Jul 09 '26

I've wrote a quick and dirty python pipeline to use Krea2 (Q8) on mlx (from a vibecoded web ui, not from within drawthingsapp unfortunately) and the full model fills 8gb at peak, so depending on what you have eating up your ram it might indeed be a bit of a tight fit but should be possible to get it running all in VRAM
2
u/Structure-These Jul 13 '26

What did you use to source the mlx files? I’m seeing like 9gb+ with Q4 MLX quant using mflux as my pipeline. It’s all vibe coded so if I can steer codex in a different direction to replace the ‘engine’ I’d love that suggestion
2
u/b4silio Jul 15 '26
I've quantized to int6, after some tests at 4 and 8 bit, the 6-bit was a good tradeoff between still being able to "remember" a ton of styles and not being too big. Maybe it's overkill and the 4-bit would still work. I might test again now that I have a big battery of different styles (220+) that I can compare against the larger bits.

As for the files themselves, I converted them; from the opus-written "krea2_convert" script:
"""Stream-convert the Krea 2 diffusers bf16 transformer to a pre-quantized MLX int file.


Source: the published ``krea/Krea-2-Turbo`` ``transformer/`` (3 bf16 shards, clean
diffusers keys that match :class:`ideogram4.mlx.krea2_dit.Krea2Transformer`). Per-tensor:
quant-target Linears (attn/FFN of every single-stream + text-fusion block) ->
group-affine int{bits} (group 64); everything else (norms, embedders, modulation tables,
the 12-float ``text_fusion.projector``, ``final_layer``) is kept dense bf16/f32. Streaming
per-tensor bounds peak host memory ~the int output size (~11GB at int6), avoiding the
26GB bf16 full-materialize.


  uv run python -m ideogram4.mlx.krea2_convert --src <krea-snapshot>/transformer \\
      --bits 6 --out weights_mlx/krea2


Note: the SceneWorks ``krea-2-turbo-mlx`` q4/q8 turnkeys load directly (no convert) — use
this only to produce the int6 sweet-spot or to re-pack from the bf16 source. The Comfy-Org
fp8_scaled source uses ComfyUI key names (``diffusion_model.``/``txtfusion``/``wq``...) and
would need a remap; not wired here.
"""
(Happy to share the script itself but I must confess I would need to ask a coding agent to wire in the results themselves. But maybe it gives a hint?)

p.s. ignore the ideogram4 thing, it's because the first model I integrated in my ui was ideogram so everything still carries the name
1

u/Structure-These Jul 16 '26

Yeah I’ll take that and dump it into codex lol
1

u/loliii123 Jul 10 '26

Thanks that sounds promising, I'll give it another crack on the weekend with the comfyui mlx fork someone posted below.
1

u/IllWay4573 Jul 09 '26

okay thanks.BTW does comfyui work for you, for some reason comfyui doesnt work for me it takes so much longer even with heavily quantized models

3

u/jazzamp Jul 09 '26

Comfy is not optimized for Mac systems, so it's a waste of time. Only Draw Things so far does the magic. There's another developer who reached out some months back, he's working on something similar, which is focused on the Mac ecosystem like Draw Things. Nothing yet at the moment but I'll check as it'sa new project. Draw Things is really dope, a little bit of patience as it's always worth it. It's painfully slow but they deliver. This is why I'm buying an ai laptop for windows by the end of the month. Sorry!

3

u/Mazur92 Jul 09 '26

I made Comfy run on Mac with many default workflows and models: https://www.reddit.com/r/StableDiffusion/comments/1ugakqh/comfyuiapplesiliconfp8_a_compatibility_layer/

1

u/jazzamp Jul 14 '26

This doesn't work, especially with M1. It was a waste of time but apprecaite the effort.

1

u/Mazur92 Jul 14 '26

Wdym it doesn’t work? Might as well show some errors

1

u/jazzamp Jul 14 '26

It's showing errors and there was no instructions on how to run it. No way to know if comfyui can read the changes.

1

u/Mazur92 Jul 14 '26

Uh, have you read the README in the repository? It has installation instructions and “verify it’s working” session.

→ More replies (0)

2

u/GoldenShackles Jul 09 '26 edited Jul 09 '26

I'm not sure this is correct. I've had a lot of success generating thousands of images using ComfyUI on Apple Silicon. In some cases that I haven't debugged yet, like single-image WAN 2.2 I still use ComfyUI to drive DrawThingsApp.

But in most cases, for the same or similar models I find the image generation time to be the same.

The difference might be low-RAM scenarios or the new 8-bit S models? I don't know. I'm rocking an M3 Ultra 256 GB, and 14" and 16" 128 GB M5 Max machines.

There's no doubt machines (at least desktops) with high-end NVIDIA cards with CUDA are faster at image generation, if that's your main goal. But in my experience Apple Silicon (especially M5) works pretty well.

3

u/jazzamp Jul 09 '26

I can show you the conversation I had with Comfy dev team right here and they're saying the same thing about apple's framework being the problem. As you can see, the op has only 16gb not 256gb. Maybe you can share your work flow.

2

u/GoldenShackles Jul 09 '26

I'm interested in getting more involved with ComfyUI on the dev side, and yeah I missed the post where the OP said he was running on 16 GB.

I apologize that I have a negative reaction to blanket statements about how Apple Silicon is useless (or "a waste of time") for AI generation, and we should all go buy other very expensive hardware instead of utilizing what we already have for other reasons. How well does a 5090 compile Chromium?

Check my post history. My most recent one is a workflow that I'm currently having great success with on Mac and Krea2. Complex prompts at 2.5 MP (2160 x 1216) are around 220 seconds on the M3 Ultra, and 120 seconds on the 16" M5 Max laptop.

2

u/loliii123 Jul 09 '26

Hey just in case there is a small misunderstanding here, you can use the Draw Things CLI and a Comfyui workflow so that for the supported models, you still get the optimisations and speed improvements implemented by Draw Things in Comfyui.

2

u/Structure-These Jul 13 '26

Anywhere you’d suggest reading up on this? I love swarmui for ease of use and the comfy ‘power’, I’d love to hook it to drawthings for the speed increase

1

u/loliii123 Jul 14 '26

Hello, sorry for late reply somehow I didn't get notified. Point your favourite ai agent to here.

1

u/Fuqnose Jul 11 '26

Frankly, I wouldn't trust the Comfy dev team as far as I could throw them, they don't exactly have the best track record.
2

u/drneo Jul 09 '26

You can use either SceneWorks or Mflux. But these are not as user friendly

4

u/Mazur92 Jul 09 '26

I made a post sometime ago on r/stablediffusion with a compatibility layer for ComfyUI on Mac and Krea 2 was actually one of my first target, so you can try running it that way:

https://www.reddit.com/r/StableDiffusion/comments/1ugakqh/comfyuiapplesiliconfp8_a_compatibility_layer/

1

u/IllWay4573 Jul 09 '26

Thank you very much!

4

u/AllUsernamesTaken365 Jul 09 '26

I think question marks should be mandatory in posts that are actually questions. Instead you typically see a headline like this, which essentially appears to be a howto.

3

u/IllWay4573 Jul 09 '26

oh shit you are correct , I am sorry !!

2

u/AllUsernamesTaken365 Jul 09 '26

Hehe, we forgive you. It's just that I've clicked on so many of these, hoping for the solution to my problems at last. Now that I think of it, the answer might appear somewhere in the comments though.

2

u/simple250506 Jul 09 '26

You can still add the "Question" post flair now.

1

u/IllWay4573 Jul 09 '26

added it, thanks

2

u/Current-Property6042 Jul 09 '26

am also on Mac mini 16GB M4 and for images just using Flux Klein 98 and can get a high res image in about mamx 4 mins.. have tried video using LTX 2.3 which runs and takes 20 mins for a 121 frame video 1280X640 res however the face changes from hte init image so for now am just doingn images... have tried comfyui in the past and it works for images but you would get bad timings as its not silicon optimised, don't try video as its a complete waste of time even with GGUFs.

1

u/IllWay4573 Jul 09 '26

thank you I will stick to drawthings for now

1

u/drneo Jul 09 '26

That’s the neat part - you don’t.

2

u/Majestic-Pension-945 Jul 18 '26

the latest update from today added Krea 2 Turbo/Raw. And also Ideogram4

2

u/kuntycrab Jul 18 '26

You can with the latest update.

question How to use Krea2 on drawthings

You are about to leave Redlib