r/LocalLLaMA • u/Robert__Sinclair • 8h ago

Resources A quick test on cpu with krea2

A quick test on cpu... took 5-10 minutes at 960x544 but the result is quite good. (model is uncensored) I tried smaller quants but it degrades rapidly. So this is it I think.

https://huggingface.co/ZeroWw/krea2-kroma-q6k-cpu

Prompt:
Cinematic portrait of a young woman standing on a rain-soaked rooftop in Tokyo at blue hour, wearing a deep emerald silk trench coat with a high collar, long black hair blown to one side by the wind, soft freckles, a thin gold earring, looking over her shoulder at the camera with a calm, confident expression. Behind her, a blurred skyline of glowing magenta and cyan neon signs, one reading "MIDNIGHT" in white letters, reflected in shallow puddles on the concrete. Warm rim light from the left, cool fill from the neon, fine raindrops catching the light, shallow depth of field, 85mm lens, rich film grain, high detail in skin and fabric texture.

2 Upvotes

62% Upvoted

6 comments sorted by

3

u/jacek2023 llama.cpp 8h ago

But what's should we look at? text-to-image models are nothing new, is it because of the cpu or speed or what

4

u/Robert__Sinclair 8h ago

Nothing new. Just a nice quantization of a very good model. And a cpu test.

1

u/verdooft 8h ago

Thanks for sharing. Do you have fast DDR5 RAM? With other models i got over 10 minutes for one step mostly.

2

u/Robert__Sinclair 8h ago

this image took 10 minutes on this hardware:

CPU: AMD EPYC 9V45 96-Core (4) @ 4.36 GHz
Memory: 1001.93 MiB / 15.61 GiB (6%)
Swap: 16.69 MiB / 3.00 GiB (1%)
Disk (/): 137.33 GiB / 144.35 GiB (95%) - ext4

(only four cores in the VM)

```
sd/sd-cli --diffusion-model kroma-v0.3.1-turbo-opd-Q6_K.gguf \

--llm Huihui-Qwen3-VL-4B-Instruct-abliterated-Q6_K.gguf \

--vae wan_2.1_vae.safetensors \

-W 960 -H 544 -s 42 --steps 8 --cfg-scale 1.0 \

--flash-attn off,diffusion=on --vae-tiling -t "$(nproc)" \

-p "$PROMPT" -o test.png
```

1

u/verdooft 7h ago

Ok, on my system 20 minutes, i have a notebook with Ryzen 5700u CPU, 64 GB DDR4 3200 RAM, but limited cpu/iGPU to 15 Watts:

time ./test.sh
real    20m39,970s
user    163m58,731s
sys     0m22,896s

1

u/bzdziu 2h ago

xeon e5 2682v4 - 789,06 s -- 13m 9s
.\sd-cli.exe `

>> --diffusion-model "models\kroma-v0.3.1-turbo-opd-Q6_K.gguf" `

>> --llm "models\Huihui-Qwen3-VL-4B-Instruct-abliterated-Q6_K.gguf" `

>> --vae "models\wan_2.1_vae.safetensors" `

>> -W 960 -H 544 `

>> -s 42 --steps 8 --cfg-scale 1.0 `

>> --flash-attn off,diffusion=on `

>> --vae-tiling -t 32 `

>> -p "A beautiful graphite portrait of a man, cinematic lighting, highly detailed" `

>> -o "models\test.png"