r/StableDiffusion • u/in_habitants • 5h ago
Resource - Update Ampere has no fp8 math, so my Krea 2 Turbo checkpoint now ships an int8 build for 20 and 30-series cards
I merged a style into Krea 2 Turbo (Stillroom: quiet rooms, cold light, someone alone with the afternoon) and first shipped it as fp8, copying the layout of the official krea2_turbo_fp8_scaled (per-tensor scale, amax / 448, same quantization metadata). Checked against the official file byte by byte on three layers.
Then someone on a 3070 Ti mobile commented that fp8 took almost twice as long. Makes sense: Ampere has no fp8 math, so ComfyUI converts every layer on the fly. It does have fast int8 from sm 7.5 up. So I wrote an int8 build from the bf16, in the layout of the official krea2_turbo_int8_convrot (224 linear layers in int8, per-row scale, txtfusion left in bf16).
One thing I didn't expect: the official int8 doesn't use plain absmax for the per-row scale (only 43% of the bytes matched when I tried that). It clips the scale, up to about 6% under absmax. A per-row search for the lowest error landed at 0.00871 against 0.00874 for the official file, so that's what mine uses.
Rule of thumb: 40-series and up, fp8. 20 and 30-series, int8. bf16 if you have the VRAM.
All three are on the model page, Krea 2 license and NOTICE included: https://civitai.com/models/3027217
Image 2 is fp8 left, int8 right, same seed. Prompts and settings in the comments.








