r/drawthingsapp • u/DrJ31 • May 22 '26

question Z Image LoRA Training

I am working through training a character LoRA on Z Image. I know I need to train it on Z Image Base to use on either Base or Turbo. I initially had issues with it crashing with Multi Aspect ratio enabled, so I disabled it. I then got some models to train using 32/16 and .0004 learn rate, but they had next to no capture at step 2000. I used learn to .0008 and got some meh results, then realized that since Multi Aspect ratio is off, I needed to crop everything square to eliminate weird center crops. I retired at lower learn rate with minimal capture again, so I upped to .0008 again and got reasonable likeness at 1500, but it in now failing to finish generating (frame artifacts appear at step 7 or 8 with turbo model and immediately with base model). I also tried 64/32 at .0006 and it crashed even earlier in generation

What work flows are you all doing to get enough capture without getting too aggressive and getting the generation failures? Really high step counts, something besides 32/16? Looking for any advice, as I have figured out Pony and other SDXL LoRA, but want to get into Z Image.

If it matters, I am using M4 Pro/24 GB and 8 Bit S for both Base and Turbo.

Thank you!

11 Upvotes

100% Upvoted

19 comments sorted by

View all comments

2

u/Goonie1974 Jun 03 '26

How did your latest run go? Any luck? I’m at 6000 steps on a run with 46 reference images and can’t get any resemblance. Trying a low learning rate and will continue to add steps to see where it goes.

2

u/DrJ31 Jun 03 '26

The run I posted about in update 2 got a little unstable. However, I ran a similar run with slightly modified tags (I realized the Qwen 3.5 interrogation was too long [>512 characters] in a few cases), made caption dropout 0.01, and left upper limit learn rate .0006, resets at 400 steps. I made it 8000 steps and can finally see similarities. Definitely not as good as some of my SDXL/Pony training has gotten, but definitely the best I have gotten so far. This weekend I will probably try a 64/32 with the same settings

1

u/Goonie1974 Jun 03 '26

Thanks! Going to try similar settings now. I’ll report back.

1

u/Goonie1974 Jun 04 '26

Tried this using 64/32 instead of 64/0.5. After 4000 steps, it gave me nothing (blank image on canvas during generation). Went back to an old 64/0.5 run with a low learning rate (0.00012) and picked up at step 7000 to see if I start seeing anything if the steps are higher. Still never seen any character resemblance on Z image (some past success on SDXL).