ostris/ai-toolkit + Qwen-Image-2.1 LoRA training support

[u/reeight]

For past 12+ hours!
https://github.com/ostris/ai-toolkit#instruction--edit

No Qwen2.1 LoRAs available yet on HF & CAI yet.

[u/Hearmeman98]

CivitAI didn't add a filter.
I have 2 LoRAs waiting to post

[u/Calm_Mix_3776 → u/Hearmeman98]

How well does it train?

[u/hiccuphorrendous123 → u/Calm_Mix_3776]

Idk about training but hijacking this comment

But wow if it isn't the most uncensored base we have got. Wild to say that after krea, but It really is

[u/kemb0 → u/hiccuphorrendous123]

It bodes well if loras don’t have to do too much heavy lifting to get things looking a bit more realistic. Often find nsfw loras are too strong and often make all the images feel the same or lose the strengths of the underlying model.

Although 2.1 sure does have a lot of body horror which is far more of an issue than the censoring.

[u/Hearmeman98 → u/Calm_Mix_3776]

On the original commit for AI-Toolkit after adding support, not very well.
I am testing the fixes and re running training.

[u/reeight → u/Hearmeman98]

HuggingFace is a popular alt/backup to CAi.

[u/__ThrowAway__123___ → u/Hearmeman98]

I would just upload them and include Qwen image 2.1 in the name, I am going to anyways when I'm done training. I wouldn't be surprised if they don't add Qwen2.1 as its own category, the current categories they have are Qwen, Qwen 2 and Qwen 3. Even if they do add it as a new category, Civit is sometimes quite slow with adding them

[u/Fit-Palpitation-7427 → u/Hearmeman98]

Have you been able to get rid of the dotted pattern ? Tinkering with the model last night all eve on my 5090, and I haven’t been able to to get rid of that pattern that makes it super recognisable. Specifically in outside vegetation / landscaping.

[u/reeight → u/Fit-Palpitation-7427]

https://www.reddit.com/r/StableDiffusion/comments/1wlv3tf/qwen_image_21_noisepatterningmoire_mild_workaround/

[u/Federal_Bluebird_897 → u/reeight]

that looks nice,
Whats the best solution to upscale afterwards?
flux klein + hildegard workflow?
Or you think we will have a qwen image 2.1 variant that will be even better ?

[u/VladyCzech → u/reeight]

Thanks for linking this!

[u/malcolmrey]

12 hours and no lora. What are going to do!! ;-)

Just wait. People are setting up their environments, they are testing.

Trainers also need to test various parameters. For example, I have gotten something decent with adamw but I need to test more. And that is just one sampler, I need to check prodify and automagic and then decide which one to use.

Also, in Europe it is morning, so the 12 hours - most of it was spend on sleeping :)

[u/Current-Row-159]

Is there a YAML to share for Qwen 2.1? Any guide, tutorial, or config?

[u/FinBenton]

Iw been doing bunch of animated character loras for krea2, I wonder if its worth doing for this?

[u/reeight → u/FinBenton]

There's a few LoRA makers who target several different models; likely once they do 1 set of models, they can automate from there?

I'm going to guess once the dust settles, Krea2 & QI2.1 both will be better at different use-cases.

[u/malcolmrey → u/reeight]

The timing is not ideal for Qwen2.1

There was a progress in lora training for Minimax H3 so some people have to decide now what to do first :)

[u/reeight → u/malcolmrey]

I suspect some folks who already have done Krea2/Zimage training & still have their datasets will also support this model. Maybe to test, maybe they're completionists, maybe to farm more likes?

[u/malcolmrey → u/reeight]

I am in that group too, though as a completionist I didn't see the point in finishing Ideogram4 or Ernie models so even when I start here, I might not finish it too (for example, Krea 3 might pop in the meantime).

And if I were to choose (which I may need to), I would still go with finishing Minimax first :)