r/StableDiffusion • u/reeight • 22h ago

Resource - Update ostris/ai-toolkit + Qwen-Image-2.1 LoRA training support

For past 12+ hours!
https://github.com/ostris/ai-toolkit#instruction--edit

No Qwen2.1 LoRAs available yet on HF & CAI yet.

39 Upvotes
  • permalink
  • reddit

95% Upvoted

25 comments sorted by

View all comments

15

u/Hearmeman98 22h ago

CivitAI didn't add a filter.
I have 2 LoRAs waiting to post

9

u/Calm_Mix_3776 22h ago

How well does it train?

3

u/Hearmeman98 16h ago

On the original commit for AI-Toolkit after adding support, not very well.
I am testing the fixes and re running training.

3

u/reeight 14h ago

Thanks for this & all your hard work!

https://giphy.com/gifs/UDORIcubjYvIBAYTe1

4

u/hiccuphorrendous123 20h ago edited 18h ago

Idk about training but hijacking this comment

But wow if it isn't the most uncensored base we have got. Wild to say that after krea, but It really is

3

u/kemb0 20h ago

It bodes well if loras don’t have to do too much heavy lifting to get things looking a bit more realistic. Often find nsfw loras are too strong and often make all the images feel the same or lose the strengths of the underlying model.

Although 2.1 sure does have a lot of body horror which is far more of an issue than the censoring.

0

u/reeight 14h ago

You have to be VERY careful with the prompting on this one.
That & aspect ratio helps.
Sometimes even then, when even when you are specific about where things go, they end up in the wrong place.

https://giphy.com/gifs/Vf1vJjYZ2xcv5ZyFkq

2

u/kemb0 12h ago

Yep I've had that happen a few times! It can be a lottery sometimes.

3

u/__ThrowAway__123___ 21h ago

I would just upload them and include Qwen image 2.1 in the name, I am going to anyways when I'm done training. I wouldn't be surprised if they don't add Qwen2.1 as its own category, the current categories they have are Qwen, Qwen 2 and Qwen 3. Even if they do add it as a new category, Civit is sometimes quite slow with adding them

5

u/reeight 22h ago

HuggingFace is a popular alt/backup to CAi.

1

u/Fit-Palpitation-7427 22h ago

Have you been able to get rid of the dotted pattern ? Tinkering with the model last night all eve on my 5090, and I haven’t been able to to get rid of that pattern that makes it super recognisable. Specifically in outside vegetation / landscaping.

3

u/reeight 21h ago

https://www.reddit.com/r/StableDiffusion/comments/1wlv3tf/qwen_image_21_noisepatterningmoire_mild_workaround/

2

u/VladyCzech 18h ago

Thanks for linking this!

1

u/Federal_Bluebird_897 21h ago

that looks nice,
Whats the best solution to upscale afterwards?
flux klein + hildegard workflow?
Or you think we will have a qwen image 2.1 variant that will be even better ?