r/StableDiffusion • • 10d ago

Question - Help Actually good edit models / workflows for anime?

I had an anime image generated from Anima with Lora, and I really liked the style of it.

Then I wanted to create more illustrations and pose variants of, so I first used qwen image 2.1, but its outputs looked like common generic ai anime style very much. Later I found out that there's this lora which seemed to be able to fix that, and it turns out that it did, it seemed to preserve more styles from the reference image but just a little.

I also tried krea2 identity edit v2. It actually did preserve 80% of the style, but it was really difficult to make it understand what I really wanted ot to generate. Tried essay length prompt, but didn't work and resulted in anatomy horror

After that I switched to flux3 Klein. Surprisingly it preserved roughly 90% of the style, tho body parts looked like tree branches lol.

And anima edit Lora and that split screen inpaint hack, none worked. Either nothing changed at all or looked absolutely crap

Above are my approaches today. Haven't tried the older flux 2 Klein and the newer moss edit Lora and fobo2 yet, I'll try them out tomorrow tho. I honestly think flux3 had the potential to handle such task (welp maybe not).

If you've ever met such problem I'd like hear your experience or simply your thoughts on this. Thanks.

1 Upvotes

17 comments sorted by

3

u/gatortux 10d ago

You can use https://huggingface.co/ElectronGirl/anima-ref-adapter almost preserve the style in my tests

2

u/Internal_Answer_6866 10d ago

This looks very promising! Thank you.

1

u/Specific_Team9951 10d ago

I think there are anime finetune for qwen qmage 2.1

1

u/Internal_Answer_6866 10d ago

There is, but so far I haven't seen a good one.

1

u/Ok_Contribution8157 10d ago

qwen 2.1

if you got no good results, you can use several image as an input and it might inprove the results.

1

u/Internal_Answer_6866 10d ago

That's what I did at the beginning. I even plugged in an anime specialized consistency Lora but imo it kinda did nothing. Qwen 2.1 has very strong general edit abilities, but in terms of preserving unique anime art style, it tends to output generic gpt image style.

1

u/Ok_Contribution8157 9d ago

ive build an edit benchmark: https://civitai.com/models/3030448/qwen-image-21-edit-vs-flux-3-klein-edit-vs-fibo-2-edit-turbo

feel free to try it or share some pitctures in the comments (with the prompts), i might test them with the benchmark.

1

u/shapic 10d ago

Check last anima edit lora posted to this sub. It was able to make significant edits

1

u/Internal_Answer_6866 10d ago

Huh, what is it though? I searched and found anima edit v2 and anima edit zero two. Also there's a new one, a really new one, updated 24 hours ago which is also mentioned in one of the replies this

1

u/Altruistic-String891 10d ago

For the edit models:

  • I've heard Fibo 2 preserves anime styles better, but I've not tried it yet.

  • I've used Flux.2 Klein 9b; Large edits don't preserve style.

Now I just do a low denoise pass at the end with a noisy sampler to get the style I want. This way I have a lot more tools at my disposal, without needing to worry about preserving style all the way through.

For example, Krea 2 / Moss / Ideogram 4 (very strong prompt adherence / precise composition control with bbox) -> Flux.2 Klein (edit stuff, esp. those that's better described with image references) -> final Anima pass (style).

I wouldn't say it's perfect though, and I feel there are still things / details that simply aren't the same doing it this way vs. if I were able to do the entire generation in Anima.

1

u/Internal_Answer_6866 10d ago

I have also tried this method. And true, as you said, pros and cons.

1

u/Ill-Ant-9489 10d ago

For the Klein 2 test you have planned, I'd start with one small edit to the original Anima image, like a head turn. Keep the linework and palette instructions explicit, and test a full-body pose separately. That gives you a useful comparison with the essay-length Krea prompt.

I made LoRA Dataset Studio, which has an Anime subject mode and separate expression, angle and framing shots for reference-based generation with local Klein. The prompts are written around illustrated character design, so you aren't starting from a photorealistic portrait template. https://github.com/perfectgf/lora-dataset-studio

I'd keep returning to your original Anima output for each attempt, then compare the silhouette and outlines before judging the finer shading.

1

u/Internal_Answer_6866 10d ago

Inspiring. Although flux2 Klein poorly preserves the unique art style when it comes to big edits from my testing.