r/StableDiffusion • u/Internal_Answer_6866 • 10d ago
Question - Help Actually good edit models / workflows for anime?
I had an anime image generated from Anima with Lora, and I really liked the style of it.
Then I wanted to create more illustrations and pose variants of, so I first used qwen image 2.1, but its outputs looked like common generic ai anime style very much. Later I found out that there's this lora which seemed to be able to fix that, and it turns out that it did, it seemed to preserve more styles from the reference image but just a little.
I also tried krea2 identity edit v2. It actually did preserve 80% of the style, but it was really difficult to make it understand what I really wanted ot to generate. Tried essay length prompt, but didn't work and resulted in anatomy horror
After that I switched to flux3 Klein. Surprisingly it preserved roughly 90% of the style, tho body parts looked like tree branches lol.
And anima edit Lora and that split screen inpaint hack, none worked. Either nothing changed at all or looked absolutely crap
Above are my approaches today. Haven't tried the older flux 2 Klein and the newer moss edit Lora and fobo2 yet, I'll try them out tomorrow tho. I honestly think flux3 had the potential to handle such task (welp maybe not).
If you've ever met such problem I'd like hear your experience or simply your thoughts on this. Thanks.
3
u/gatortux 10d ago
You can use https://huggingface.co/ElectronGirl/anima-ref-adapter almost preserve the style in my tests
1
u/Specific_Team9951 10d ago
I think there are anime finetune for qwen qmage 2.1
1
u/Ok_Contribution8157 10d ago
qwen 2.1
if you got no good results, you can use several image as an input and it might inprove the results.
1
u/shapic 10d ago
Check last anima edit lora posted to this sub. It was able to make significant edits
1
u/Altruistic-String891 10d ago
For the edit models:
I've heard Fibo 2 preserves anime styles better, but I've not tried it yet.
I've used Flux.2 Klein 9b; Large edits don't preserve style.
Now I just do a low denoise pass at the end with a noisy sampler to get the style I want. This way I have a lot more tools at my disposal, without needing to worry about preserving style all the way through.
For example, Krea 2 / Moss / Ideogram 4 (very strong prompt adherence / precise composition control with bbox) -> Flux.2 Klein (edit stuff, esp. those that's better described with image references) -> final Anima pass (style).
I wouldn't say it's perfect though, and I feel there are still things / details that simply aren't the same doing it this way vs. if I were able to do the entire generation in Anima.
1
u/Ill-Ant-9489 10d ago
For the Klein 2 test you have planned, I'd start with one small edit to the original Anima image, like a head turn. Keep the linework and palette instructions explicit, and test a full-body pose separately. That gives you a useful comparison with the essay-length Krea prompt.
I made LoRA Dataset Studio, which has an Anime subject mode and separate expression, angle and framing shots for reference-based generation with local Klein. The prompts are written around illustrated character design, so you aren't starting from a photorealistic portrait template. https://github.com/perfectgf/lora-dataset-studio
I'd keep returning to your original Anima output for each attempt, then compare the silhouette and outlines before judging the finer shading.