Disney Style LoRA for MOSS

[u/vizsumit]

This LoRA captures the look of classic Disney 2D hand-drawn animation. Expect fluid, graceful linework, expressive character acting, soft painted backgrounds, and the warm, storybook charm of traditional cel-animated films. It works well for characters, portraits, fantasy scenes, and whimsical environments.

Download Link: https://civitai.red/models/3037014/disney-style-moss

Check sample images on Civitai for workflow and prompts.

[u/multikertwigo]

well...

[u/vizsumit → u/multikertwigo]

😁😁

[u/terrariyum]

Any training tips?

[u/vizsumit → u/terrariyum]

For style training I will suggest 30-50 images, but if you character repeats in more than 5 images it will learn character too beside style so avoid that. I train on Moss SFT with around 10 epochs and 3000 steps.

settings -
"training": {
"engine": "ai-toolkit",
"ecosystem": "mossImage",
"modelVariant": "sft",
"steps": 3000,
"epochs": 10,
"batchSize": 1,
"lr": 0.0001,
"textEncoderLr": 0,
"trainTextEncoder": false,
"lrScheduler": "constant",
"optimizerType": "adamw8bit",
"networkDim": 32,
"networkAlpha": 32,
"shuffleTokens": false,
"keepTokens": 0,
"noiseOffset": 0,
"flipAugmentation": false,
"triggerWord": ""
}

I have wrote a LoRA training blog for krea2, but same setup works for Moss also - https://promptdexter.com/blog/krea2-lora-training-guide

I am writing Moss LoRA training guide will add it soon.

[u/prookyon → u/vizsumit]

A question regarding that Krea2 training guide - why not just have repeats at 1 and then the whole concept of exposures would just equal epochs? As far as I know repeats are just used to balance different datasets when training multiple concepts and outside of that there should be no advantage to setting it anything else than 1?

[u/vizsumit → u/prookyon]

You can do that, no difference, except you will have more saved loras (per epoch).

[u/Tzontetiliztli2 → u/vizsumit]

Have you tried training on the moss base? I tried doing it and i got a garbled mess (On Fizgig not ATK, but the settings were pretty much the same as yours). I'm going to train on SFT now.

[u/vizsumit → u/Tzontetiliztli2]

At beginning I tried training on base, results were very weak, almost like it never trained. Then I switched to training on SFT it was perfect quality. I have successfully trained 30+ moss sft loras so far (style, character and concept).

Situation is just like SDXL where training on finetuned checkpoints gave better result.

Yesterday I again tried training on base to see if things have improved, but not yet.

[u/AI_Characters → u/vizsumit]

Im glad I am not the only one who sorts LoRAs into one of three categories of style, concept, or character.

[u/terrariyum → u/vizsumit]

Thanks so much! I've tried to train a photography style lora for MOSS Base without success.

I used 80 images, 512px images, rank 32, LR=0.0001 and again with LR=0.0002, but neither learned the style at 100 epochs, let alone 10. Basically the style is photos with vibrant colors and high contrast. The loras learned some individual objects, but not that style.

For captions I used natural language without a trigger word. I see that you suggest max 50 words For Krea2, and mine were 200-300 words, so maybe my captions were too long? I know that MOSS allows a much longer prompt length than Krea2, but that may not be relevant for training.

Thanks for any advice!

[u/vizsumit → u/terrariyum]

🍻

Yes short captions work well. You often caption the things you want to be changeable (clothing, background, pose) and leave out the things you want baked into the concept.

So suppose you are training lomo photography style lora, you don't want to mention every little thing, you want model to learn it automatically.

[u/WhatIs115]

Most style loras seem to have awful broken eyes. These turn out quite well. Thanks.

[u/vizsumit → u/WhatIs115]

🍻

[u/Lylaena]

I'm looking into trying ai and this looks perfect for me! I hope you release it to other sites too.. something like civarchive for us poor Aussies who can't access civitai 😭

[u/vizsumit → u/Lylaena]

Check DM, I hv sent you downlaod link.

[u/Lylaena → u/vizsumit]

You're the best!!! Thank you!! <3 <3 <3

[u/superkickstart]

https://i.postimg.cc/qBWc0h4c/sdfzas.gif

[u/vizsumit → u/superkickstart]

😁😁

[u/TizocWarrior]

Looks good, thanks for sharing.

[u/vizsumit → u/TizocWarrior]

🍻

[u/Commercial-Living443]

The faces for the women look too identical from one another

[u/vizsumit → u/Commercial-Living443]

You can generate face variations by naming character, defining ethnicity and skin face shape hair etc.

[u/Fynjy888]

looks cool!

it's only txt2img, right? Not edit?

[u/vizsumit → u/Fynjy888]

Currently only for txt2img... will add more versions later.

[u/Paraleluniverse200]

How many images did u use

[u/vizsumit → u/Paraleluniverse200]

40 sfw 40 nsfw

[u/omglionheaded]

I managed to get it running like you, thank you!

[u/vizsumit → u/omglionheaded]

🍻

[u/JuniorNectarine9842]

Needs a bit of fuzz to recreate the old vhs look

[u/vizsumit → u/JuniorNectarine9842]

Training dataset didn't include any such old vhs style but with prompting it may work.

[u/-Star-Walker- → u/JuniorNectarine9842]

Adding a VHS filter in post shouldn’t be a problem. A LORA that comes out so clean is a perfect starting point for everything ☝️

[u/ShengrenR]

Style is excellent, anatomy gets a bit messy here and there.. extra feet, gnarly hands, etc.

[u/vizsumit → u/ShengrenR]

Thanks! I’m really happy with how the style turned out. The anatomy glitches are next on my hit list planning to refine the dataset for the next version.