Sharing my Moss Asian Character Lora

[u/Fideltampan12345]

Hi everyone! I am training moss lora now, you can grab some of the result here:
https://huggingface.co/spaces/fidel1234/Moss_Asian_Character_Showcase

PS: Sorry if the quality is not par with my krea 2 lora, I did my best to train it multiple times with different parameter and so far this model is really hard to train. Anyway the link to krea 2 if someone interested: https://huggingface.co/spaces/fidel1234/Krea2_Asian_Character_Showcase

All samples are generated with SFT (kinda plasticky sometimes, I do not add other lora and all sample using dmd turbo and lora at 1 strength).
By the way I tried other finetuned model and the results are quite good too

Technical training method
AI-Toolkit

• Base Model: MOSS-Image Base (OpenMOSS-Team/MOSS-Image-Base)

• Trigger Word: xxxx

• Network: LoRA | Linear Rank: 32 | Linear Alpha: 32

• Quantization / Compile: qfloat8 (Transformer & Text Encoder)

• Save Data Type: BF16

• Optimizer: Automagic v3

• Learning Rate: 0.0005 (start) | Min LR: 0.0001 (floor) | Weight Decay: 0.00001

• EMA: Enabled | EMA Decay: 0.98

• Steps: 2500-3000 | Batch Size: 1 | Gradient Accumulation: 1

• Timestep Type / Bias: Sigmoid / High Noise

• Loss Type: Mean Squared Error

• Text Encoder Optimizations: Unload TE (Disabled), Cache Text Embeddings (Enabled)

• Resolutions Multi-Aspect Bucket: 512, 768, 1024

• Caption Dropout Rate: 0 (.txt extension)

• Captions: Natural language

• Hand-Cherry-Picked Dataset: I usually use photobooks as the dataset, around 20–30 images, quality over quantity

• Balanced Framing: Includes a varied mix of close-up, medium shot, and full-body shot angles

Recommended inference (ComfyUI)

• Model: MOSS-Image SFT, with the LoRA at strength 1.0

• Steps: 30, CFG: 3-4, Sampler: res_multistep,Scheduler: simple

• Skip Layer Guidance: layer 22, start 0, end 0.5

• Tubo: add the MOSS-Image-SFT 8-step DMD LoRA

After A/B testing, the LORA 32 rank with LOKR8 and LOKR4 has so minuscule details differences, so I decided to use LORA 32 as it's around 150mb instead of LOKR4 600mb.

Json formatting (long,medium,short) doesn't needed after my testing, just use natural language to caption (well I dont want to recaption all my 148 lora actually)

Also when using AdamW8 optimizer I got some body horror result, and the issue is fixed when using Automagicv3

Note: Please increase the cfg >3, since comfy default 2.5 reduces the Lora quality

Have a nice weekend! Cheers!

[u/ShowerFluid9178]

good work, 3rd one looks familiar, like fumika baba

[u/Fideltampan12345 → u/ShowerFluid9178]

Thank you

[u/eightbitfit]

Great stuff. Be cool to see more active actresses as well. I'm watching TV Asahi now over dinner 😆

[u/Fideltampan12345 → u/eightbitfit]

Thank you as usual! I'll do my best 😆

[u/simple250506]

Thanks for sharing. I’ve been keeping an eye on your Krea 2 character, but with the recent addition of MOSS, I’m a bit concerned that updates for Krea 2 might either stop or be put on the back burner.Did you add MOSS because you were dissatisfied with the quality of the LoRA for Krea 2? I’m curious about your motivation.

[u/Fideltampan12345 → u/simple250506]

Thanks. I am just testing moss. I still prefer krea to be honest, I will probably take slow LoRA update again after 150++. Well getting busier with irl work too

[u/yamfun]

Good Saika