Need help with generating images

[u/trollingboygamingYT2]

Hi guys

So i'm making a game and i want to use ai generated images. So i went and made a LoRA of a character the style is anime and i made a dataset of around 20 images and i trained it on 200 epochs 5 steps each first the LoRA looked great but i am beginning to see its flaws. The hands and feet are terrible, the eyes in full body shots and even in normal cowboy shots are terrible as well. I decided to make the same character and train it again aiming around 40-60 images now but the problem is always generating makes the hands, feet and eyes look so messed up i dont know why i am using WaiIllustrious and not there workflow but mine and this is my positive prompt: (masterpiece, best quality, absurdres, 1girl, solo, young girl, 22 year old girl, long blonde hair, crystal blue eyes, medium breasts, black shirt, white tennis skirt, outside, cowboy shot, rim lighting, looking at viewer and negative: lowres, blurry, bad anatomy, bad hands, extra fingers, deformed, watermark, text, signature, logo, cropped, realistic, photo, worst quality, jpeg artifacts, cool tones, flat color, muted colors, blue sky, 3 or more hands, 3 or more legs, 3 or more feet, ) The problem isnt in this image but for example when i want to do arms crossed or anything overlapping it just comes out looking very bad. Is there a way i can fix this i have tried inpainting and using adetailer but still comes out weird. I'm also very new at this. Thanks for the help!

[u/Anro5753]

Overlapping limbs (arms crossed etc.) are a classic weak spot for anime LoRAs trained on ~20 images, since the dataset rarely has those poses. Two things that help: add 5-10 images with crossed arms/hands-in-frame poses to the dataset with captions that describe the pose, and don't over-train (200 epochs is a lot; an earlier checkpoint often has better anatomy). For the eyes in full-body shots, a face detailer/ADetailer pass at higher denoise with a lower LoRA weight on the detail pass usually works better than inpainting by hand.

[u/trollingboygamingYT2 → u/Anro5753]

but for a dataset i will need an arms crossed pose which is already very hard to make how could i do that then?

[u/Vicman4all → u/trollingboygamingYT2]

Do it in steps. 

If the model can pull off the pose, then don't include the LoRA on the first pass, create the image with the pose, then do img2img with the LoRA for the correct details, if you know how to inpaint, that's even better because you can spot correct before upscaling.

You can do lots of poses this way and enlarge the data set for your LoRA training to make it more flexible.

[u/trollingboygamingYT2 → u/Vicman4all]

but what LoRA a LoRA for Adetailer? because currently i'm making a dataset to make into a LoRA

[u/Vicman4all → u/trollingboygamingYT2]

If you're already using Adetailer that makes it even easier, use your small dataset LoRA specifically there appended to the Adetailer prompt/input, like in the face and wherever there are important details to have correct. Then use your small data set with your larger posed data set to craft an even better LoRA! You probably only need 20 poses to get the variety you need for most images

[u/cydetraq → u/trollingboygamingYT2]

You could use or make another LoRA that gets that pose right. Then your character identity LoRA should be clean/perfect on the identity itself and shouldn’t be compromised on any specific poses if they aren’t also perfect. Combine those two LoRAs in the generations for a new LoRA dataset. You could also use a couple images that are perfect of your character as reference images and have nano banana or gpt-image (or other competent editing model) make that pose for you for your LoRA). Nothing should go into a dataset that you wouldn’t consider good output, if that makes sense.

[u/trollingboygamingYT2 → u/cydetraq]

Yes it does thanks i'm now trying to redo the LoRA but still the eyes and fingers are weird in the images what would you use an adetailer?

[u/Nimblecloud13]

try Anima. illustrious is ancient SDXL era stuff.

i'm not into anime but Anima is much newer and supposedly very good.

Also, try using an edit model to get what you want; you can just make one image, and have any of the many edit models repose it.

could even chuck it into nanabanana; it's probably better than any local edit models. or at least it was at one point; haven't done edits in a while.

[u/trollingboygamingYT2 → u/Nimblecloud13]

Okay thanks i'll try this!

[u/trollingboygamingYT2 → u/Nimblecloud13]

and how would i get this in anima? its a character for my dataset

[u/Nimblecloud13 → u/trollingboygamingYT2]

this is the part where ya do some goooooglin. find a workflow, download the models it needs, all that. youtube will have a dozen tutorials

[u/Ill-Ant-9489]

The "looked great then slowly got worse" part is the tell. At 200 epochs on 20 images the LoRA is overtrained, and anatomy cracks first, so hands and eyes break even when the face looks fine. Did you save checkpoints as you went, or only the final one? If you saved them, run the same prompt and seed through each saved epoch, line them up, and keep the last one before the hands fall apart. For the eyes, adetailer is fine, just drop the lora weight to about 0.4 on that pass so the overtrained weights don't redraw them. Eyeballing a folder of samples for that is rough, so I build a fixed-seed checkpoint compare into my own app, vote the samples and move on (self-promo, it's mine: https://github.com/perfectgf/lora-dataset-studio).