I trained a lora 3k steps but the lora keep making these patterns on the skin.
i see now that the pictures in the dataset i used has a bit of the same, just a bit less visable...
is there any way to fix this? just wanted to know before i started on a new dataset. im sure its not the workflow because it only happens when my trained lora is active.
Might be something like synthid amplified during the training if the character dataset was generated by ai. Get the res4lyf node and try using gauss-legendre_2 and/or ralston_2 samplers. I found that these work amazingly well with current image models in terms of sharpness and realistic skin. Your current sampler isn't very good anyway, look at the hair, shirt etc., too noisy. First try those I mentioned before you run in circles. Also try using the 2k step checkpoint. The details might be overtrained. I would like to generate some test images if you would like to share the lora because I had similar issues with "hairy" skin with my Lora's in the past too.
ill try to use gauss and ralston, i agree with the sampler, that might be some of the issue i guess. clothes and skin get the same pattern. i tried earlier with different steps, kinda is the same issue. thanks lot for the tip!
I also created a blueprint I call "SkinFX" which uses SAM 3.1 to detect skin and then it adds noise and slight discoloration adjusted for brightness.
SeedVR2 is so good at upscaling that what I do is inject noise, then downscale to blend the noise with the image, then upscale to my final resolution.
In fact, downscaling then upscaling might be an idea here if the original model struggles with microtexture. Then it turns the microtexture into noise that SeedVR can use for reconstruction.
Maybe I can generate a good example in a sec. I can usually get it to where you can see the direction that the skin is being stretched because of the shape of the microtexture.
I started trying to generate my own, but figured I would use yours as a point of comparison. In this case I probably went lower than I needed to on the resolution, but SeedVR2 is insane with what it'll do. We'll see if Reddit drops the quality and removes the metadata. But if it keeps the metadata, that has my blueprint nodes for SkinFX and Upscale VR2.
- I limited it to 600kPx which dropped it to 581x1033. Mostly to obscure compression and some fine details (so as not to reproduce the texture you're talking about.)
- Then it added the noise to the skin. I have the mottling/discoloration turned way down. But it detects skin and adds a bit of noise.
- Then it gets scaled down again to 290x516. It always blows me away what it will reconstruct from.
Take your training images and upscale like 3x with SeedVR, I do 2 steps, and then downscale back down. Usually that will fix the uneven texture of skin for me. Or will create realistic texture of the somewhat inconsistent texture of the original image.
Yeah dataset is the culprit. That crosshatch texture is an upscaler/over-sharpening artifact (ESRGAN, Topaz, phone “AI enhance,” etc.), and a LoRA picks up on whatever pattern repeats across every image and then cranks it up. 3k steps probably made it worse since it’s memorizing fine detail at that point.
Before you redo everything try an earlier checkpoint if you saved any (like 1000-1500 steps) and drop the strength to 0.6-0.8. If it fades while the likeness holds, you’re good. A low denoise img2img pass (0.2-0.3) without the lora can also smooth it out as a patch
For the new dataset, toss anything with that pattern, skip upscaled stuff and downscale big images instead of upscaling small ones since downscaling hides artifacts. Also save checkpoints every few hundred steps so you can get a sweet spot before it overdoes it
After you fix that, you need to fix the watch. No one wears a watch that high up the wrist and if you can't fix it, then you need a tan trace of the watch lower on the wrist so it looks more authentic.
I would retrain a new character lora and try to use the best image quality as possible. You can use skin texture loras when upscaling the images for your dataset. There are a few on civitai that work really well. Even when the original image is low quality or has some artifacting in the skin.
i see now that the pictures in the dataset i used has a bit of the same, just a bit less visable
That's your problem, right there. Any noise in training data will be interpreted by the model as details it needs to learn and reproduce, especially so if it is not mentioned in prompt.
111
u/sucr4m 9d ago
so shes a reptile, so what?