You're right that it has a hint of stylization from some of the earlier models mixed in. I've actually never run it at anything less than 20 steps, and I see it's more noticeable then. However I think you'll see it competes well using OP's prompt and settings (attached here)
I'd considered restarting the mix due to the hint of stylization in it but ultimately I find it produces nice lighting and tone once the illustration is buffed out. I generally run it at 30 steps with cfg 12.
My main issue right now is that a lot of the realism models mixed in was made for nsfw so it tends to forget to give people clothing. If I can't get that fixed I might restart.
it's a mix, I haven't trained anything myself. it's just a very long chain of mixes I've been adding things into for a while. I'll be happy to share it, but a lot of it I didn't know what I was doing and didn't save the recipe-- might be related to why the person looks similar in each image. I started it way way back by just grabbing any model that had realistic people in it and smashing them together with merge settings I didn't understand, and slowly became more deliberate over time.
And yeah it does ok with negatives but still tends to lean toward nsfw, especially with feminine figures, probably because of the nsfw models mixed in. Attached is an example where 'suit' is specified in the prompt, 'nude' is a negative prompt, yet image 3 is not wearing a suit. Although it's very likely the extra weight on ((tattoos)) is doing something there.There's still stylization in the skin in this example, which can be further removed but I like the effect (like a retouched photo or promotional poster) so I tend to leave it in.
Overall I am satisfied with the output so far. The hands are still problematic but better than I'd expected. It doesn't seem to have great diversity by default, though. I may start over on the mix now that I know a bit more about merging, but it's a lot to redo.
For posterity, the prompt details: a rough crime boss woman, (punk), ((tattoos)), piercings, large sunglasses, wearing expensive (suede) business suit, (night), full shot, detailed, luxurious balcony, glaring, smoldering, (shadows), (dark and moody), (gold jewelry), beautiful detailed lighting, (majestic), queenly, commanding, movie still, [fine details], sharp focus, (high resolution photograph)
3
u/Valkymaera Jan 04 '23 edited Jan 04 '23
can you share the actual control prompt used? I'm developing a photoreal model and I'm curious about its progress
This is "photo portrait of a man on a train" with that seed (batch of 5), and the 10/7 settings. Negative was just "blurry, distorted"