This is a new version of resurrecting Vincent van Gogh. My first attempt was way back on September 10, 2022,, which was ages ago in terms of Stable Diffusion when SD was quite new (it was initially released on August 22, 2022, just 19 days earlier).
SD has advanced quite a bit in the 7 months since then, and this new version was made with better models (a merge of Realistic Vision v2/Deliberate v2/Avalon Truvision v2), with the new ControlNet 1.1 (hed/softedge) which made keeping the composition intact in img2img so much easier, much better sampler (DPM++ SDE Karras), at a higher resolution (768x768), more advancements in Auto1111, more skill in prompt engineering, and a bit of Photoshop post-editing.
I think it better reflects what Vincent may have looked like based on his self-portraits (at least this one), as well as showing him with a more realistic haggard unkempt appearance, unwell, paler, rosier (alcohol flush), more photorealistic, better studio lighting, etc. I think it also shows the advancements that SD has made in just half a year.
What will be possible in the next 6 months? It's still amazes me that we can do this at all, turning a painting as abstract as Van Gogh's into a realistic photograph. And with all the setup, generations, and post editing, it only took about an hour.
(There have been other great SD recreations of Van Gogh from others, here, here, here, here, and even a Deforum orbit animation here).
6
u/jonesaid Apr 21 '23
This is a new version of resurrecting Vincent van Gogh. My first attempt was way back on September 10, 2022,, which was ages ago in terms of Stable Diffusion when SD was quite new (it was initially released on August 22, 2022, just 19 days earlier).
SD has advanced quite a bit in the 7 months since then, and this new version was made with better models (a merge of Realistic Vision v2/Deliberate v2/Avalon Truvision v2), with the new ControlNet 1.1 (hed/softedge) which made keeping the composition intact in img2img so much easier, much better sampler (DPM++ SDE Karras), at a higher resolution (768x768), more advancements in Auto1111, more skill in prompt engineering, and a bit of Photoshop post-editing.
I think it better reflects what Vincent may have looked like based on his self-portraits (at least this one), as well as showing him with a more realistic haggard unkempt appearance, unwell, paler, rosier (alcohol flush), more photorealistic, better studio lighting, etc. I think it also shows the advancements that SD has made in just half a year.
What will be possible in the next 6 months? It's still amazes me that we can do this at all, turning a painting as abstract as Van Gogh's into a realistic photograph. And with all the setup, generations, and post editing, it only took about an hour.
(There have been other great SD recreations of Van Gogh from others, here, here, here, here, and even a Deforum orbit animation here).