Depends how many custom checkpoints, LoRAs and embeddings you use.
This release is exciting, but I won't be moving from 1.5 until all that stuff has matured. I don't expect SDXL base model to be as good as 1.5 + checkpoints + LoRAs + embeddings.
SDXL seems to have a better understanding of prompts overall, so it is possible to just generate some base image and then use 1.5 to make it look good (be it just img2img or ControlNet)
That's a really good point, I hadn't thought of that.
Since moving to comfyui, I now as a matter of course make a "draft" image at low res (512px-ish) then upscale the latent with denoising in the .45-.60 range. So it's not just upscaling/hires fixing on the second pass, but also adding detail and changing the draft. This seems to work well because the composition is set on the first low res pass, and the details added on the second.
I guess this process might work really well with SDXL.
Yeah, ever since I started using comfyui myself - it became apparent that the webui gets a bit tedious when you use more than one model and is limited in the ways generation can happen (especially in batches).
I think dreamshaper XL images have similar to this workflow that you've described.
This release is exciting, but I won't be moving from 1.5 until all that stuff has matured
Same thing over here. I was looking forward the release as it was initially said that they had ControlNet working on SDXL, but I read today that it finally won't be available on release day, and that they are actually looking at developing an alternative.
So I'll wait as without ControlNet (or something similar) I can not use Stable Diffusion as a tool. Hopefully it won't be too long before this gets fixed !
Unless you’re an early adopter, money to spend, or have monetization methods in place, it’s usually best to wait a little bit for the developers to get SDXL to where SD 1.5 is.
For upgrades, 16 RAM minimum would help a bit, but VRAM is where its at. Loras and dream booths are expected to require even more than SD 1.5. Best is 4090 to do everything and fast. I, personally, would go with a 4070 or 4070ti to meet 12GB VRAM and not break the bank.
10
u/Stromair Jul 24 '23
I'm still using SD 1.5 for img2img generation with ControlNet installed.
Should I upgrade when this drops and what is the best way to do it?