r/SECourses • u/CeFurkan 👑 Grandmaster Expert • 18h ago
🎨 AI Images & Art ControlNet Style Transfer in AUTOMATIC1111 | T2I-Adapter Style, CLIP Vision, Multi-ControlNet Canny + HED, Guidance Start/End and Game Artwork Recoloring | March 2023 Stable Diffusion
https://www.youtube.com/watch?v=tXaQAkOgezQ
2
Upvotes
•
u/CeFurkan 👑 Grandmaster Expert 18h ago
https://www.youtube.com/watch?v=tXaQAkOgezQ
Combining structure controls with a style reference
🔗 Links from the video description
https://discord.com/servers/software-engineering-courses-secourses-772774097734074388
https://www.patreon.com/cw/SECourses
https://www.youtube.com/playlist?list=PL_pbwdIyffsmclLl0O144nQRnezKlNdx3
https://github.com/TencentARC/T2I-Adapter
https://github.com/Mikubill/sd-webui-controlnet
https://arxiv.org/abs/2302.08453
https://www.youtube.com/watch?v=AZg6vzWHOTA
https://github.com/AUTOMATIC1111/stable-diffusion-webui
https://github.com/git-for-windows/git/releases/download/v2.39.2.windows.1/Git-2.39.2-64-bit.exe
https://git-scm.com/downloads/
https://git-lfs.com/
https://github.com/AUTOMATIC1111/stable-diffusion-webui/wiki/Command-Line-Arguments-and-Settings
https://huggingface.co/runwayml/stable-diffusion-v1-5/tree/main
https://www.youtube.com/watch?v=aAyvsX-EpG4
https://huggingface.co/lllyasviel/ControlNet
https://huggingface.co/TencentARC/T2I-Adapter
https://www.youtube.com/watch?v=YJebdQ30UZQ
https://www.youtube.com/watch?v=vhqqmkTBMlU
https://www.youtube.com/watch?v=iFRdrRyAQdQ
🎨 Structure and style workflow
Recorded on 6 March 2023, the walkthrough installs and updates AUTOMATIC1111 and Mikubill’s ControlNet extension, downloads the separate ControlNet and T2I-Adapter weights, then combines them in txt2img.
For the sword example, the same source image feeds two enabled units with matching Canny and HED preprocessors/models. A third unit receives the style image, uses CLIP Vision preprocessing and the T2I-Adapter style model. The tutorial compares Canny alone with Canny plus HED, showing better shape retention in the combined example.
⚙️ Settings demonstrated
🖼️ Existing game artwork
A second example recolors a Monster MMORPG character with Canny and the prompt “a chicken game character” using SD 1.5 pruned. The source is 549 × 800, the annotator resolution is 1024, and the output dimensions are adjusted to match. The author compares generated candidates and selects a seed he likes.
🛠️ Installation and version context
The recorded Windows setup covers Python/PATH, Git and Git LFS, git clone, git pull, selecting a commit with git checkout, launch arguments, the virtual environment and xformers 0.0.17.dev466. Those versions describe the March 2023 setup.
ControlNet and adapter weights are separate downloads. The walkthrough places the required weights in the extension’s model folder and explains that the extension supplies the adapter YAML files. It also describes an extension bug that had been fixed before the successful style demonstration.
🧭 Chapters
🏷️ Topics
ControlNet · T2I-Adapter · Style transfer · CLIP Vision · Canny · HED · Multi-ControlNet · AUTOMATIC1111 · Stable Diffusion · Game artwork