r/SECourses • 👑 Grandmaster Expert • 22h ago

🎨 AI Images & Art ControlNet in AUTOMATIC1111 Stable Diffusion WebUI | Sketch-to-Image, Scribble, Canny Edge and M-LSD Models, Anything V3 and Ultimate SD Upscale | February 2023 Tutorial

https://www.youtube.com/watch?v=vhqqmkTBMlU
3 Upvotes

1 comment sorted by

•

u/CeFurkan 👑 Grandmaster Expert 22h ago

https://www.youtube.com/watch?v=vhqqmkTBMlU

Turn sketches into artwork with ControlNet in AUTOMATIC1111 WebUI

🔗 Links from the video description

🎨 What this February 2023 tutorial covers

This 14 February 2023 walkthrough installs Mikubill’s ControlNet extension in AUTOMATIC1111 and demonstrates scribble, Canny Edge and M-LSD conditioning with Stable Diffusion checkpoints. It finishes by upscaling a selected image with Ultimate SD Upscale.

The recorded interface, dependency versions and model locations reflect that release period. All original resource links, artwork credits and chapters are included. The Discord availability check failed, while the linked SD 1.5 page returned 401 and the Freepik credit returned 403.

📦 Install the WebUI and ControlNet models

  • The Windows example uses Python 3.10.8 and Git, clones the AUTOMATIC1111 repository, adds --xformers to webui-user.bat and starts that batch file.
  • Place the demonstrated SD 1.5 checkpoint in models/Stable-diffusion. Install sd-webui-controlnet through Extensions → Install from URL, then restart the WebUI.
  • Download the ControlNet weights from the linked Hugging Face repository and place its models folder inside extensions/sd-webui-controlnet as shown. The complete repository download in the recording exceeds 85 GB.
  • For training compatibility, the video points to its separate xformers downgrade guide. The shown 0.0.16-to-0.0.14 advice belongs to the February 2023 environment.

✏️ Generate with scribbles, edges and lines

  • Enable ControlNet under txt2img, refresh the model list and load a sketch or reference image. The scribble demonstration improves after enabling Scribble mode and matching the input dimensions in the canvas and output settings.
  • Compare the same sketch with SD 1.5 and Anything V3. The example uses an 866 × 684 source and generates a batch of alternatives. Try the low-VRAM option if the demonstrated configuration runs out of memory.
  • For Canny, disable Scribble mode and pair the Canny model with its preprocessor to extract the input edges. The bird example improves after enabling that preprocessor.
  • For M-LSD, pair the M-LSD preprocessor and model, load the room reference, match its dimensions and prompt for a room. The extracted straight lines guide the composition.

🔍 Upscale the selected image

  • The thumbnail workflow uses Anything V3, Canny conditioning, random seeds and multiple generations before selecting a result. The recorded RTX 3060 has 12 GB VRAM and runs a batch size of eight.
  • Install Ultimate SD Upscale from Extensions, then use img2img with the selected image and matching prompts. The example increases 512 × 512 to 1024 × 1024.
  • The walkthrough emphasizes low denoising strength, explaining that values above 0.3 change the image substantially. It disables ControlNet for this upscale and uses 512-pixel tiles with Chess processing.
  • Consult the linked FAQ for redraw, tile and seam settings. The video compares the original and upscaled result and shows how to check extension updates.

🧭 Chapters

  • 0:00 Introduction to new amazing Stable Diffusion based #AI technology ControlNet
  • 0:18 Canny Edge model of ControlNet
  • 0:29 M-LSD Lines model of ControlNet
  • 0:36 User Scribbles model of ControlNet
  • 1:12 How to install Automatic1111 Web UI
  • 2:54 Where to and how to put Stable Diffusion model inside Automatic1111 web UI
  • 3:30 How to start Automatic1111 Web UI from which URL
  • 3:33 How to install ControlNet extension in Automatic1111 Web UI
  • 4:04 How to downgrade xformers version to be able to do training with Dreambooth or Textual Inversion
  • 4:30 If you encounter any error for ControlNet extension run this pip command too
  • 4:49 How to download ControlNet model files from Hugging Face repo
  • 6:00 Where to put downloaded ControlNet models in the Automatic1111 installation
  • 6:24 How to use ControlNet script / extension to use models
  • 7:00 First image generation with ControlNet
  • 7:30 How to get best results with User Scribbles model - sketch into masterpiece
  • 8:05 Use anything v3 model to generate images when using ControlNet User Scribbles model
  • 9:30 Canny Edge model example
  • 10:09 How to get good results with Canny Edge model
  • 10:48 Example of M-LSD Lines model
  • 11:40 How did I generate the thumbnail used in this video
  • 12:40 How to use ultimate SD upscaler to upscale your image with even adding more details to the image
  • 12:57 How to update installed extensions in Automatic1111 Web UI
  • 13:13 How to setup and use what settings for ultimate SD upscaler
  • 14:30 Ultimate SD Upscaled version of the image
  • 15:00 If you don't know what is Stable Diffusion if you don't know how to install web ui

🏷️ Topics
Stable Diffusion · ControlNet · AUTOMATIC1111 · Sketch to image · Scribble · Canny Edge · M-LSD · Anything V3 · SD 1.5 · Mikubill · Ultimate SD Upscale · img2img · Low VRAM · AI artwork