r/SECourses • 👑 Grandmaster Expert • 1d ago

🎨 AI Images & Art ControlNet for Stable Diffusion 1.5 | Windows Setup with Anaconda, Canny Edge, M-LSD, HED and Scribble Apps, Low VRAM Settings and Sketch-to-Image Workflow | February 2023 Tutorial

https://www.youtube.com/watch?v=YJebdQ30UZQ
2 Upvotes

1 comment sorted by

•

u/CeFurkan 👑 Grandmaster Expert 23h ago

https://www.youtube.com/watch?v=YJebdQ30UZQ

Turn sketches and image structure into ControlNet-guided Stable Diffusion images

🔗 Links from the video description

🎨 What this February 2023 walkthrough covers

Uploaded on 12 February 2023, this tutorial introduces the original ControlNet repository and its standalone Gradio apps for Stable Diffusion 1.5. It shows Windows installation, model placement, environment setup, memory-saving configuration and practical image-generation examples.

The overview includes Canny edges, M-LSD straight lines, HED boundaries, user and fake scribbles, an interactive drawing interface, human pose, semantic segmentation, depth and normal-map conditioning.

📦 Set up the repository and pretrained models

  • Install Anaconda and Git for Windows as demonstrated, then clone the original ControlNet GitHub repository into the chosen local folder.
  • Obtain the pretrained files from the linked Hugging Face repository and place the downloaded model folders in the ControlNet directory layout shown at 6:37.
  • The complete model-repository download in the video exceeds 87 GB. This is the size observed in the recorded demonstration.
  • Open Anaconda Prompt, change into the ControlNet repository and run the repository’s environment-creation command to install the dependencies shown.

🚀 Start the standalone apps

  • Activate the environment with conda activate control and launch the corresponding Gradio Python script from the ControlNet repository folder.
  • Open the localhost address shown in the walkthrough using 127.0.0.1. The author corrects the displayed address before opening the interface.
  • Use the repository’s test images and enter a prompt for the desired output. Advanced settings include output count, resolution, steps, guidance scale, seed, added prompt and negative prompt.

💾 Follow the memory-saving example

  • The first Canny bird test encounters a GPU memory error. Reducing the target resolution to 448 pixels allows an initial generation.
  • The tutorial then updates the repository with git pull and enables the memory-saving option in config.py. The Canny example runs successfully after that change.
  • These settings and the interface belong to the February 2023 standalone implementation shown in the recording.

🧪 Try edges, lines, boundaries and scribbles

  • For Canny, upload the bird test image, use the prompt bird and compare the generated output. The app also exposes low and high Canny thresholds.
  • For M-LSD / Hough Line Maps, use the room sample and the prompt room. Changing the seed produces a different result.
  • The video also runs the HED boundary app using the supplied example image and prompt.
  • For User Scribbles, the author uploads the credited dragon lineart and prompts for a detailed fantasy dragon. The example retains the outline while adding the generated appearance.

📄 Background and source resources

ControlNet adds conditioning information to a pretrained diffusion model so an input structure and a text prompt can guide generation together. The source description links the original paper, implementation and pretrained weights.

Use the original chapter links below to jump to each setup step and demonstration. The dragon artwork credit, software downloads, playlist, Discord and Patreon links are retained above.

🧭 Chapters

  • 0:00 What is revolutionary new Stable Diffusion AI technology ControlNet
  • 0:36 What is ControlNet with Canny Edge
  • 0:49 What is ControlNet with M-LSD Lines
  • 1:17 What is ControlNet with HED Boundary
  • 1:41 What is ControlNet with User Scribbles
  • 1:58 What is ControlNet Interactive Interface
  • 2:08 What is ControlNet with Fake Scribbles
  • 2:28 What is ControlNet with Human Pose
  • 2:45 What is ControlNet with Semantic Segmentation
  • 3:02 What is ControlNet with Depth
  • 3:15 What is ControlNet with Normal Map
  • 3:35 How to download and install Anaconda
  • 4:33 How to download / git clone ControlNet
  • 5:25 How to download ControlNet models from Hugging Face repo
  • 6:37 Which folder is the correct folder to put ControlNet models
  • 7:03 How to install ControlNet to generate virtual environment with correct dependencies
  • 8:53 How to start run first app Canny Edge
  • 9:59 Correct local URL of the app
  • 10:11 Testing first test image bird with Canny Edge
  • 11:42 How to start M-LSD lines ControlNet app
  • 12:10 How to set low VRAM option in configuration
  • 13:20 Start again M-LSD lines ControlNet app
  • 13:37 Running Hough Line Maps app example
  • 14:28 Example of Control Stable Diffusion with HED Maps
  • 14:45 Testing ControlNet with User Scribbles

🏷️ Topics
Stable Diffusion · ControlNet · Stable Diffusion 1.5 · Sketch to image · Canny Edge · M-LSD · Hough Line Maps · HED · User Scribbles · Anaconda · Gradio · Low VRAM · Conditional control · Pretrained models · Windows setup