-
-
Notifications
You must be signed in to change notification settings - Fork 847
ControlNet
ControlNets allow you to select a image to guide the AI, to make it follow your control image more closely. You can pick a filter to pre-process the image, and one of the known (or custom) controlnet models.
While this sounds similar to image-to-image, ControlNets allow the AI to extract meaningful information from the image and make completely different images in the same style. For e.g. following the same body posture as your initial image, or the same color style or image composition.

- In the
Image Settingspanel, set aControl Image. This can be any image that you want the AI to follow. For e.g. download this painting and set that as the control image. - Then set
Filter to applytoCanny. This will automatically selectCannyas the controlnet model as well. - Type
Emma Watsonin the prompt box (at the top), and use1808629740as the seed, andeuler_awith 25 steps andSD 1.4model (or any other Stable Diffusion model). - Make an image.
It'll take a while during the first image, since it'll download about 1.3 GB of models for the canny controlnet.
You can also set a photo of a person in a particular pose, and make the AI follow that pose. For e.g.
- Download this photo of a man, and set that as the control image
- Set
Filter to applytoOpen Pose(the first one). This will automatically selectOpenPoseas the controlnet model. - Type
Knight in black armorin the prompt box (at the top), and use1873330527as the seed, andeuler_awith 25 steps, andSD 1.4model (or any other SD model). - Make an image.
You can also use images generated in the OpenPose format, e.g. from the civitai poses category. For e.g.
- Download this openpose photo (stick figure), and set that as the control image.
- Set
Filter to applytoNone. - Set
ModeltoOpen Pose - Type
Knight in black armorin the prompt box (at the top), and use1873330527as the seed, andeuler_awith 25 steps, andSD 1.4model (or any other SD model). - Make an image.
- A collection of pose images: https://openposes.com/
- Make your custom pose images: https://app.posemy.art/ or https://openposeai.com/