Searching for a ControlNet model can be time-consuming, given the variety of developers offering their versions. Each model has its unique features. I’ll list all ControlNet models, versions and provide Hugging Face’s download links for easy access to the desired ControlNet model.
Key Providers of ControlNet Models
lllyasviel/ControlNet-v1–1
This is the official version 1.1 from the ControlNet author, offering the most comprehensive model but limited to SD 1.5 version. If using fp16 mode, please download fp16 version.
kohya-ss/controlnet-lllite
A lightweight SDXL version with minimal capacity and RAM usage. It includes a version specialized for anime, highly recommended for efficiency.
diffusers/sdxl-controlnet
Providing various sizes of Canny and Depth versions, including an fp16 for selection.
TencentARC/t2i-adapter-sdxl
TencentARC offers multiple T2I Adapter SDXL models in addition to PhotoMaker models.
bdsqlsz/qinglong_controlnet-lllite
bdsqlsz provides several lightweight SDXL models to choose from.
thibaud | SargeZT | latentcat | huchenlei | monster-lab | h94
Each of these authors offers one or more ControlNet models and some unique specialized models.
Which Version Should You Choose?
In essence, opt for the version that suits your checkpoint and has the least capacity unless it significantly underperforms or presents other issues. Lesser capacity means lower RAM usage and faster processing without compromising on performance. Thus prioritize models with minimal capacity.
Download Stable Diffusion 1.5 ControlNet Model
lllyasviel
Canny (1.45GB) | Canny fp16 (723MB)
Depth (1.45GB) | Depth fp16 (723MB)
IP-Adapter (44.6MB) | IP-Adapter Plus (158MB)
Instruct Pix2Pix (1.45GB) | Instruct Pix2Pix fp16 (723MB)
LineArt (1.45GB) | LineArt fp 16 (723MB)
LineArt Anime (1.45GB) | LineArt Anime fp16 (723MB)
NormalMap (1.45GB) | NormalMap fp16 (723MB)
OpenPose (1.45GB) | OpenPose fp16 (723MB)
Scribble (1.45GB) | Scribble fp16 (723MB)
Segmentation (1.45GB) | SD Segmentation fp16 (723MB)
Shuffle (1.45GB) | Shuffle fp16 (723MB)
SoftEdge (1.45GB) | SoftEdge fp16 (723MB)
Tile (1.45GB)
latentcat
Brightness (1.45GB)
Illumination 11000 (1.45GB) | Illumination 15000 (1.45GB) | Illumination 2000 (1.45GB)
Recolor (723MB)
h94
FaceID (96.7MB) | FaceID Plus (157MB) | FaceID Plus V2 (157MB)
FaceID Portrait (64.6MB) | FaceID Portrait V1.1 (64.6MB)
IP Adapter Full Face (43.6MB) | IP Adapter Plus Face (98.2MB)
IP Adapter (44.6MB) | IP Adapter Plus (98.2MB)
IP Adapter Light (44.6MB) | IP Adapter Light V1.1 (44.6MB)
IP Adapter Vit-G (46.2MB)
huchenlei
Animal Openopose (1.45GB) | Animal Openpose fp16 (723MB)
monster-labs
QRCode Monster (723MB)
Download Stable Diffusion 2.1 ControlNet Model
thibaud
Canny (728MB)
Color (728MB)
Zoe Depth (729MB)
LineArt (728MB)
NormalMap (728MB)
OpenPose V1 (728MB) | OpenPose V2 (729MB)
Scribble (728MB)
Segmentation ade20k (728MB)
HED (728MB)
Download SDXL ControlNet Model
lllyasviel
IP-Adapter (703MB)
kohya-ss
Blur (46.2MB) | Blur Anime (46.2MB)
Canny (46.2MB) | Canny Anime (46.2MB)
Depth (46.2MB) | Depth Anime (11.3MB)
OpenPose Anime V1 (46.2MB) | OpenPose Anime V2 (46.2MB)
Fake Scribble Anime (46.2MB)
Replicate Anime v1 (22.5MB) | Replicate Anime v2 (46.2MB)
diffusers
Canny full (5GB) | Canny mid (1GB) | Canny small (640MB)
Canny full fp16 (2.5GB) | Canny mid fp16 (545MB) | Canny small fp16 (320MB)
Depth full (5GB) | Depth mid (1GB) | Depth small (640MB)
Depth full fp16 (2.5GB) Depth mid fp16 (545MB) | Depth small fp16 (320MB)
Zoe Depth (2.5GB)
TencentARC
Canny (316MB) | Canny fp16 (158MB)
Depth Zoe (316MB) | Depth Zoe fp16 (158MB)
Depth MiDas (316MB) | Depth MiDas fp16 (158MB)
Lineart (316MB) | Lineart fp16 (158MB)
OpenPose (316MB)
PhotoMaker (934MB)
Sketch (316MB) | Sketch fp16 (158MB)
bdsqlsz
Canny (224MB)
Depth (224MB)
Lineart Anime (224MB)
MLSD (224MB)
Normal Map (224MB) | Normal Dsine (224MB)
Recolor Luminance (224MB)
Segment Anime Face (224MB) | Segment Anime Face v2 (224MB)
T2I Adapter Color Shuffle (224MB)
Tile Anime Alpha (224MB) | Tile Anime Beta (224MB)
Tile Realistic (317MB)
SargeZT
Depth Faid Vidit (5GB) | Depth Faid Vidit (2.5GB)
Depth Zeed (5GB) | Depth Zeed (2.5GB)
Segmentation (5GB)
h94
FaceID (1.07GB) | FaceID Plus V2 (1.49GB)
FaceID Portrait (750MB) | FaceID Protrait Unnorm (1.01GB)
IP Adapter Plus Face Vit-H (848MB) | IP Adapter Plus Vit-H (848MB)
IP Adapter (703MB) | IP Adapter Vit-H (698MB)
ttplanet
Tile Realistic V1 (5GB) | Tile Realistic V1 fp16 (2.5GB) | Tile Realistic V2 fp16 (2.5GB)
thibaud
OpenPose (5GB)
InstantX
InstantID (2.5GB)
monster-labs
QR Code Monster (5GB)
Please let me know if you don’t want to share your model here.