ControlNet strength advisor
The two settings that make or break a ControlNet generation are the control weight and the guidance window (start % and end %). Too strong and the output is a stiff trace of your reference; too weak and the structure you wanted is ignored. This advisor turns “I want the pose but a totally different scene” into concrete numbers you can paste into A1111, ComfyUI or Forge.
How the recommendation is built
Each control type has a baseline weight reflecting how strict its map is — OpenPose and Canny grip hard, Scribble and Reference are gentle. Your freedom slider then shifts three things at once:
- Weight drops as you ask for more freedom (a looser grip on structure).
- Start % moves later, so the first noisy steps are unconstrained and the model can reinterpret the layout.
- End % moves earlier, handing the final detail steps back to the prompt.
The result is a balanced trio rather than a single number, because when the control is active matters as much as how hard.
Control type baseline weights at a glance
Different preprocessor maps carry very different structural authority. Here is roughly what to expect before you touch the freedom slider:
| Control type | Typical baseline weight | Notes |
|---|---|---|
| OpenPose | 0.9–1.1 | Skeleton map is strict; weights above 1.2 can distort limbs |
| Canny / Lineart | 0.8–1.0 | Edge maps grip hard; great for architecture, risky for faces |
| Depth | 0.7–0.9 | Softer than edges; gives 3D plausibility without locking detail |
| Scribble / Sketch | 0.6–0.8 | Loose by design; tolerates higher weights before over-constraining |
| Tile / Upscale | 0.5–0.7 | Used mainly to preserve local texture, not global structure |
| Reference | 0.5–0.8 | Style/character consistency; higher weights risk face cloning |
These ranges are starting points — model checkpoint, VAE, and sampler all shift the effective strength.
Worked examples
Example 1 — scene recomposition with a pose: You have a reference image of a person sitting and want to transplant the pose into a fantasy forest scene. Set control type to OpenPose and freedom slider to “loose”. A typical output might be weight 0.65, start 10%, end 70%. The early denoising steps are free to build the forest; the middle steps lock the skeleton; the final 30% of steps add texture and lighting without the rigid skeleton fighting the prompt.
Example 2 — product shot exact copy: You need to reproduce the exact layout of an architectural floor plan. Set control type to Canny/Lineart and freedom slider to “rigid”. Typical output: weight 1.05, start 0%, end 100%. ControlNet runs the full schedule at full strength — every wall and corner stays exactly where the edge map dictates.
Example 3 — style hint without over-constraining: You want to loosely follow a scribbled composition sketch. Scribble at medium freedom gives weight ~0.55, start 5%, end 60%. The rough shapes guide the composition but the model freely interprets textures, colours, and proportions.
Tips
- For faithful product or architectural renders, keep freedom low so the control runs the full schedule (0% → 100%).
- For character work, lock the pose but end control around 70–80% so faces and clothing get realistic detail in the late steps.
- If you see ghosting or doubled edges, your weight is too high — lower it by 0.2 before touching anything else.
- Stack multiple ControlNets carefully: two controls at 1.0 each can be stronger than one at 2.0, so lower each weight proportionally when combining pose + depth.
- Sampler matters. Euler and DPM++ samplers respond differently to the same weight. If switching samplers, re-check the recommended numbers.
- Re-run the advisor whenever you change the preprocessor — a different map type has a completely different baseline.