Overview
- Begin with the standard text-to-image graph.
- Install ControlNet Union through Model Manager and refresh.
- Install the ArtVenture custom nodes and restart ComfyUI.
- Disconnect the positive prompt from the KSampler.
- Add Apply ControlNet.
- Connect the positive prompt encoder to Apply ControlNet.
- Connect Apply ControlNet's conditioning output to the KSampler's Positive input.
- Add ControlNet Loader and select the installed ControlNet Union model.
- Add Load Image and upload a photograph containing the desired pose.
- Add AV ControlNet Preprocessor.
- Select SDXL, OpenPose, and a resolution such as 768 for the faster example.
- Set the generated image dimensions to the same scale.
- Connect the preprocessed image to Apply ControlNet.
- Set strength to 0.8.
- Preview the preprocessed pose image to confirm that it captured the intended skeleton.
- Enter a new positive prompt and queue the workflow.
- Increase strength toward 1 when the generated pose should follow the reference more strictly.
For a landscape transformation, upload a mountain image, choose Canny, inspect the edge map, and prompt for mountains at sunset. The resulting image follows the reference mountain shapes to some degree while changing the lighting and style.