AI Video Summary: The video demonstrates a workflow combining an IP adapter and a segmentation model to apply a Hawaiian shirt style to a selected part of an image, emphasizing fine-tuned adjustments, the ability to batch process and giving a detailed step-by-step guide on setting up and running the required custom nodes and models for this task, while also noting the process’s VRAM requirements and limitations in style transfer consistency.

ComfyUI Workflow Download Link: Changing Styles with IPAdapter and Grounding Dino

When we combine an IP adapter with a segmentation model, we can make fine-tuned adjustments to specific areas of an image. These adjustments can look significantly better than those achieved through traditional in-painting coupled with a ControlNet method.

The workflow featured in the video is broken into three components:

We’re using four different nodes in this area, which include the following: Load Image, IPAdapter Unified Loader, Load Clip Vision model, and IPAdapter Advanced.

The overall goal here is to understand the style of the reference image and pass that information along with the model so the output accurately understands what that reference image is about and applies it accordingly.

While in the example provided in the video uses a Hawaiian shirt, the input image could be any image that you want to extract the style from. This could be other shirt or fabric styles, paintings, monograms, etc.

Power-up: You can learn more about IPAdapters in this in-depth guide provided by HuggingFace.

Borrowing from the popular SD WebUI Segment Anything extension, the Segment Anything custom nodes for ComfyUI provided by storyicon allow you to provide a textual input and it will, if found, segment that object from an image. Both extensions are based on Grounding Dino.

The video demonstrates how to connect a Load Image node along with SAMModelLoader, GroundingDinoModelLoader, and the GroundingDinoSAMSegment nodes.

One important variable to touch on that wasn’t included in the video is the threshold value in the GroundingDinoSAMSegment node. Essentially, a lower value may result in more of an area being selected, whereas a higher value will be more specific. The problem is that too high of a value may result in nothing being selected at all.

Generally, the default value of 0.30 works well for most cases. Use the Convert Mask to Image node if you want to review the segment.

Have any questions on this workflow? Drop it below

Thanks for the video and tutorial. I love the concept of this.

Could you help with my issue please? Output completely ignoring clothes.

SETUP:

Comment

Save my name, email, and website in this browser for the next time I comment.

Nodes:

The post Quickly Change Styles, Clothes, and More with Precision in ComfyUI appeared first on Prompting Pixels.