PuLID ComfyUI Custom Nodes Documentation

Overview

PuLID ComfyUI is a custom nodes repository designed to integrate the PuLID framework into ComfyUI. This integration enables users to directly implement PuLID's capabilities within ComfyUI workflows. PuLID, established as a native implementation, leverages advanced machine learning models to improve image generation fidelity and style adaptation.

Installation

To successfully install the PuLID ComfyUI custom nodes, follow these steps:

1. Download the PuLID pre-trained model:

   • PuLID pre-trained model should be placed in ComfyUI/models/pulid/.

2. Automatic Download of EVA CLIP:

   • The EVA CLIP model, specifically EVA02-CLIP-L-14-336, will be automatically downloaded and located in the huggingface directory.

3. Install facexlib Dependency:

   • Ensure facexlib is installed. The necessary models will be downloaded on first use.

4. Install InsightFace with AntelopeV2:

   • Download and unzip the AntelopeV2 models into ComfyUI/models/insightface/models/antelopev2.

Repository Purpose

This repository provides a set of custom nodes that facilitate the integration of the PuLID framework within ComfyUI. This integration focuses on enhancing image generation processes by improving attention masking, style fidelity, and flexibility to align closely with reference images or styles.

Node Types

This repository offers the following nodes:

• PulidModelLoader: Loads the PuLID models necessary for image processing.
• PulidInsightFaceLoader: Loads the InsightFace models required for facial recognition and processing.
• PulidEvaClipLoader: Loads the EVA CLIP models.
• ApplyPulid: Applies the PuLID framework to the workflow with standard parameters.
• ApplyPulidAdvanced: Provides advanced configuration options for applying PuLID, including fidelity and projection settings.

Special Features and Capabilities

• Attention Masking and Advanced Node: Added on 2024.05.12, these features enhance the ability to fine-tune image generation by adjusting how closely the generated image adheres to a reference.

• Method Parameter: Allows different approaches in applying weights:

  • Fidelity: Ensures resemblance to the reference ID.
  • Style: Offers more style freedom.
  • Neutral: Provides no normalization, with adjustments applied manually in advanced settings.

• Projection and Fidelity Options in the Advanced Node: Facilitates nuanced control over the stylistic and fidelity outcomes of the generated images.

Usage in ComfyUI Workflows

PuLID ComfyUI can be instrumental in workflows that require high-level image manipulation, particularly:

• Enhanced image fidelity and stylistic adaptation.
• Leveraging advanced settings for fine-tuned image output.
• Maintaining high-quality outputs from reference images, facilitated by the integration of state-of-the-art models like EVA CLIP and InsightFace.

By embedding these nodes into their workflows, ComfyUI users can achieve more precise and stylistically coherent results, making it an invaluable tool for artists and developers working within this UI framework.