comfyui_controlnet_aux

2888
By tstandley
Updated about 1 month ago
View on GitHub →See Common Issues →

Available Nodes

DSINE-NormalMapPreprocessor

Documentation for the DSINE-NormalMapPreprocessor Node

Overview

The DSINE-NormalMapPreprocessor is a node designed for the ComfyUI framework, specifically within the context of ControlNet preprocessor nodes. This node is part of the Normal and Depth Estimators category and is utilized to generate a normal map from an input image. A normal map is a type of image commonly used in 3D graphics to simulate the lighting of bumps and dents on surfaces.

Functionality

The primary function of the DSINE-NormalMapPreprocessor node is to transform an input image into a normal map. This process involves estimating the surface normals of the object(s) present in the image. The node utilizes the DSINE (an acronym for a deep learning-based method) algorithm to perform this transformation.

Inputs

The DSINE-NormalMapPreprocessor node accepts the following inputs:

  • Image: The source image from which the normal map will be generated.

  • Field of View (fov): A floating-point value that specifies the field of view for the estimation process. The default value is 60.0, with a maximum of 365.0. The field of view affects how the image is perceived in terms of depth.

  • Iterations: An integer defining the number of iterations for the estimation process. The default is set to 5, with a range from 1 to 20. More iterations may result in a more detailed normal map but could increase processing time.

  • Resolution: An integer specifying the resolution of the resulting normal map. Common values are typical resolutions like 512, 1024, etc.

Outputs

The node produces the following output:

  • IMAGE: The output is an image that represents the normal map derived from the input image. This normal map can then be used in various 3D visualization and rendering tasks.

Usage in ComfyUI Workflows

In a typical ComfyUI workflow, the DSINE-NormalMapPreprocessor node can be connected to other nodes that require normal maps as input. For example, it can be used in combination with rendering nodes or light simulation nodes within a ControlNet-based workflow.

Here’s a simplified workflow scenario:

  1. Input Image Node: Provide an image of a 3D object or scene.
  2. DSINE-NormalMapPreprocessor Node: Process the input image to produce a normal map.
  3. Output Node: Use the resulting normal map in subsequent nodes for simulation or visualization processes.

The node is particularly useful for users who are working on projects involving 3D graphics and need an efficient way to generate normal maps from 2D images.

Special Features and Considerations

  • Model Utilization: This node uses a pre-trained model tailored for normal map generation using the DSINE method, ensuring high-quality output.

  • Performance: Users should be aware that higher iterations and resolutions can significantly increase processing time. It’s advisable to start with the default settings and only increase these parameters if necessary for the specific application.

  • Device Compatibility: The node makes use of advanced computational models and may require appropriate hardware capabilities, such as a GPU, to function optimally.

The DSINE-NormalMapPreprocessor node is an essential tool for users seeking to integrate normal map generation into their workflows seamlessly. With its intuitive inputs and high-quality output, it enhances the capabilities of ComfyUI in handling complex image processing tasks.