Metric3D-NormalMapPreprocessor Documentation

Overview

The Metric3D-NormalMapPreprocessor is a node within the ComfyUI ecosystem specifically designed for creating normal maps based on 3D metrics. It serves as one of the preprocessor nodes that convert input images into normal maps, which can be used as hint images for ControlNet, a neural network platform that assists with generating customized outputs in various style forms.

Functionality

What This Node Does

The Metric3D-NormalMapPreprocessor node processes an input image to generate a normal map. A normal map is a texture that provides a technique for simulating the lighting of bumps and dents on a surface without using additional polygons. It is especially useful for creating detailed textures and realistic shading effects in computer-generated imagery and rendering.

Inputs

This node accepts the following inputs:

• Image: The primary input, an image that the node will process to generate a normal map.
• Backbone: A dropdown option to select the model architecture. Available options include:
  • vit-small
  • vit-large
  • vit-giant2
• Focal Length X (fx): An integer value representing the focal length in the x-direction. It defaults to 1000 and can be adjusted between 1 and the maximum allowed resolution.
• Focal Length Y (fy): An integer value representing the focal length in the y-direction. It also defaults to 1000, with the same adjustable range as fx.
• Resolution: Defines the output resolution of the normal map. It can be adjusted based on user preferences and system capabilities.

Outputs

The node produces a single output:

• Normal Map Image: An image file representing the normal map generated from the input image.

Usage in ComfyUI Workflows

The Metric3D-NormalMapPreprocessor node can be integrated into ComfyUI workflows as a pre-processing step for generating hint images for ControlNet. The normal maps generated by this node can provide depth and surface orientation information, which can be used by ControlNet for further processing, such as producing stylized or modified output images.

This node can be particularly beneficial for users who want to incorporate realistic textures, shading, or 3D effects in their image-generation workflows. The flexibility offered by choosing different backbones and resolution settings allows for customization based on specific project needs and hardware capabilities.

Special Features or Considerations

• Backbone Selection: The ability to choose different backbone architectures (vit-small, vit-large, vital-giant2) provides flexibility in the level of detail and computational resources required for generating the normal maps.
• Resolution and Focal Length Customization: Users can adjust the resolution and focal lengths (fx, fy) to tweak the normal map output, catering to their specific requirements.
• Integration with ControlNet: As part of a broader ecosystem, this node is designed to enhance the functionality of ControlNet by providing additional data inputs that can guide and improve output generation.

Overall, the Metric3D-NormalMapPreprocessor node is a powerful tool for enhancing image-processing workflows, offering detailed control over the creation of realistic 3D effects.