Steerable Motion: A Custom Nodes Repository for ComfyUI

Table of Contents

1. Introduction
2. Installation
3. Node Descriptions
4. Special Features and Capabilities
5. Use in ComfyUI Workflows
6. Feedback and Community
7. Credits

Introduction

The Steerable Motion repository offers a custom node for ComfyUI designed to facilitate batch creative interpolation in videos using images. It aims to provide the highest quality and most precise motion steering methods as video models evolve. This repository is best experienced through the creative tool, Dough, or in a community setting such as Discord.

Installation

To install the Steerable Motion custom nodes within ComfyUI, follow these steps:

1. Install Prerequisites:

   • If not already installed, download and set up ComfyUI and Comfy Manager.

2. Download Workflow:

   • Obtain the workflow file here and place it into ComfyUI.

3. Install Missing Custom Nodes:

   • Open the workflow in ComfyUI, and use Comfy Manager to click on "Install Missing Custom Nodes."
   • Ensure that the required models are downloaded from Comfy Manager, with names matching those in the workflow.

Node Descriptions

The repository provides the following nodes:

• BatchCreativeInterpolation

  • Implemented as BatchCreativeInterpolationNode, this node is essential for creative interpolation of video frames using batches of input images.

• IpaConfiguration

  • Implemented as IpaConfigurationNode, it allows configuration of the IP-Adapter (IPA), which is crucial for steering motion and determining influence parameters.

• RemoveAndInterpolateFrames

  • Implemented as RemoveAndInterpolateFramesNode, it removes certain frames and interpolates between them, enabling smooth transitions in motion.

Special Features and Capabilities

• Customizable Interpolation:

  • Easily customize key frame positions, influence length, influence strength, and image adherence for precise control.

• Dynamic Settings:

  • Optionally apply settings linearly or dynamically for nuanced motion effects.

• Creative Flexibility:

  • Functions like a paintbrush where trial and error allow for the creation of visually appealing outputs, all based on user input and experience.

Use in ComfyUI Workflows

Steerable Motion is designed to be integrated into ComfyUI workflows, where it can significantly enhance video generation projects by offering advanced interpolating capabilities. Users can choose from different predefined workflows to start with, each offering unique characteristics and motion types. Additionally, community-created workflows build upon this node, showing its versatility and creative potential.

Feedback and Community

Join the vibrant community exploring creative and technical possibilities in the Discord channel here. The community is welcoming to new ideas and provides support and inspiration for pushing the limits of open-source models.

Credits

The development of Steerable Motion leverages significant inspiration and components from existing tools:

• Cubiq's IPAdapter_plus
• Kosinkadink's Animatediff Evolved
• Kosinkadink's ComfyUI-Advanced-ControlNet
• Fizzledorf's Fizznodes
• Fannovel16's Frame Interpolation

Gratitude is extended to all contributing developers and the supportive community behind these projects.