Preview for ComfyUI Sonic | Lip-Sync Portrait Animation

Run this workflow on InstaSD

Get started in minutes! Run this ComfyUI workflow online - no setup required.

Description

Bring portraits to life with ComfyUI Sonic, a cutting-edge method that focuses on global audio perception for seamless and realistic lip-sync animation. Unlike traditional phoneme-based approaches, Sonic captures the full audio context, delivering natural, expressive facial movements that reflect true emotional depth. Perfect for content creators, game developers, and AI enthusiasts seeking next-level animation.


🎯 Features

  • Lifelike Lip-Sync Animations – Generate realistic mouth movements synced perfectly to audio.
  • Emotionally Expressive – Goes beyond basic phonemes for more nuanced, expressive animations.
  • Global Audio Context – Captures the full scope of speech for natural results.
  • Powered by Sonic Technology – Advanced audio processing ensures smooth, high-quality animation.

💡 Use Cases

  • Content Creation – Animate characters for YouTube, TikTok, or storytelling apps.
  • Game Development – Add immersive, lip-synced characters to your games.
  • Virtual Avatars – Bring virtual influencers and digital personas to life.

⚙️ How It Works

  1. Upload Your Portrait – Choose an image of your character or person.
  2. Add Audio – Upload a voice clip or any audio file for lip-syncing.
  3. Generate Animation – Watch as the portrait comes to life with realistic movement.
  4. Download & Share – Export your animation for use across platforms.

Credits: Comfy UI Sonic

Models

FileDestinationSource
svd_xt_1_1.safetensors/ComfyUI/models/checkpointsDownload
unet.pth/ComfyUI/models/sonicDownload
config.json/ComfyUI/models/sonic/whisper-tinyDownload
model.safetensors/ComfyUI/models/sonic/whisper-tinyDownload
preprocessor_config.json/ComfyUI/models/sonic/whisper-tinyDownload
audio2bucket.pth/ComfyUI/models/sonicDownload
audio2token.pth/ComfyUI/models/sonicDownload
yoloface_v5m.pt/ComfyUI/models/sonicDownload
flownet.pkl/ComfyUI/models/sonic/RIFEDownload
sonic-input-anime.8444a2d8.png/ComfyUI/inputDownload
sing_female_10s.wav/ComfyUI/inputDownload

Nodes

SONICSamplerSONIC_PreDataImageOnlyCheckpointLoaderLoadImageSONICTLoaderLoadAudioVHS_VideoCombine