Run this workflow on InstaSD
Get started in minutes! Run this ComfyUI workflow online - no setup required.
Description
Bring portraits to life with ComfyUI Sonic, a cutting-edge method that focuses on global audio perception for seamless and realistic lip-sync animation. Unlike traditional phoneme-based approaches, Sonic captures the full audio context, delivering natural, expressive facial movements that reflect true emotional depth. Perfect for content creators, game developers, and AI enthusiasts seeking next-level animation.
🎯 Features
- Lifelike Lip-Sync Animations – Generate realistic mouth movements synced perfectly to audio.
- Emotionally Expressive – Goes beyond basic phonemes for more nuanced, expressive animations.
- Global Audio Context – Captures the full scope of speech for natural results.
- Powered by Sonic Technology – Advanced audio processing ensures smooth, high-quality animation.
💡 Use Cases
- Content Creation – Animate characters for YouTube, TikTok, or storytelling apps.
- Game Development – Add immersive, lip-synced characters to your games.
- Virtual Avatars – Bring virtual influencers and digital personas to life.
⚙️ How It Works
- Upload Your Portrait – Choose an image of your character or person.
- Add Audio – Upload a voice clip or any audio file for lip-syncing.
- Generate Animation – Watch as the portrait comes to life with realistic movement.
- Download & Share – Export your animation for use across platforms.
Credits: Comfy UI Sonic
Models
File | Destination | Source |
---|---|---|
svd_xt_1_1.safetensors | /ComfyUI/models/checkpoints | Download |
unet.pth | /ComfyUI/models/sonic | Download |
config.json | /ComfyUI/models/sonic/whisper-tiny | Download |
model.safetensors | /ComfyUI/models/sonic/whisper-tiny | Download |
preprocessor_config.json | /ComfyUI/models/sonic/whisper-tiny | Download |
audio2bucket.pth | /ComfyUI/models/sonic | Download |
audio2token.pth | /ComfyUI/models/sonic | Download |
yoloface_v5m.pt | /ComfyUI/models/sonic | Download |
flownet.pkl | /ComfyUI/models/sonic/RIFE | Download |
sonic-input-anime.8444a2d8.png | /ComfyUI/input | Download |
sing_female_10s.wav | /ComfyUI/input | Download |
Nodes
SONICSamplerSONIC_PreDataImageOnlyCheckpointLoaderLoadImageSONICTLoaderLoadAudioVHS_VideoCombine