> For the complete documentation index, see [llms.txt](https://docs.pletor.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.pletor.ai/models/lip-sync-models.md).

# Lip sync models

Lip sync models take existing video footage and match it perfectly with audio input, whether that's recorded voice or AI-generated speech. This eliminates the complex technical work traditionally required for dubbing, multilingual content, or AI avatar creation.

Use these models when you need to:

* **Dub existing videos** into multiple languages while maintaining natural lip movements
* **Animate AI-generated characters** or avatars with realistic speech
* **Create talking head content** without filming actual speakers
* **Edit dialogue in post-production** without reshooting footage
* **Produce multilingual campaigns** using the same visual assets

How to choose:

* Animating a still image (character referecence, illustration, mascot) → **Veed Fabric 1.0**
* Re-syncing existing video to new audio → **Sync Lipsync 2.0**
* Portrait-based talking head when neither above fits → **Hedra 3**

### Veed Fabric 1.0 (Popular)

*Image-to-video model that animates any image with speech-driven motion*

* **Strengths:** Works with any input image that can "speak" (photos, illustrations, mascots, 3D renders), audio drives lip movements plus body/hand/head motion, fast generation for videos up to 1 minute, preserves original image style, combines well with AI voices.
* **Weaknesses:** Generation time varies by resolution (1.5-5 minutes for 10-second clips), limited to talking/speaking scenarios
* **Use cases:** Product explainer videos with avatars, Facecam UGC-like video content, animated mascot content, multilingual campaigns, podcast clips converted to video
* **How to use effectively:** Upload any clear character or product image + provide audio recording or text script (auto-generates voice). 
* **Specs:** Up to 1 minute duration, resolution: 480p or 720p, aspect ratios: 16:9, 4:3, 1:1, 3:4, 9:16, scaled proportionally for other ratios (based on source image).
* **Model versions**: Available in Fast mode for quicker generation.

### Sync Lipsync 2.0

*Lip sync model for realistic audio-visual matching based on a reference video and an audio file*

* **Strengths:** Flawless lip sync animation, works with any character type (live-action, animated, AI-generated), preserves speaker's unique style across languages, editable dialogue in post-production
* **Weaknesses:** Requires separate video and audio inputs, limited to lip sync functionality only
* **Use cases:** Dubbing existing videos, multilingual content creation, AI avatar animations, post-production dialogue editing
* **How to use effectively:** Connect your video input (from any video generation model) + audio file (script reading or generated voice) for seamless lip sync matching
* **Specs:** Works with any video resolution, output length depends on audio input

### Hedra 3

*Talking-head generator from a portrait image. Lower performance than Veed Fabric.*

* **Strengths:** Realistic lip-sync and facial expressions, good character consistency with starting frame, high control over voice and script, handles videos up to 60 seconds
* **Weaknesses:** Limited to talking head scenarios, full-body movement less stable than face, background typically static, requires separate audio file generation
* **How to use effectively:** Provide high-quality portrait image (starting frame) + clean audio file (script) + text description for desired facial expressions and mood. Keep scripts conversational for realistic delivery
* **Specs:** 720p resolution, up to 60 seconds (depends on script length), aspect ratios: 1:1, 16:9, 9:16