> For the complete documentation index, see [llms.txt](https://docs.pletor.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.pletor.ai/model-library/lip-sync-models.md).

# Lip sync models

Lip sync models take existing video footage and match it perfectly with audio input, whether that's recorded voice or AI-generated speech. This eliminates the complex technical work traditionally required for dubbing, multilingual content, or AI avatar creation.

Use these models when you need to:

* **Dub existing videos** into multiple languages while maintaining natural lip movements
* **Animate AI-generated characters** or avatars with realistic speech
* **Create talking head content** without filming actual speakers
* **Edit dialogue in post-production** without reshooting footage
* **Produce multilingual campaigns** using the same visual assets

### Veed Fabric 1.0 (Popular)

*Image-to-video model that animates any image with speech-driven motion*

* **Strengths:** Works with any input image that can "speak" (photos, illustrations, mascots, 3D renders), audio drives lip movements plus body/hand/head motion, fast generation for videos up to 1 minute, preserves original image style, combines well with AI voices.
* **Weaknesses:** Generation time varies by resolution (1.5-5 minutes for 10-second clips), limited to talking/speaking scenarios
* **Use cases:** Product explainer videos with avatars, Facecam UGC-like video content, animated mascot content, multilingual campaigns, podcast clips converted to video
* **How to use effectively:** Upload any clear character or product image + provide audio recording or text script (auto-generates voice). 
* **Specs:** Up to 1 minute duration, resolution: 480p or 720p, aspect ratios: 16:9, 4:3, 1:1, 3:4, 9:16, scaled proportionally for other ratios (based on source image).
* **Model versions**: Available in Fast mode for quicker generation.

### Sync Lipsync 2.0 (Popular)

*Lip sync model for realistic audio-visual matching based on a reference video and an audio file*

* **Strengths:** Flawless lip sync animation, works with any character type (live-action, animated, AI-generated), preserves speaker's unique style across languages, editable dialogue in post-production
* **Weaknesses:** Requires separate video and audio inputs, limited to lip sync functionality only
* **Use cases:** Dubbing existing videos, multilingual content creation, AI avatar animations, post-production dialogue editing
* **How to use effectively:** Connect your video input (from any video generation model) + audio file (script reading or generated voice) for seamless lip sync matching
* **Specs:** Works with any video resolution, output length depends on audio input

### Hedra 3

*Talking head video generator with realistic lip-sync*

* **Strengths:** Realistic lip-sync and facial expressions, good character consistency with starting frame, high control over voice and script, handles videos up to 60 seconds
* **Weaknesses:** Limited to talking head scenarios, full-body movement less stable than face, background typically static, requires separate audio file generation
* **Use cases:** Product explainers, fake UGC or podcast content, talking mascots, AI spokesperson videos, multilingual campaigns using same face with different audio tracks
* **How to use effectively:** Provide high-quality portrait image (starting frame) + clean audio file (script) + text description for desired facial expressions and mood. Keep scripts conversational for realistic delivery
* **Specs:** 720p resolution, up to 60 seconds (depends on script length), aspect ratios: 1:1, 16:9, 9:16


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.pletor.ai/model-library/lip-sync-models.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.