Dream LipSync 2.0 - Video Lip Synchronization
Synchronize lip movements in videos with audio using the LipSync 2.0 API.
Quick Start
1. Get API Key
Before using this skill, you need a DreamAPI API key. Visit https://api.newportai.com/api-reference/get-started to sign up and get your API key.
For more AI tools, please visit: https://tools.dreamfaceapp.com/home
2. Configure API Key
openclaw config patch --json '{"skills": {"entries": {"dream-lipsync": {"env": {"DREAMLIPSYNC_API_KEY": "your-api-key-here"}}}}}'```
### 3. Usage
#### Parameters:
- **srcVideoUrl**: Source video URL (mp4)
- **audioUrl**: Audio URL (mp3, wav)
- **videoParams** (optional): Video processing options
- **video_width**: Output video width (0=keep original)
- **video_height**: Output video height (0=keep original)
- **video_enhance**: Face enhancement (0=no, 1=yes)
#### Request Format (Example):
```json
{
"srcVideoUrl": "https://example.com/video.mp4",
"audioUrl": "https://example.com/audio.mp3",
"videoParams": {
"video_width": 0,
"video_height": 0,
"video_enhance": 0
}
}
API Details
1. Get Upload Policy (for local files)
Upload your local files to OSS first (get upload policy, then upload).
POST https://api.newportai.com/api/file/v1/get_policy
Request Body:
{
"scene": "Dream-CN"
}
Response:
{
"code": 0,
"message": "success",
"data": {
"accessId": "LTAI5t...",
"policy": "eyJ...",
"signature": "G2...",
"dir": "tmp/dream/2026-03-17/xxxxxx/",
"host": "https://dreamapi-oss.oss-cn-hongkong.aliyuncs.com",
"expire": "1732005888",
"callback": "eyJ..."
}
}
2. Upload File to OSS
Upload to the host URL with form data (policy, OSSAccessKeyId, signature, key, callback, file).
Uploaded file URL: {host}/{dir}{filename}
3. LipSync 2.0 API
POST https://api.newportai.com/api/async/lipsync/2.0
4. Polling for Result
POST https://api.newportai.com/api/getAsyncResult
Implementation Notes
- All API calls require Authorization header
- Local files must be uploaded to OSS first
- Tasks are async, poll for results
- Poll every 2-3 seconds, timeout ~60 seconds
- Status: 0=pending, 1=processing, 2=processing, 3=completed, 4=timeout
- video_enhance=1 improves face clarity