360 Secure SkillHub
360 安全技能中心

UGC Manual

核心功能是将带清晰人脸的图片与用户自录/外部音频结合，生成人脸对口型的MP4视频，无需AI语音生成。典型场景包括用户有自录语音、外部TTS音频、需将人脸与音乐同步。输入支持JPG/PNG图片及MP3/WAV/OGG等音频，输出为对口型视频，精准保留原音频时序，区别于veed-ugc的AI语音生成逻辑。

pauldelavallaz
pauldelavallaz
热度 94.89
最近更新 2026-05-11 16:25:06
分类：创作依赖：代码执行 / 第三方 API / 读写文件应用场景：视频编辑 / 自动化脚本 / 工作流 / file_conversion

安装技能

复制下面的话术发给你的 Agent，它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill： npx secure-skills-cli add ugc-manual
Metadata
name
ugc-manual
description
Generate lip-sync video from image + user's own audio recording. ✅ USE WHEN: - User provides their OWN audio file (voice recording) - Want to sync image to specific audio/voice - User recorded the script themselves - Need exact audio timing preserved ❌ DON'T USE WHEN: - User provides text script (not audio) → use veed-ugc - Need AI to generate the voice → use veed-ugc - Don't have audio file yet → use veed-ugc with script INPUT: Image + audio file (user's recording) OUTPUT: MP4 video with lip-sync to provided audio KEY DIFFERENCE: veed-ugc = script → AI voice → video ugc-manual = user audio → video (no voice generation)

UGC-Manual

Generate lip-sync videos by combining an image with a custom audio file using ComfyDeploy's UGC-MANUAL workflow.

Overview

UGC-Manual takes:

  1. An image (person/character with visible face)
  2. An audio file (user's voice recording)

And produces a video where the person in the image lip-syncs to the audio.

API Details

Endpoint: https://api.comfydeploy.com/api/run/deployment/queue Deployment ID: 075ce7d3-81a6-4e3e-ab0e-7a25edf601b5

Required Inputs

Input Description Formats
image Image with a visible face JPG, PNG
input_audio Audio file to lip-sync MP3, WAV, OGG

Usage

uv run ~/.clawdbot/skills/ugc-manual/scripts/generate.py \
  --image "path/to/image.jpg" \
  --audio "path/to/audio.mp3" \
  --output "output-video.mp4"

With URLs:

uv run ~/.clawdbot/skills/ugc-manual/scripts/generate.py \
  --image "https://example.com/image.jpg" \
  --audio "https://example.com/audio.mp3" \
  --output "result.mp4"

Workflow Integration

Typical Use Cases

  1. Custom voice recordings - User records their own audio via Telegram/WhatsApp
  2. Pre-generated TTS - Audio generated externally (ElevenLabs, etc.)
  3. Music/sound sync - Sync mouth movements to any audio

Example Pipeline

# 1. Convert Telegram voice message to MP3 (if needed)
ffmpeg -i voice.ogg -acodec libmp3lame -q:a 2 voice.mp3

# 2. Generate lip-sync video
uv run ugc-manual... --image face.jpg --audio voice.mp3 --output video.mp4

Difference from VEED-UGC

Feature UGC-Manual VEED-UGC
Audio source User provides Generated from brief
Script N/A Auto-generated
Voice User's recording ElevenLabs TTS
Use case Custom audio Automated content

Notes

  • Image should have a clearly visible face (frontal or 3/4 view)
  • Audio quality affects output quality
  • Processing time: ~2-5 minutes depending on audio length
  • Audio auto-conversion: The script automatically converts any audio format (MP3, OGG, M4A, etc.) to WAV PCM 16-bit mono 48kHz before sending to FabricLipsync
  • Requires ffmpeg installed on the system