360 Secure SkillHub
360 安全技能中心

whisperx

该 Skill 调用 Replicate 的 WhisperX 模型,将音频转写为带词级时间戳的 JSON 和 SRT,适合歌词对齐、剪切安全分句与字幕源时间生成;需提供音频并开启 align_output。

pruna-ai
pruna-ai
热度 57.59
最近更新 2026-10-15 23:43:33
分类:效率依赖:代码执行 / 读写文件 / 第三方 API应用场景:数据处理 / 视频编辑 / 工作流

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add pruna-ai/whisperx
Metadata
name
whisperx
description
Use when someone needs word-level timestamps from audio — lyric alignment, cut-safe line boundaries, or caption source timing before burn-in with video-editing.
license
MIT
metadata
{"version":"1.0.15","package":"pruna-skills","provider":"replicate","replicate_model":"victor-upmeet/whisperx"}

Prerequisites

Install and load these skills before generating (skip if already in context via @pruna):

Skill Description Install
generation-diversity Use when writing any generative prompt — ritual seed, explicit structure, scenario axes, and quality gates before paid API calls. npx skills add PrunaAI/pruna-skills@generation-diversity -y
pruna-api Use before any Pruna or Replicate HTTP call — credentials, upload/poll/download, parallel batches, and agent safety. npx skills add PrunaAI/pruna-skills@pruna-api -y

Or install the full suite once: npx skills add PrunaAI/pruna-skills@pruna -y

Follow each skill's Before generating / craft sections — do not restate guide content here.

Agent habit

In the first reply, name `whisperx` in backticks, confirm REPLICATE_API_TOKEN (or stop with signup links from pruna-api), then ask for required inputs. Open intake → generation-diversity clarification intake before the first POST. Redirect when When NOT to use fits better.

When NOT to use

Use a different skill instead:

Skill Description Install
music-2.5 Use when someone wants an original AI song with vocals — sung lyrics, a style prompt track, or source audio for a music video. npx skills add PrunaAI/pruna-skills@music-2.5 -y
gemini-3.1-flash-tts Use when someone needs spoken narration or voiceover — explainer tracks, documentary lines, or voice to pair with generated video. npx skills add PrunaAI/pruna-skills@gemini-3.1-flash-tts -y
video-editing Use when assembling or polishing already-rendered clips with ffmpeg — concat, crossfades, burned captions and subtitles, text/logo overlays, before/after sliders, background music beds, platform export — or when composing a multi-layer HTML combination video with Hyperframes. Not for AI video generation, prompt craft, or model-based video edits. npx skills add PrunaAI/pruna-skills@video-editing -y

Environment

export REPLICATE_API_TOKEN=r8_...

HTTP / pipeline

Prefer the repo helpers (they upload local audio and write JSON + SRT):

# Agent: follow phase table in this SKILL.md \
  --song output/my-mv/song.mp3 \
  --out output/my-mv/whisperx_transcript.json \
  --initial-prompt "First few lyric lines help recognition"

# Agent: follow phase table in this SKILL.md \
  --cuts output/my-mv/cut_manifest.json \
  --transcript output/my-mv/whisperx_transcript.json \
  --song output/my-mv/song.mp3

In a music-video workflow, run this skill during the align phase — see music-video.

Before generating

  1. Complete Prerequisites guide reading order.
  2. Confirm audio_file (HTTPS URL — helpers upload local files), language, and align_output: true for word-level cut alignment. When listing inputs, name REPLICATE_API_TOKEN (Replicate — not PRUNA_API_KEY).
  3. Model notes: set initial_prompt to the first lyric lines for better rap/sung recognition. Optional diarization for multi-voice battles.

Required input

  • audio_file (HTTPS URL)

Common optional fields

  • language — ISO code, e.g. en
  • align_output — true for word-level timestamps (required for cut alignment)
  • initial_prompt — first lyric lines
  • diarization — speaker labels

Typical next steps

Common follow-ons after this skill:

Skill Description Install
music-video Use when someone wants a full music video — original song or vocals, performance clips, B-roll, and lyric-synced edits. npx skills add PrunaAI/pruna-skills@music-video -y
music-2.5 Use when someone wants an original AI song with vocals — sung lyrics, a style prompt track, or source audio for a music video. npx skills add PrunaAI/pruna-skills@music-2.5 -y
video-editing Use when assembling or polishing already-rendered clips with ffmpeg — concat, crossfades, burned captions and subtitles, text/logo overlays, before/after sliders, background music beds, platform export — or when composing a multi-layer HTML combination video with Hyperframes. Not for AI video generation, prompt craft, or model-based video edits. npx skills add PrunaAI/pruna-skills@video-editing -y