360 Secure SkillHub
360 安全技能中心

Vocal Chat

该 Skill 在 WhatsApp 上实现语音到语音的自动对话循环:收到音频/ogg/opus 消息后调用 tools/transcribe_voice.sh 本地转写,将文本作为普通提示处理,再用 bin/sherpa-onnx-tts 生成 .ogg 语音并连同文字一起回发。约束为仅用本地工具(ffmpeg、whisper-cpp、sherpa-onnx-tts),保持快速响应。

rubenfb23
rubenfb23
热度 74.78
最近更新 2026-05-11 15:50:52
分类:自动化依赖:代码执行 / 读写文件 / 内部调用大模型应用场景:工作流 / 自动化脚本

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add vocal-chat
Metadata
name
walkie-talkie
description
Handles voice-to-voice conversations on WhatsApp. Automatically transcribes incoming audio and responds with local TTS audio. Use when the user wants to "talk" instead of type.

Walkie-Talkie Mode

This skill automates the voice-to-voice loop on WhatsApp using local transcription and local TTS.

Workflow

  1. Incoming Audio: When a user sends an audio/ogg/opus file:

    • Use tools/transcribe_voice.sh to get the text.
    • Process the text as a normal user prompt.
  2. Outgoing Response:

    • Instead of a text reply, generate speech using bin/sherpa-onnx-tts.
    • Send the resulting .ogg file back to the user as a voice note.

Triggers

  • User sends an audio message.
  • User says "activa modo walkie-talkie" or "hablemos por voz".

Constraints

  • Use local tools only (ffmpeg, whisper-cpp, sherpa-onnx-tts).
  • Maintain a fast response time (RTF < 0.5).
  • Always reply with BOTH text (for clarity) and audio.

Manual Execution (Internal)

To respond with voice manually:

bin/sherpa-onnx-tts /tmp/reply.ogg "Tu mensaje aquí"

Then send /tmp/reply.ogg via message tool with filePath.