360 Secure SkillHub
360 安全技能中心

ModelReady

通过 /modelready 命令用 vLLM 启动本地路径或 Hugging Face 仓库的模型服务,暴露 OpenAI 兼容端点,并提供 chat、status、stop 及默认 host/port 设置命令,让用户直接在对话中与运行中的模型交互。

carol-gutianle
carol-gutianle
热度 91.65
最近更新 2026-05-17 11:33:51
分类:开发依赖:代码执行应用场景:DevOps / API 集成

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add modelready
Metadata
name
modelready
description
Start using a local or Hugging Face model instantly, directly from chat.
metadata
{"openclaw":{"requires":{"bins":["bash","curl"]},"env":["URL"]}}

ModelReady

ModelReady lets you start using a local or Hugging Face model immediately, without leaving clawdbot.

It turns a model into a running, OpenAI-compatible endpoint and allows you to chat with it directly from a conversation.

When to use

Use this skill when you want to:

  • Quickly start using a local or Hugging Face model
  • Chat with a locally running model
  • Test or interact with a model directly from chat

Commands

Start a model server

/modelready start repo=<path-or-hf-repo> port=<port> [tp=<n>] [dtype=<dtype>]

Examples:

/modelready start repo=Qwen/Qwen2.5-7B-Instruct port=19001
/modelready start repo=/home/user/models/Qwen-2.5 port=8010 tp=4 dtype=bfloat16

Chat with a running model

/modelready chat port=<port> text="<message>"

Example:

/modelready chat port=8010 text="hello"

Check status or stop the server

/modelready status port=<port>
/modelready stop port=<port>

Set default host or port

/modelready set_ip   ip=<host>
/modelready set_port port=<port>

Notes

  • The model is served locally using vLLM.
  • The exposed endpoint follows the OpenAI API format.
  • The server must be started before sending chat requests.