360 Secure SkillHub
360 安全技能中心

Fetch

面向公开 URL 的网页抓取与正文提取工具：用 Python 脚本抓取网页、提取标题/正文/链接，将原始响应与结构化结果保存到本地，并提供作业历史列表与详情查看；不需要凭证、包依赖或云同步。

agistack
agistack
热度 92.35
最近更新 2026-05-11 17:30:52
分类：效率依赖：代码执行 / 读写文件应用场景：数据处理 / 工作流 / 研究

安装技能

复制下面的话术发给你的 Agent，它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill： npx secure-skills-cli add fetch
Metadata
name
fetch
description
Public web retrieval and clean extraction engine. Use whenever the user wants to fetch, download, inspect, clean, or save content from a public URL. Supports safe fetching of public web pages, extracts title/text/links, stores results locally, and keeps a job history. No credentials, no login flows, no cloud sync.

Fetch

Turn public URLs into usable local content.

Core Philosophy

  1. Fetch only public web content.
  2. Prefer clean extracted text over noisy raw HTML.
  3. Save both the raw response and structured extraction locally.
  4. Keep a simple local job history so previous fetches are easy to inspect.

Runtime Requirements

  • Python 3 must be available as python3
  • No external packages required

Safety Boundaries

  • Public URLs only
  • No login flows
  • No cookies or browser automation
  • No API keys or credentials
  • No external uploads or cloud sync
  • All fetched data is stored locally only

Local Storage

All data is stored under:

  • ~/.openclaw/workspace/memory/fetch/jobs.json
  • ~/.openclaw/workspace/memory/fetch/pages/

Key Workflows

  • Fetch URL: fetch_url.py --url "https://example.com"
  • Save cleaned output: save_output.py --url "https://example.com" --title "Example"
  • List history: list_jobs.py
  • Show job details: show_job.py --id JOB-XXXX

Scripts

Script Purpose
init_storage.py Initialize local storage
fetch_url.py Fetch a public URL and extract content
save_output.py Save cleaned output with a custom title
list_jobs.py List previous fetch jobs
show_job.py Show one saved fetch job