zhipu web fetch

核心功能：调用智谱Reader API，以cURL工具获取指定URL的网页内容，可转换为Markdown或纯文本格式，支持配置缓存、图片保留、摘要等选项，同时返回标题、关键词等元数据。典型场景：读取技术文档、提取纯文本内容、强制获取最新页面等。输入为指定URL及可选参数，输出为含解析内容与元数据的JSON。注意：仅获取特定URL内容，不支持关键词搜索。

whyhit2005

热度 62.43

最近更新 2026-05-11 17:31:34

分类：效率依赖：代码执行 / 第三方 API应用场景：数据处理 / 文件转换 / 摘要总结

安装技能

复制下面的话术发给你的 Agent，它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill： npx secure-skills-cli add zhipu-web-fetch

Metadata

name: zhipu-web-fetch
description: Zhipu AI Web Page Reader Tool - Fetches and parses web page content into structured Markdown or text via cURL. Use when: - Need to fetch and read the content of a web page by URL - Need to convert web pages to Markdown or plain text format - Need to extract page content with or without images - Need to get page metadata (title, description, keywords) - Need to control caching, image retention, or summary options for fetched content - User asks to "read a URL", "fetch a page", "grab the content of a web page", "scrape" or "crawl" a URL Do NOT confuse with web search — this skill fetches a specific URL's content, it does not perform keyword searches.
metadata: {"openclaw":{"requires":{"env":["ZHIPU_API_KEY"],"bins":["curl"]}}}

Zhipu Web Page Reader

Fetch and parse web page content via Zhipu AI's Reader API (/paas/v4/reader), using lightweight cURL. Returns parsed page content in Markdown or plain text format, along with metadata like title and description.

Quick Start

Basic cURL Usage

curl --request POST \
  --url https://open.bigmodel.cn/api/paas/v4/reader \
  --header "Authorization: Bearer $ZHIPU_API_KEY" \
  --header 'Content-Type: application/json' \
  --data '{
    "url": "https://www.example.com"
  }'

Script Usage

A wrapper shell script is provided for convenience.

# Basic Fetch (returns Markdown by default)
bash scripts/zhipu_fetch.sh --url "https://www.example.com"

# Fetch as plain text, no cache
bash scripts/zhipu_fetch.sh \
  --url "https://docs.python.org/3/" \
  --format text \
  --no-cache

# Fetch with image and link summaries
bash scripts/zhipu_fetch.sh \
  --url "https://news.example.com/article" \
  --images-summary \
  --links-summary

# Fetch without images, disable GFM
bash scripts/zhipu_fetch.sh \
  --url "https://blog.example.com/post" \
  --no-images \
  --no-gfm

API Parameter Reference

Parameter	Type	Required	Default	Description
`url`	string	✅	-	URL of the web page to fetch
`timeout`	integer	-	`20`	Request timeout in seconds
`no_cache`	boolean	-	`false`	Disable caching (`true`/`false`)
`return_format`	string	-	`markdown`	Return format: `markdown` or `text`
`retain_images`	boolean	-	`true`	Retain images in output (`true`/`false`)
`no_gfm`	boolean	-	`false`	Disable GitHub Flavored Markdown (`true`/`false`)
`keep_img_data_url`	boolean	-	`false`	Keep image data URLs (`true`/`false`)
`with_images_summary`	boolean	-	`false`	Include images summary (`true`/`false`)
`with_links_summary`	boolean	-	`false`	Include links summary (`true`/`false`)

Response Structure

The API returns JSON with the parsed page content.

{
  "id": "task-id",
  "created": 1704067200,
  "request_id": "request-id",
  "model": "model-name",
  "reader_result": {
    "title": "Page Title",
    "description": "Brief page description",
    "url": "https://www.example.com",
    "content": "Parsed page content (Markdown or text)",
    "external": {
      "stylesheet": {}
    },
    "metadata": {
      "keywords": "page, keywords",
      "viewport": "width=device-width",
      "description": "Meta description",
      "format-detection": "telephone=no"
    }
  }
}

Key Response Fields

Field	Description
`reader_result.content`	Main parsed content (body text, images, links)
`reader_result.title`	Page title
`reader_result.description`	Brief page description
`reader_result.url`	Original page URL
`reader_result.metadata`	Page metadata (keywords, viewport, etc.)

Common Use Cases

Scenario	Command
Read a documentation page	`--url <doc_url>`
Extract text only (no images)	`--url <url> --no-images --format text`
Force fresh fetch (bypass cache)	`--url <url> --no-cache`
Get content with all summaries	`--url <url> --images-summary --links-summary`
Long page with extended timeout	`--url <url> --timeout 60`

Environment Requirements

Environment variable ZHIPU_API_KEY must be configured.
curl command must be available in your system path.