360 Secure SkillHub
360 安全技能中心

Web Markdown Navigator

该 Skill 用 Node 脚本抓取用户给定 URL 的网页，先经 Readability 抽取正文并转为 Markdown，内容过薄时回退为纯文本 Markdown；含 localhost/私有 IPv4 拦截，支持最大字符数与超时参数，并按退出码区分参数、URL、网络与提取失败；JS 渲染页面需借助 browser 工具兜底。

plgonzalezrx8
plgonzalezrx8
热度 26.41
最近更新 2026-05-11 17:26:14
分类：效率依赖：代码执行 / 联网浏览搜索应用场景：数据处理 / 摘要总结 / 研究

安装技能

复制下面的话术发给你的 Agent，它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill： npx secure-skills-cli add web-markdown-navigator
Metadata
name
web-markdown-navigator
description
Fetch webpages and return clean markdown instead of raw HTML. Use for URL reading, extraction, and summarization tasks where the user wants markdown output; use browser fallback for JS-heavy/SPA pages when extraction is thin.

Web Markdown Navigator

Use this skill for deterministic URL → markdown extraction.

Quick flow

  1. Run script:
    • cd /Users/pedrogonzalez/clawd/skills/web-markdown-navigator/scripts
    • node fetch-markdown.mjs "<url>" --max-chars 50000
  2. If exit code 0, return markdown output.
  3. If exit code 3 or 4, or output is thin/boilerplate, use browser tool fallback to capture rendered content and return markdown summary.

Script

node scripts/fetch-markdown.mjs <url> [--max-chars N] [--timeout-ms N] [--json]

Behavior:

  • Layer 1: Fetch HTML + Mozilla Readability + Turndown markdown conversion.
  • Layer 2: Fallback plain-text markdown if extraction is too thin.
  • URL safety checks block localhost/private literal IPv4 hosts.

Output requirements

  • Return markdown only (no raw HTML dump).
  • Preserve source URL in response.
  • If truncated, include truncation note.
  • If fallback was needed, mention method used (readability or fallback-text).

Error handling

  • 1 bad args
  • 2 invalid/blocked URL
  • 3 network/fetch/content-type failure
  • 4 extraction failure/thin output

For extended notes and troubleshooting, read:

  • /Users/pedrogonzalez/clawd/skills/web-markdown-navigator/references/usage.md