360 Secure SkillHub
360 安全技能中心

ScrapingBee Fetch

该 Skill 通过 ScrapingBee 服务渲染目标网页的 JavaScript,提取主要内容并输出便于阅读的 Markdown。运行时需提供 ScrapingBee API Key,支持关闭 JS 渲染、指定代理国家、设置等待时间以及使用高级代理等可选参数。

flobo3
flobo3
热度 41.45
最近更新 2026-05-11 17:38:33
分类:搜索依赖:代码执行 / 第三方 API应用场景:研究 / 工作流

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add scrapingbee-fetch
Metadata
name
scrapingbee-fetch
description
Advanced JavaScript web page renderer using ScrapingBee API. Extracts main content and returns clean Markdown.
requires
[{"ENV":"SCRAPINGBEE_API_KEY"}]

ScrapingBee Fetch

Use this skill to render JavaScript on target websites and extract the main content. It returns clean Markdown optimized for LLM reading.

Setup

You need a ScrapingBee API key to use this skill. Set it as an environment variable:

export SCRAPINGBEE_API_KEY="your_api_key_here"

Or add it to a .env file in the directory where you run the script.

Usage

uv run fetch.py --url "https://example.com"

Optional Parameters

  • --no-render-js: Disable JavaScript rendering (faster, but might miss dynamic content).
  • --country-code <code>: Use a proxy from a specific country (e.g., us, uk, ru).
  • --wait <milliseconds>: Wait time in milliseconds before extracting content (default: 3000).
  • --no-block-ads: Disable ad blocking (ads are blocked by default to save bandwidth and speed up rendering).
  • --premium-proxy: Use a premium proxy (useful for highly protected websites).

Examples

Fetch a website using a US proxy and wait 5 seconds:

uv run fetch.py --url "https://example.com" --country-code us --wait 5000

Fetch a highly protected website using a premium proxy:

uv run fetch.py --url "https://example.com" --premium-proxy

Fetch a simple website without rendering JavaScript:

uv run fetch.py --url "https://example.com" --no-render-js