360 Secure SkillHub
360 安全技能中心

Websearch

通过 Python 脚本并行调用 DuckDuckGo、DDG Lite、Yahoo、Yahoo JP、Startpage 与基于无头 Chromium 的 Google 共 6 个搜索引擎,抓取结果后按 URL 去重并按跨引擎出现频次排序,输出 JSON 结果;无需 API 密钥,需 Python 3.9+ 与 Playwright。

nirveshdagar
nirveshdagar
热度 55.97
最近更新 2026-05-11 17:40:03
分类:搜索依赖:代码执行 / 联网浏览搜索 / 第三方 API应用场景:研究 / 摘要总结

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add multi-engine-websearch
Metadata
name
websearch
version
2.0.0
description
Multi-engine web search across 6 engines: DuckDuckGo, DDG Lite, Yahoo, Yahoo JP, Startpage, and Google (headless Chromium). No API keys required. Returns 10+ results per engine, ranked by cross-engine frequency.
author
nirvesh-dagar
repository
https://github.com/nirveshdagar/multi-engine-websearch
tags
["search","web","research","google","multi-engine"]

WebSearch — Multi-Engine Search Aggregator

🔗 GitHub: https://github.com/nirveshdagar/multi-engine-websearch

📦 Git Install:

git clone https://github.com/nirveshdagar/multi-engine-websearch.git

📦 ClawHub Install:

npx clawhub@latest install multi-engine-websearch

A free, local web search skill that queries 6 reliable search engines simultaneously (in parallel), merges results, deduplicates URLs, and ranks by cross-engine frequency.

No API keys required. No paid subscriptions. Runs entirely on your machine.

Requirements

  • Python 3.9+
  • Playwright (pip3 install playwright && python3 -m playwright install chromium)

Playwright is needed for the Google engine (headless Chromium renders JS-based results). All other engines use lightweight HTTP scraping with zero dependencies.

When to Use

Use this skill whenever the user asks you to:

  • Search the web for anything
  • Find recent news, articles, or information
  • Look up a topic, person, product, or event
  • Verify a fact with current web results
  • Research a topic with multiple sources

Command

python3 ~/.openclaw/workspace/skills/websearch/scripts/search.py "your query" --json

Options

Flag Default Description
--json / -j off Output as JSON
--num / -n 10 Results per engine
--max / -m 50 Max total results
--engines / -e all 6 Comma-separated engine list
--list-engines — Show available engines

Engines

Engine Method Reliability
DuckDuckGo HTML scrape ⭐⭐⭐⭐⭐
DDG Lite HTML scrape ⭐⭐⭐⭐
Yahoo HTML scrape ⭐⭐⭐⭐
Yahoo JP HTML scrape ⭐⭐⭐⭐
Startpage HTML scrape ⭐⭐⭐⭐
Google Headless Chromium ⭐⭐⭐⭐

All engines run in parallel using ThreadPoolExecutor for maximum speed.

Output Format

{
  "query": "your search",
  "total": 35,
  "engines": {"duckduckgo": 10, "google": 8, "yahoo": 10, ...},
  "results": [
    {
      "title": "Result Title",
      "url": "https://example.com",
      "snippet": "Description...",
      "engines": ["duckduckgo", "google", "yahoo"]
    }
  ]
}

Results appearing in more engines are ranked higher (cross-engine consensus).

Core Rules

  1. Always use --json flag when parsing results programmatically
  2. Summarize top results in natural language for the user
  3. Always cite sources with URLs
  4. If one engine fails, others compensate — the system is resilient
  5. Google engine is slower (~5s) due to headless browser; other engines are fast (~1-2s)