AI Daily News

通过 Python 脚本从 arXiv、Hugging Face、Product Hunt、YouTube 与 RSS 采集 AI 资讯，主通道失败时用 Playwright 浏览器抓取兜底，生成结构化日报并可推送到飞书，支持定时调度与自定义数据源。

josephleohou-ui

热度 68.99

最近更新 2026-05-17 14:56:51

分类：自动化依赖：代码执行 / 联网浏览搜索 / 读写文件 / 第三方 API应用场景：自动化脚本 / 工作流 / 研究 / 报告撰写 ...

安装技能

复制下面的话术发给你的 Agent，它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill： npx secure-skills-cli add ai-daily-news

Metadata

name: ai-daily-news
description: Automated AI daily news collection and reporting system. Collects AI papers from arXiv, Hugging Face, AI products from Product Hunt, YouTube videos from AI creators, and RSS feeds like PaperWeekly. Generates structured daily reports and pushes to Feishu. Use when: (1) Setting up automated AI news collection, (2) Generating daily AI news reports, (3) Fetching latest arXiv papers, Hugging Face papers, Product Hunt AI products, YouTube AI videos, (4) Configuring news sources and scheduling, (5) Troubleshooting news collection issues.

AI Daily News Skill

Automatically collect and report AI news from multiple sources with fallback browser scraping.

Quick Start

# Install dependencies
pip install -r references/requirements.txt
playwright install chromium

# Configure
python scripts/setup_config.py

# Run collection
python scripts/collect_ai_news.py

# Generate and push report
python scripts/push_to_feishu.py

Supported Data Sources

Source	Primary Method	Fallback Method
arXiv Papers	RSS API	Playwright browser
Hugging Face Papers	RSS Feed	Playwright browser
Product Hunt	RSS Feed	Playwright browser
YouTube AI Creators	yt-dlp	Playwright browser
PaperWeekly	RSS	requests
Custom RSS	feedparser	requests

Configuration

Edit references/config.example.json or run setup_config.py:

{
  "feishu": {
    "webhook_url": "https://open.feishu.cn/open-apis/bot/v2/hook/xxx",
    "chat_id": "oc_xxx"
  },
  "sources": {
    "arxiv": {"enabled": true, "categories": ["cs.CL", "cs.LG", "cs.AI"]},
    "youtube": {
      "enabled": true,
      "creators": ["andrew_ng", "matt_wolfe", "ai_explained", "greg_isenberg"]
    },
    "paperweekly": {"enabled": true, "rss_url": ""}
  }
}

YouTube Creators

Available creator keys:

andrew_ng - 吴恩达 (DeepLearning.AI)
matt_wolfe - Matt Wolfe
ai_explained - AI Explained
ai_with_oliver - AI with Oliver
greg_isenberg - Greg Isenberg

Scripts Overview

Script	Purpose
`collect_ai_news.py`	Main collector with fallback logic
`youtube_collector.py`	YouTube video collection
`rss_collector.py`	RSS feed collection
`browser_fallback.py`	Browser-based fallback scraping
`push_to_feishu.py`	Report generation and Feishu push
`daily_scheduler.py`	Scheduled task runner
`setup_config.py`	Interactive configuration setup

Fallback Mechanism

When primary methods (RSS/API/yt-dlp) fail:

Automatically retries with browser-based scraping
Uses Playwright for JavaScript-rendered pages
Seamless integration - same output format
Logs fallback usage for monitoring

Report Format

Generated reports include:

📚 arXiv papers with abstracts
🚀 Product Hunt AI products
🤗 Hugging Face papers
📺 YouTube video summaries
📰 PaperWeekly interpretations
📊 Source statistics

Troubleshooting

arXiv returns 0 papers: Check days_back parameter or network connection YouTube fails: Ensure yt-dlp is installed; fallback to Playwright available RSS timeouts: Browser fallback will attempt direct requests Feishu push fails: Verify webhook URL and chat_id in config

Advanced: Adding Custom Sources

Add RSS feed to rss section in config
Or implement new collector in scripts/
Register in collect_ai_news.py
Add fallback method in browser_fallback.py

See references/DEVELOPMENT.md for detailed extension guide.