Multi-API Data Pipeline to Google Sheets

连接最多 10 个 REST API，支持 API Key、Bearer、OAuth2 认证，抓取并转换合并数据后推送到 Google Sheets 实时仪表盘，按每 15 分钟、每小时或每日定时更新；同时输出运行日志、写入 _run_log 标签页，失败时本地缓冲重试并告警。

neo1307

热度 53.36

最近更新 2026-05-11 17:33:58

分类：数据依赖：代码执行 / 第三方 API / 读写文件应用场景：数据处理 / API 集成 / 自动化脚本 / 工作流 ...

安装技能

复制下面的话术发给你的 Agent，它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill： npx secure-skills-cli add argus-api-pipeline

Metadata

name: Multi-API Data Pipeline to Google Sheets
description: Connects multiple REST APIs, fetches and transforms data, and pushes it to a live Google Sheets dashboard that auto-updates on a schedule.
version: 1.0.2
tags: ["python","api","automation","google-sheets","pipeline","dashboard","data"]
author: neo1307
requires: ["python3","requests","pandas","gspread","google-auth-oauthlib"]

Multi-API Data Pipeline to Google Sheets

Overview

Automated data pipeline that pulls from multiple REST APIs, transforms and merges the data, and pushes it to a Google Sheets dashboard that updates automatically on your chosen schedule (every 15 minutes, hourly, daily). Replaces hours of manual copy-paste work.

What It Does

Connects to up to 10 REST APIs simultaneously
Handles authentication: API keys, Bearer tokens, OAuth2
Transforms and merges data across sources
Pushes clean, formatted data to Google Sheets in real time
Sends alert if any API call fails
Logs all pipeline runs with success/failure status

Required Environment Variables

Set these in OpenClaw's Secrets manager before running:

Variable	Description
`GOOGLE_SERVICE_ACCOUNT_JSON`	Google Service Account key (full JSON string)
`TARGET_SHEET_ID`	Google Sheets document ID (from the sheet URL)
`[SERVICE]_API_KEY`	One secret per connected API, e.g. `SHOPIFY_API_KEY`, `HUBSPOT_TOKEN`

Setup

Create a Google Service Account, download the JSON key, paste it as GOOGLE_SERVICE_ACCOUNT_JSON
Share your target Google Sheet with the service account email
Set TARGET_SHEET_ID from the sheet URL
Add one secret per API you want to connect
Set update schedule: every 15 minutes / hourly / daily at 06:00

Usage

"Connect Shopify and HubSpot APIs and sync sales data to my Google Sheet every hour" "Pull weather data and stock prices into a live dashboard" "Set up a pipeline from our internal API to Google Sheets, update every 15 minutes" "Add Stripe revenue data to the existing pipeline"

Output

Live Google Sheets dashboard with latest data
Pipeline run log: logs/pipeline_YYYY-MM-DD.txt
Alert on failure with error details

Rules

Never store raw API credentials in output files or logs
Always validate API response schema before writing to Sheets
If Google Sheets write fails, buffer data locally and retry up to 3 times
Respect API rate limits — add delays per API documentation
Each pipeline run must write a summary row to a _run_log tab in the Sheet