360 Secure SkillHub
360 安全技能中心

Gemini Video Analyzer

该工具基于Google Gemini多模态API,无需抽帧即可直接分析视频,支持1FPS全运动、音频与视觉理解。核心功能包括场景描述、文本/UI提取、内容问答、语音转写等。典型场景有视频摘要生成、录屏信息提取、教程总结、视频对比等。支持MP4、AVI等多格式(单文件最大2GB),通过Python脚本调用,需配置GOOGLE_AI_API_KEY,可传入视频路径及自定义提问,输出对应分析结果,还支持文件管理操作。

aiwithabidi
aiwithabidi
热度 58.39
最近更新 2026-05-10 17:40:54
分类:效率依赖:代码执行 / 第三方 API / 读写文件应用场景:摘要总结 / 会议纪要 / 数据处理

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add gemini-video-analyzer
Metadata
name
gemini-video-analyzer
description
Native video analysis using Google Gemini API. Upload and analyze video files — describe scenes, extract text/UI, answer questions about content, transcribe speech, identify objects and actions. Use when: (1) User sends a video file and wants it analyzed, (2) Video summarization or description needed, (3) Extracting text, UI elements, or information from screen recordings, (4) Answering questions about video content, (5) Comparing multiple videos, (6) Analyzing tutorials, demos, or walkthroughs.
homepage
https://www.agxntsix.ai
license
MIT
metadata
{"openclaw":{"emoji":"🎬","requires":{"bins":["python3","curl"],"env":["GOOGLE_AI_API_KEY"]},"primaryEnv":"GOOGLE_AI_API_KEY"}}

Gemini Video Analyzer

Analyze videos natively using Google Gemini's multimodal API. No frame extraction needed — Gemini processes video at 1 FPS with full motion, audio, and visual understanding.

Quick Start

# Analyze a video with default prompt (full description)
GOOGLE_AI_API_KEY=$GOOGLE_AI_API_KEY python3 {baseDir}/scripts/analyze.py /path/to/video.mp4

# Ask a specific question
GOOGLE_AI_API_KEY=$GOOGLE_AI_API_KEY python3 {baseDir}/scripts/analyze.py /path/to/video.mp4 "What text is visible on screen?"

# Manage uploaded files
GOOGLE_AI_API_KEY=$GOOGLE_AI_API_KEY python3 {baseDir}/scripts/manage_files.py list
GOOGLE_AI_API_KEY=$GOOGLE_AI_API_KEY python3 {baseDir}/scripts/manage_files.py cleanup

Supported Formats

MP4, AVI, MOV, MKV, WebM, FLV, MPEG, MPG, WMV, 3GP — up to 2GB per file.

How It Works

  1. Video uploads to Google's Files API (temporary, auto-deletes after 48h)
  2. Gemini processes at 1 frame/sec — understands motion, transitions, audio context
  3. Model generates response based on your prompt
  4. Way better than frame extraction for understanding temporal content

Use Cases

Task Example Prompt
General description (default — no prompt needed)
UI/text extraction "What text and UI elements are visible?"
Tutorial summary "Summarize the steps shown in this tutorial"
Bug report from video "Describe what went wrong in this screen recording"
Meeting notes "Summarize the key points discussed"
Content comparison Upload 2 videos, ask for differences

Configuration

Set GOOGLE_AI_API_KEY in your environment or .env file. Get a free key at aistudio.google.com.

Default model: gemini-2.5-flash (fast, cheap, excellent vision). Override with --model gemini-2.5-pro for complex analysis.

API Reference

See references/gemini-files-api.md for file upload limits, processing details, and advanced options.

Credits

Built by M. Abidi · LinkedIn · YouTube · GitHub · Book a Call