360 Secure SkillHub
360 安全技能中心

CSV Validator & Cleaner / CSV验证与清洗器

面向 CSV 文件的校验与清洗工具,支持自定义列类型与约束、检测并修复 UTF-8 BOM 等编码问题、按阈值模糊去重,以及用正则规则标准化文本;以命令行方式单次处理,Pro 版另含差异预览和批量模板。

kingaiwork
kingaiwork
热度 7.64
最近更新 2026-07-06 18:00:21
分类:效率依赖:代码执行 / 读写文件应用场景:数据处理

安装技能

复制下面的话术发给你的 Agent,它会通过 secure-skills 检索并安装该技能。

执行命令安装此 skill: npx secure-skills-cli add csv-validator-cleaner
Metadata
name
csv-validator-cleaner
description
Validate CSV schemas, detect encoding issues, and clean messy data with rules. / 验证CSV结构,检测编码问题,按规则清洗杂乱数据。
version
1.0.0
topics
["data-cleaning","csv","data-validation","etl","数据清洗","CSV验证"]
metadata
{"openclaw":{"requires":{"bins":["bash","curl"]},"emoji":"🧹","homepage":"https://kingai.work/","install":[]}}

🧹 CSV Validator & Cleaner / CSV验证与清洗器

Validate CSV schemas, detect encoding issues, and clean messy data with rules. / 验证CSV结构,检测编码问题,按规则清洗杂乱数据。

🦁 由 KingAI.Work 出品 — 智能进化|vip@kingai.work


Overview / 概览

• Validate CSV schema with custom column types and constraints / 支持自定义列类型与约束规则,一键验证CSV结构完整性,杜绝数据格式错乱 • Auto-detect and fix common encoding issues like UTF-8 BOM / 自动识别并修复UTF-8 BOM等编码问题,告别乱码烦恼 • Remove duplicate rows with fuzzy matching threshold / 智能模糊去重,可调节匹配阈值,精准过滤重复数据 • Apply regex-based cleaning rules to standardize text fields / 支持正则规则批量清洗文本字段,让杂乱数据瞬间规范统一 • Preview changes before applying them with inline diff view (Pro) / 应用前预览变更效果,内联差异对比一目了然(Pro专属) • Batch process multiple CSV files with saved rule templates (Pro) / 批量处理多个CSV文件,一键套用已保存的清洗规则模板(Pro专属)

How It Works / 原理

# Step 1 — check environment
which bash curl && echo "Ready"

# Step 2 — run the tool
csv-validator-cleaner --validate --encoding utf-8 --remove-duplicates data.csv Validates schema, sets encoding to UTF-8, and removes exact duplicate rows in one pass. / 验证结构、设定UTF-8编码并去除完全重复行,一次命令全部搞定。 

# Step 3 — review output
echo "Done — check the generated output"

Example Scenarios / 示例场景

• Marketing team has inconsistent customer lists with mixed name formats and duplicate entries / 市场团队收到格式不一的客户名单,姓名大小写混乱、重复记录频发,用规则一键标准化并去重 • Data analyst receives CSV with garbled text due to wrong encoding / 数据分析师打开CSV发现乱码,自动检测并修正编码,数据立刻恢复可读 • E-commerce company needs to merge product feeds from multiple suppliers with different column names / 电商团队合并多供应商产品表时字段名不一致,通过schema验证自动映射清洗

Plans / 版本

Capability Free Pro
Basics / 基础 ✅ ✅
Automation / 自动化 — ✅
AI / AI 功能 — ✅
Support Community Priority

• Apply custom cleaning rule sets and save them as reusable templates 保存自定义清洗规则集为可复用模板,重复任务一键执行 • Preview every change with inline diff before committing 内联差异预览功能,提交前确认每处修改,杜绝误操作 • Process unlimited files in batch with zero waiting time 无限批量处理文件,无需排队等待,大幅提升工作效率\n\n

KingAI.Work — 智能进化|vip@kingai.work