OpenClaw Skill Self Improvement

A health, eval, and regression system for continuously improving OpenClaw skills.

Goal

Turn skill quality from an occasional cleanup task into a repeatable health loop.

What it does

1. Skill Health Check

Scans all workspace and system skills to detect:

• Duplicate skills: skills with highly similar names/descriptions
• Dark skills: skills with no recent usage signals
• Stale skills: skills unused for extended periods

2. Routing Eval

Runs evaluation cases against a keyword-weighted router to verify:

• Correct skills trigger for given inputs
• Wrong skills don't accidentally trigger
• Pass rate tracking over time

3. Daily Heartbeat

Automated daily run that:

• Executes health check + eval
• Compares against previous run
• Generates human-readable summary
• Surfaces changes and recommended actions

Usage

Run health check

node scripts/skill-health-check.mjs /path/to/workspace

Run routing eval

node scripts/routing-eval-runner.mjs /path/to/workspace

Run daily heartbeat

node scripts/daily-health-heartbeat.mjs /path/to/workspace

Output files

• .learnings/skill-health-report.json
• .learnings/routing-eval-report.json
• .learnings/daily-skill-health-summary.txt
• .learnings/skill-health-history.json

Current status

• Total skills scanned: 122 (workspace + system)
• Duplicate pairs: 1 (false positive)
• Dark skills: 0
• Eval pass rate: 100% (8/8)

Files

• scripts/skill-health-check.mjs — duplicate and dark skill detection
• scripts/routing-eval-runner.mjs — routing evaluation runner
• scripts/daily-health-heartbeat.mjs — daily automation
• references/routing-evals.json — evaluation case definitions

License

MIT