Setup & Installation
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
Version History
v2.0.0: 18 commands, CI command with JSON output, GitHub Action workflow, improved README
What This Skill Does
skillbench is a CLI tool for tracking AI agent skill performance across versions. It records task outcomes, scores skills on a graded scale, and surfaces which skills are declining, stale, or need attention. Benchmarks can be collected manually or pulled automatically from tasktime.
Combines version-aware benchmarking, graded scoring, regression detection, and improvement suggestions in one tool built around the AI agent skill workflow rather than general software testing.
When to use it
- Comparing a skill's success rate before and after an update
- Flagging which skills have dropped below 70% success rate
- Auto-recording task duration via tasktime integration without manual timing
- Running baseline checks in CI to catch skill regressions
- Generating a performance dashboard to review agent health across all skills
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: Check if my github skill improved after updating it to v1.1.0
- 1Sets active version with `skillbench use github@1.1.0`
- 2Records a task outcome after completing work: `skillbench record "Create PR" --success`
- 3Runs a version comparison: `skillbench compare github@1.0.0 github@1.1.0`
- 4Reviews the score breakdown across success rate, duration, consistency, and trend
- 5Checks improvement suggestions with `skillbench improve github` if grade is still low
Side-by-side grade comparison showing whether v1.1.0 improved or regressed across each scoring dimension