Setup & Installation
openclaw skills install @wanng-ide/arxiv-gamedevbench-evaluating-agentic-capabili
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
npx clawhub install arxiv-gamedevbench-evaluating-agentic-capabili
What This Skill Does
GameDevBench is a benchmark that evaluates AI agent capabilities using game development tasks, requiring agents to navigate large codebases while working with multimodal assets like shaders, sprites, and animations. This skill scaffolds Node.js experiments based on the paper's evaluation methodology.
Game development combines complex software engineering with multimodal assets, making it a more demanding evaluation testbed than pure coding benchmarks.
When to use it
- Running GameDevBench evaluations on coding agents
- Testing multimodal AI performance on game asset manipulation
- Reproducing arXiv paper experiments locally
- Comparing agent capabilities across game development tasks
- Benchmarking agents on large codebase navigation
Example Workflow
Here's how your AI assistant might use this skill in practice.
INPUT
User asks: Run a GameDevBench evaluation experiment
AGENT
- 1Locate the base directory containing the benchmark scripts
- 2Configure experiment parameters for the target agent
- 3Execute node scripts/run.js to start the evaluation
- 4Collect and parse the benchmark output results
OUTPUT
Evaluation results showing agent performance on game development tasks