LaunchKit · 2026
Back to Skills

hle-benchmark-evolver

Runs HLE-oriented benchmark reward ingestion and curriculum generation for capability-evolver.

0
434 downloads
by @wanng-ide

Setup & Installation

openclaw skills install @wanng-ide/hle-benchmark-evolver

Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:

npx clawhub install hle-benchmark-evolver

What This Skill Does

Ingests question-level HLE benchmark results into the capability-evolver reward system and generates curriculum signals for evolution cycles. Converts per-question accuracy data into prioritized queues that focus subsequent training on easier questions first.

Closes the loop between benchmark evaluation and capability evolution by automating reward ingestion, curriculum prioritization, and solidification in a single pipeline command.

When to use it

  • Processing an HLE report JSON into reward and curriculum signals
  • Running a multi-cycle evolution pipeline with automatic re-evaluation
  • Checking current benchmark accuracy and curriculum stage snapshot
  • Targeting a specific HLE score threshold using easy-first question queues
  • Identifying which subjects and modalities to focus on next

Example Workflow

Here's how your AI assistant might use this skill in practice.

INPUT

User asks: ingest my HLE report and generate curriculum signals

AGENT
  1. 1Validate the report JSON exists at the provided path
  2. 2Ingest report into capability-evolver benchmark reward state
  3. 3Generate curriculum signals: benchmark_*, curriculum_stage:*, focus_subject:*, question_focus:*
  4. 4Print compact result summary as JSON
OUTPUT

JSON with benchmark_id, accuracy, reward, trend, curriculum_stage, queue_size, focus_subjects, and next_questions