LaunchKit · 2026
Back to Skills

hle-reasoning-wrapper

Wraps HLE benchmark questions in a structured Chain-of-Thought (CoT) reasoning process.

0
399 downloads
by @wanng-ide

Setup & Installation

openclaw skills install @wanng-ide/hle-reasoning-wrapper

Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:

npx clawhub install hle-reasoning-wrapper

What This Skill Does

Wraps Humanity's Last Exam (HLE) benchmark questions in a Chain-of-Thought reasoning format. It injects a required Thought/Answer structure into prompts and validates that LLM responses comply with that format.

Handles both prompt formatting and output validation in one module, removing the need to manually enforce CoT structure on each HLE question.

When to use it

  • Evaluating LLM performance on HLE benchmark questions
  • Preprocessing HLE prompts before sending to a language model API
  • Validating that model outputs follow required CoT structure
  • Running automated HLE benchmark tests with format compliance checks
  • Debugging reasoning failures in structured LLM evaluations

Example Workflow

Here's how your AI assistant might use this skill in practice.

INPUT

User asks: Answer this HLE question: What is the speed of light?

AGENT
  1. 1Format the question using hle.formatPrompt() to inject the required Thought/Answer structure
  2. 2Send the formatted prompt to an LLM API
  3. 3Receive the raw LLM response
  4. 4Validate the response using hle.validateOutput() to check format compliance
OUTPUT

Validated response confirming the model followed the Thought/Answer reasoning structure