LaunchKit · 2026
Back to Skills

vision-tagger

Tag and annotate images using Apple Vision framework (macOS only)

0
897 downloads
by @sagarjhaa

Setup & Installation

openclaw skills install @sagarjhaa/vision-tagger

Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:

npx clawhub install vision-tagger

What This Skill Does

macOS-native image analysis using Apple's Vision framework. Detects faces, body joints, hands, text (OCR), barcodes, scene labels, and saliency regions from image files. All processing runs on-device — no cloud APIs or API keys required.

Runs entirely on-device using Apple's built-in Vision framework, so there are no API costs, no usage limits, and no image data sent to external servers.

When to use it

  • Auto-tagging vacation photos by detected scenes and objects
  • Extracting text from scanned receipts or handwritten notes
  • Monitoring sitting posture by tracking body joint positions during work sessions
  • Scanning product barcodes from photographed inventory
  • Detecting people in security camera screenshots

Example Workflow

Here's how your AI assistant might use this skill in practice.

INPUT

User asks: Analyze this photo and tell me what objects and people are in it

AGENT
  1. 1Runs the compiled Swift binary against the specified image file
  2. 2Parses the JSON output for faces, body joints, scene labels, and text regions
  3. 3Maps detected labels to human-readable descriptions with confidence scores
  4. 4Returns a structured summary of all detected elements
OUTPUT

JSON report listing detected faces with bounding boxes and orientation angles, body skeleton joints, scene labels such as 'outdoor' and 'sky' with confidence scores, and any OCR text found in the image

Requirements

Accounts, API keys, or tools you or your AI assistant may need to set up while using this skill.

Xcode Command Line Tools (run: xcode-select --install)Pillow Python library (run: pip3 install Pillow)