Setup & Installation
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
Version History
- Version bump to 1.0.2 with no functional or documentation changes detected. - No file modifications; the skill remains unchanged.
What This Skill Does
A web scraping tool that runs inside a Docker container using Crawlee and Playwright to extract content from sites with anti-bot protections. Targets JavaScript-heavy platforms like YouTube and X/Twitter. Outputs structured JSON with status, content type, and raw data.
Running Playwright inside Docker bypasses bot detection that blocks standard HTTP-based scrapers on protected sites.
When to use it
- Extracting transcripts from YouTube videos
- Scraping posts or threads from X/Twitter
- Getting raw text from JavaScript-rendered pages
- Feeding scraped content directly into LLM pipelines
- Collecting video descriptions in bulk from YouTube
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: Get the transcript from this YouTube video URL
- 1Validates the YouTube video ID from the provided URL
- 2Runs the Docker container with the target URL as argument
- 3Crawlee and Playwright load the page and intercept transcript data
- 4Parses the JSON output from stdout for status and data fields
JSON object with status SUCCESS, type TRANSCRIPT, videoId, and full transcript text
Requirements
Accounts, API keys, or tools you or your AI assistant may need to set up while using this skill.