Setup & Installation
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
Version History
Added license (MIT) and metadata.source/pypi fields to frontmatter so registry shows verified provenance instead of 'Source: unknown'.
What This Skill Does
Scrapling is a Python web scraping framework with built-in anti-bot bypass, including Cloudflare Turnstile handling and browser fingerprint spoofing. It offers three fetcher modes: fast HTTP, stealth headless Chrome, and full dynamic browser for JS-heavy pages. Use it when standard fetch tools return 403s or Cloudflare challenges.
Unlike standard HTTP clients or plain Playwright, Scrapling combines TLS fingerprint spoofing, adaptive element tracking, and Cloudflare bypass in a single tool with a consistent CLI interface.
When to use it
- Extracting product prices from sites that block scrapers
- Scraping article content from JS-rendered news sites
- Pulling structured data from pages behind Cloudflare
- Automating data collection from SPAs with heavy JavaScript
- Fetching paginated listings when HTTP requests return bot challenges
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: get all H2 headings from a Cloudflare-protected page as JSON
- 1Run scrape.py with the target URL, --mode stealth, --selector 'h2', and --json flags
- 2Scrapling launches headless Chromium via patchright with anti-detect settings
- 3Page loads fully, bypassing Cloudflare challenge
- 4CSS selector extracts all matching H2 elements
- 5Results are serialized to JSON and returned
JSON array of H2 text strings from the page
Requirements
Accounts, API keys, or tools you or your AI assistant may need to set up while using this skill.