Setup & Installation
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
Version History
Expanded support for new content types: now includes Amazon, YouTube, and Reddit scraping. - Added commands to scrape Amazon product pages and Amazon search results (outputs structured JSON). - Added the ability to fetch YouTube video subtitles using the video ID. - Added support for scraping content and listings from Reddit posts and subreddits. - Google search output is now a structured JSON object with clearly described sections. - Documentation improved with detailed usage examples and updated summary table.
What This Skill Does
Connects to the Decodo Web Scraping API to search Google, scrape arbitrary web pages, fetch Amazon product data, retrieve YouTube transcripts, and read Reddit posts or subreddits. Each target returns structured output suited for programmatic use: JSON for search and Amazon results, markdown for pages, plain text for transcripts.
Handles JavaScript-rendered pages and structured parsers for Google, Amazon, and Reddit that raw HTTP requests cannot replicate.
When to use it
- Looking up current prices and specs for a product on Amazon before buying
- Pulling a YouTube video transcript to summarize or translate
- Checking what a subreddit is currently discussing without opening a browser
- Running a Google search and extracting organic results for further processing
- Scraping a documentation page or article into clean markdown for an LLM prompt
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: find the top Google results for 'open source LLM benchmarks' and summarize the snippets
- 1Runs scrape.py with --target google_search --query 'open source LLM benchmarks'
- 2Receives JSON with organic, related_questions, and related_searches sections
- 3Extracts titles and snippets from the organic array
- 4Compiles a summary from the top results
A list of the top organic results with titles, URLs, and snippets summarized in plain text
Requirements
Accounts, API keys, or tools you or your AI assistant may need to set up while using this skill.