Setup & Installation
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
Version History
V3.5.1: Final flattened structure. All scripts in root to guarantee ClawHub inclusion. Fixed all reported bugs.
What This Skill Does
Multi-provider search aggregator that queries Google CSE, Wikipedia, Reddit, GNews RSS, and DuckDuckGo (via headless scraping) in a single call. Returns structured JSON with source, title, link, and sanitized snippet per result. Supports optional Redis caching and runs the scraping provider in a subprocess-isolated virtual environment.
Querying five independent providers in one call reduces coverage gaps that occur when any single source is rate-limited, blocked, or returns poor results.
When to use it
- Aggregating news and forum discussion results on a single topic across five sources
- Cross-referencing Wikipedia summaries with Reddit threads during research
- Building a search backend with automatic provider-level fallback
- Fetching DuckDuckGo results without triggering bot detection
- Caching repeated search queries to reduce API call volume
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: "Find recent news and discussions about LLM fine-tuning"
- 1Invokes scripts/search-cluster.py with provider flag 'all' and the query string
- 2Dispatches requests to Google CSE, Wikipedia, Reddit, and GNews RSS concurrently
- 3Spawns an isolated subprocess running stealth_fetch.py to query DuckDuckGo via Scrapling
- 4Sanitizes and normalizes all provider responses into a shared schema
- 5Writes aggregated results to Redis cache if REDIS_HOST is configured
Structured JSON array where each entry contains source, title, link, and sanitized snippet
Requirements
Accounts, API keys, or tools you or your AI assistant may need to set up while using this skill.