Setup & Installation
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
Version History
- Expanded documentation with new "Quick Start", "Response", and "Errors" sections. - Added example outputs for both text and HTML formats. - Clarified that the response is plain text or raw HTML, not JSON. - Included error response examples for common status codes. - Added links to the API reference and Desearch Console for further resources.
What This Skill Does
Crawls a webpage by URL and returns its content as clean text or raw HTML. Powered by the Desearch API. Useful when an agent needs to read the full contents of a specific page rather than search for it.
Returns clean, markup-free text by default, which keeps agent context lean compared to raw HTML scrapers.
When to use it
- Reading a documentation page before writing code
- Extracting article text for summarization
- Fetching a competitor's pricing page for comparison
- Pulling release notes from a changelog URL
- Checking the current content of a web page before editing
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: summarize the Python 3 tutorial index
- 1Call crawl with 'https://docs.python.org/3/tutorial/index.html' and default text format
- 2Receive plain text content of the page
- 3Parse section headings and descriptions from the text
- 4Compose a summary from the extracted content
A structured summary of the Python 3 tutorial sections
Requirements
Accounts, API keys, or tools you or your AI assistant may need to set up while using this skill.