# Send Data Scraper to your agent Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually. ## Fast path - Download the package from Yavira. - Extract it into a folder your agent can access. - Paste one of the prompts below and point your agent at the extracted folder. ## Suggested prompts ### New install ```text I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete. ``` ### Upgrade existing ```text I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run. ``` ## Machine-readable fields ```json { "schemaVersion": "1.0", "item": { "slug": "data-scraper", "name": "Data Scraper", "source": "tencent", "type": "skill", "category": "开发工具", "sourceUrl": "https://clawhub.ai/mupengi-bot/data-scraper", "canonicalUrl": "https://clawhub.ai/mupengi-bot/data-scraper", "targetPlatform": "OpenClaw" }, "install": { "downloadUrl": "/downloads/data-scraper", "sourceDownloadUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=data-scraper", "sourcePlatform": "tencent", "targetPlatform": "OpenClaw", "packageFormat": "ZIP package", "primaryDoc": "SKILL.md", "includedAssets": [ "GUIDE.md", "SKILL.md", "run.sh" ], "downloadMode": "redirect", "sourceHealth": { "source": "tencent", "slug": "data-scraper", "status": "healthy", "reason": "direct_download_ok", "recommendedAction": "download", "checkedAt": "2026-05-02T08:19:09.095Z", "expiresAt": "2026-05-09T08:19:09.095Z", "httpStatus": 200, "finalUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=data-scraper", "contentType": "application/zip", "probeMethod": "head", "details": { "probeUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=data-scraper", "contentDisposition": "attachment; filename=\"data-scraper-1.0.0.zip\"", "redirectLocation": null, "bodySnippet": null, "slug": "data-scraper" }, "scope": "item", "summary": "Item download looks usable.", "detail": "Yavira can redirect you to the upstream package for this item.", "primaryActionLabel": "Download for OpenClaw", "primaryActionHref": "/downloads/data-scraper" }, "validation": { "installChecklist": [ "Use the Yavira download entry.", "Review SKILL.md after the package is downloaded.", "Confirm the extracted package contains the expected setup assets." ], "postInstallChecks": [ "Confirm the extracted package includes the expected docs or setup files.", "Validate the skill or prompts are available in your target agent workspace.", "Capture any manual follow-up steps the agent could not complete." ] } }, "links": { "detailUrl": "https://openagent3.xyz/skills/data-scraper", "downloadUrl": "https://openagent3.xyz/downloads/data-scraper", "agentUrl": "https://openagent3.xyz/skills/data-scraper/agent", "manifestUrl": "https://openagent3.xyz/skills/data-scraper/agent.json", "briefUrl": "https://openagent3.xyz/skills/data-scraper/agent.md" } } ``` ## Documentation ### data-scraper Web Data Scraper — Extract structured data from web pages using curl + parsing. Lightweight, no browser required. Supports HTML-to-text, table extraction, price monitoring, and batch scraping. ### When to Use Extract text content from web pages (articles, blogs, docs) Scrape product prices, reviews, or listings Monitor pages for changes (price drops, new content) Batch-collect data from multiple URLs Convert HTML tables to structured formats (JSON/CSV) ### Quick Start # Extract readable text from URL data-scraper fetch "https://example.com/article" # Extract specific elements data-scraper extract "https://example.com" --selector "h2, .price" # Monitor for changes data-scraper watch "https://example.com/product" --interval 3600 ### Text Mode (default) Fetches page and extracts readable content, stripping HTML tags, scripts, and styles. Similar to reader mode. data-scraper fetch URL # Output: clean markdown text ### Selector Mode Target specific CSS selectors for precise extraction. data-scraper extract URL --selector ".product-title, .price, .rating" # Output: matched elements as structured data ### Table Mode Extract HTML tables into structured formats. data-scraper table URL --index 0 # Output: JSON array of row objects (header → value mapping) ### Link Mode Extract all links from a page with optional filtering. data-scraper links URL --filter "*.pdf" # Output: filtered list of absolute URLs ### Batch Scraping # Scrape multiple URLs data-scraper batch urls.txt --output results/ # With rate limiting data-scraper batch urls.txt --delay 2000 --output results/ urls.txt format: https://site1.com/page https://site2.com/page https://site3.com/page ### Change Monitoring # Watch for changes, alert on diff data-scraper watch URL --selector ".price" --interval 3600 # Compare with previous snapshot data-scraper diff URL Stores snapshots in data-scraper/snapshots/ with timestamps. Alerts via notification-hub when changes detected. ### Output Formats FormatFlagUse CaseText--format textReading, summarizationJSON--format jsonData processingCSV--format csvSpreadsheetsMarkdown--format mdDocumentation ### Headers & Auth # Custom headers data-scraper fetch URL --header "Authorization: Bearer TOKEN" # Cookie-based auth data-scraper fetch URL --cookie "session=abc123" # User-Agent override data-scraper fetch URL --ua "Mozilla/5.0..." ### Rate Limiting & Ethics Default: 1 request per second per domain Respects robots.txt when --polite flag is set Configurable delay between requests Stops on 429 (Too Many Requests) and backs off ### Error Handling ErrorBehavior404Log and skip403/401Warn about auth requirement429Exponential backoff (max 3 retries)TimeoutRetry once with longer timeoutSSL errorWarn, option to proceed with --insecure ### Integration web-claude: Use as fallback when web_fetch isn't enough competitor-watch: Feed scraped data into competitor analysis seo-audit: Scrape competitor pages for SEO comparison performance-tracker: Collect social metrics from public profiles ## Trust - Source: tencent - Verification: Indexed source record - Publisher: mupengi-bot - Version: 1.0.0 ## Source health - Status: healthy - Item download looks usable. - Yavira can redirect you to the upstream package for this item. - Health scope: item - Reason: direct_download_ok - Checked at: 2026-05-02T08:19:09.095Z - Expires at: 2026-05-09T08:19:09.095Z - Recommended action: Download for OpenClaw ## Links - [Detail page](https://openagent3.xyz/skills/data-scraper) - [Send to Agent page](https://openagent3.xyz/skills/data-scraper/agent) - [JSON manifest](https://openagent3.xyz/skills/data-scraper/agent.json) - [Markdown brief](https://openagent3.xyz/skills/data-scraper/agent.md) - [Download page](https://openagent3.xyz/downloads/data-scraper)