Requirements
- Target platform
- OpenClaw
- Install method
- Manual import
- Extraction
- Extract archive
- Prerequisites
- OpenClaw
- Primary doc
- SKILL.md
Tencent SkillHub · Developer Tools
MrScraper
Run AI-powered, unblockable web scraping, data extraction with natural language via the MrScraper API
skill openclawclawhub Free
Run AI-powered, unblockable web scraping, data extraction with natural language via the MrScraper API
⬇ 0 downloads ★ 0 stars Unverified but indexed
Install for OpenClaw
Quick setup
- Download the package from Yavira.
- Extract the archive and review SKILL.md first.
- Import or place the package into your OpenClaw setup.
Package facts
- Download mode
- Yavira redirect
- Package format
- ZIP package
- Source platform
- Tencent SkillHub
- What's included
- SKILL.md
Validation
- Use the Yavira download entry.
- Review SKILL.md after the package is downloaded.
- Confirm the extracted package contains the expected setup assets.
Install with your agent
Agent handoff
Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually.
- Download the package from Yavira.
- Extract it into a folder your agent can access.
- Paste one of the prompts below and point your agent at the extracted folder.
New install
I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete.
Upgrade existing
I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run.
Trust & source
Release facts
- Source
- Tencent SkillHub
- Verification
- Indexed source record
- Version
- 1.0.4
Provenance
- Publisher
- ai-mrscraper
- Source page
- View original listing
- Canonical URL
- Open canonical page
Documentation
MrScraper
Run AI-powered, unblockable web scraping, data extraction with natural language via the MrScraper API
Actions
This skill supports: Opening blocked pages through unblocker (stealth browser + IP rotation) Starting AI scraper runs from natural-language instructions Rerunning existing scraper configurations on one or multiple URLs Running manual workflow-based reruns Fetching paginated results and detailed results by ID This skill is API-only and does not depend on bundled local scripts.
Base URLs
Unblocker API: https://api.mrscraper.com Platform API: https://api.app.mrscraper.com
Unblocker API auth
Use query-param auth on unblocker endpoint: token=<MRSCRAPER_API_TOKEN>
Platform API auth
Use header-based auth on platform endpoints: x-api-token: <MRSCRAPER_API_TOKEN> accept: application/json content-type: application/json
How to get MRSCRAPER_API_TOKEN?
An API token lets your applications securely interact with MrScraper APIs and rerun scrapers created in the dashboard. Follow these steps in the dashboard: Click your User Profile at the top-right corner. Select API Tokens. Click New Token. Enter a name and set an expiration date. Click Create. Copy the new token and store it securely as MRSCRAPER_API_TOKEN. Use it in requests through the x-api-token header. Security rule: Never expose tokens in client-side code (browser/mobile app bundles). Store tokens in environment variables or server-side secret managers. Notes from the auth docs: The API key works for all V3 Platform endpoints. The same key can be used for endpoints on sync.scraper.mrscraper.com. For access to endpoints on other hosts, contact support@mrscraper.com.
Install and Runtime
No local install step is required by this skill document. No bundled scripts/ are required. Calls are direct HTTPS requests to the two base URLs above.
Data and Scope
Data is sent only to api.app.mrscraper.com and api.mrscraper.com. Responses may contain extracted page content and scrape metadata. This skill does not define hidden persistence or background jobs. Never expose tokens in logs, commits, or output.
1. Unblocker
Method: GET URL: https://api.mrscraper.com Auth: token query parameter Opens a target URL through stealth browsing and IP rotation, then returns HTML. Use this when direct access is blocked by captcha or anti-bot protections. Query parameters: FieldTypeRequiredDefaultDescriptiontokenstringYes—Unblocker token (MRSCRAPER_API_TOKEN)urlstringYes—URL-encoded target URLtimeoutnumberNo60Max wait in seconds (example 120)geoCodestringNoNoneGeographic routing code (example SG)blockResourcesbooleanNofalseBlock non-essential resources Request example: curl --location 'https://api.mrscraper.com?token=<MRSCRAPER_API_TOKEN>&timeout=120&geoCode=SG&url=https%3A%2F%2Fwww.lazada.sg%2Fproducts%2Fpdp-i111650098-s23209659764.html&blockResources=false' Response example: <!doctype html> <html> <head>...</head> <body>...</body> </html> Notes: Prefer explicit geoCode and practical timeouts for repeatable behavior. Only pass cookies when session-specific content is required.
2. Create AI Scraper
Method: POST Host: https://api.app.mrscraper.com Path: /api/v1/scrapers-ai Auth: x-api-token Create a new AI scraper run from natural-language instructions. Payload parameters (for agent: general or agent: listing): FieldTypeRequiredDefaultDescriptionurlstringYes—Target URLmessagestringYes—Extraction instructionagentstringNogeneralThe AI agent type to use for scraping: general, listing, or mapproxyCountrystringNoNoneISO country code for proxy-based scraping Payload parameters (for agent: map): FieldTypeRequiredDefaultDescriptionurlstringYes—Target URLagentstringNomapThe AI agent type to use for scraping (for this case it is map)maxDepthnumberNo2Maximum depth level for crawling links from the starting URL.<br>0 = only the starting URL, 1 = +direct linksmaxPagesnumberNo50Maximum number of pages to scrape during the crawling process.limitnumberNo1000Maximum number of data records to extract across all pages. Scraping stops when this limit is reached.includePatternsstringNo""Regex patterns to include (separate multiple with ||)excludePatternsstringNo""Regex patterns to exclude (separate multiple with ||) Request example: curl -X POST "https://api.app.mrscraper.com/api/v1/scrapers-ai" \ -H "x-api-token: <MRSCRAPER_API_TOKEN>" \ -H "Content-Type: application/json" \ -d '{ "url": "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html", "message": "Extract title, price, stocks, and rating", "agent": "general" }' Response example: { "id": "497f6eca-6276-4993-bfeb-53cbbbba6f08", "createdAt": "2019-08-24T14:15:22Z", "createdById": "e13e432a-5323-4484-a91d-b5969bc564d9", "updatedAt": "2019-08-24T14:15:22Z", "updatedById": "d8bc6076-4141-4a88-80b9-0eb31643066f", "deletedAt": "2019-08-24T14:15:22Z", "deletedById": "8ef578ad-7f1e-4656-b48b-b1b4a9aaa1cb", "userId": "2c4a230c-5085-4924-a3e1-25fb4fc5965b", "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "type": "AI", "url": "http://example.com", "status": "Finished", "error": "string", "tokenUsage": 0, "runtime": 0, "data": {}, // MAIN SCRAPED DATA "htmlPath": "string", "recordingPath": "string", "screenshotPath": "string", "dataPath": "string" } Notes: Choose agent type correctly as each agent is specialized for specified use cases. Use general for most standard web scraping tasks. The go to agent if the user doesn't specify or the connected LLM is not confident about the type of page. But mostly used for scraping product page, but handles any type of page very well as well. Use listing for scraping listing pages like product listings, job listings, etc. Choose this if the connected LLM can confidently identify whether the given URL is a listing page. Use map for crawling and getting all subdomain or subpages of a website. Choose this if the user specifies that the given URL is a website and not a specific page. For map agent type, there is a special args that can be used to configure the scraping process. For the map agent, you can use special arguments to control crawling:<br>maxDepth (lower values 1–2 for focused scraping, max 3 recommended),<br>maxPages (limits total pages regardless of depth),<br>limit (caps total records extracted),<br>and includePatterns/excludePatterns (regex patterns separated by || to specify which URLs to crawl or skip, e.g., */products/*||*/blog/* or */cart/*||*.pdf).<br>If includePatterns is an empty string, all URLs are included. If excludePatterns is an empty string, no URLs are excluded.
3. Rerun AI Scraper
Method: POST Host: https://api.app.mrscraper.com Path: /api/v1/scrapers-ai-rerun Auth: x-api-token Reruns an existing scraper configuration on a new URL. Payload parameters: FieldTypeRequiredDefaultDescriptionscraperIdstringYes—Scraper ID retrieved from created AI scraperurlstringYes—Target URL Optional payload parameters for map agent: FieldTypeRequiredDefaultDescriptionmaxDepthnumberNo2Crawl depthmaxPagesnumberNo50Maximum pages to crawllimitnumberNo1000Result limitincludePatternsstringNo""Regex patterns to include (separate multiple with ||)excludePatternsstringNo""Regex patterns to exclude (separate multiple with ||) Request example: curl -X POST "https://api.app.mrscraper.com/api/v1/scrapers-ai-rerun" \ -H "accept: application/json" \ -H "x-api-token: <MRSCRAPER_API_TOKEN>" \ -H "Content-Type: application/json" \ -d '{ "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "url": "https://shopee.sg/" }' Response example: { "message": "Successful operation!", "data": { "id": "497f6eca-6276-4993-bfeb-53cbbbba6f08", "createdAt": "2019-08-24T14:15:22Z", "createdById": "e13e432a-5323-4484-a91d-b5969bc564d9", "updatedAt": "2019-08-24T14:15:22Z", "updatedById": "d8bc6076-4141-4a88-80b9-0eb31643066f", "deletedAt": "2019-08-24T14:15:22Z", "deletedById": "8ef578ad-7f1e-4656-b48b-b1b4a9aaa1cb", "userId": "2c4a230c-5085-4924-a3e1-25fb4fc5965b", "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "type": "Rerun-AI", "url": "http://example.com", "status": "Finished", "error": "string", "tokenUsage": 0, "runtime": 0, "data": {}, // MAIN SCRAPED DATA "htmlPath": "string", "recordingPath": "string", "screenshotPath": "string", "dataPath": "string", "htmlContent": "string" } }
4. Bulk Rerun AI Scraper
Method: POST Host: https://api.app.mrscraper.com Path: /api/v1/scrapers-ai-rerun/bulk Auth: x-api-token Runs one scraper configuration over multiple URLs. Payload parameters: FieldTypeRequiredDefaultDescriptionscraperIdstringYes—Existing AI scraper configuration IDurlsarray[string]Yes—Target URLs to run Request example: curl -X POST "https://api.app.mrscraper.com/api/v1/scrapers-ai-rerun/bulk" \ -H "x-api-token: " \ -H "Content-Type: application/json" \ -d '{ "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "urls": [ "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html", "https://books.toscrape.com/catalogue/tipping-the-velvet_999/index.html", "https://books.toscrape.com/catalogue/soumission_998/index.html" ] }' Response example: { "message": "Bulk rerun started successfully", "data": { "bulkResultId": "f89f8f58-3c9a-42e5-a72e-59fa6c389f09", "status": "Running", "totalUrls": 3 } }
5. Rerun Manual Scraper
Method: POST Host: https://api.app.mrscraper.com Path: /api/v1/scrapers-manual-rerun Auth: x-api-token Executes a rerun using a manual browser workflow. Creating a Manual Scraper Before calling the manual rerun endpoint, you need to create and save a manual scraper from the dashboard. Follow these steps: Open the MrScraper dashboard and go to Scraper. Click New Manual Scraper +. Enter your target URL. Add workflow steps that match your site's behavior (e.g., Input, Click, Delay, Extract, Inject JavaScript). Configure pagination if needed (using options like Query Pagination, Directory Pagination, or Next Page Link). Test and save the scraper, then copy its scraperId to use in API reruns. Payload parameters: FieldTypeRequiredDefaultDescriptionscraperIdstringYes—ID of the manual scraper to rerun.urlstringYes—Target URL for the rerun.workflowarray<object>NoNoneAllows overriding the saved workflow steps. By default, uses the workflow saved during manual creation. Request example: curl -X POST "https://api.app.mrscraper.com/api/v1/scrapers-manual-rerun" \ -H "accept: application/json" \ -H "x-api-token: " \ -H "Content-Type: application/json" \ -d '{ "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "url": "https://books.toscrape.com/", "workflow": [ { "type": "extract", "data": { "extraction_type": "text", "attribute": null, "name": "book", "selector": "h3 a" } } ], "record": false, "paginator": { "type": "query_pagination", "max_page": 1, "enabled": false } }' Response example: { "message": "Successful operation!", "data": { "id": "497f6eca-6276-4993-bfeb-53cbbbba6f08", "createdAt": "2019-08-24T14:15:22Z", "createdById": "e13e432a-5323-4484-a91d-b5969bc564d9", "updatedAt": "2019-08-24T14:15:22Z", "updatedById": "d8bc6076-4141-4a88-80b9-0eb31643066f", "deletedAt": "2019-08-24T14:15:22Z", "deletedById": "8ef578ad-7f1e-4656-b48b-b1b4a9aaa1cb", "userId": "2c4a230c-5085-4924-a3e1-25fb4fc5965b", "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "type": "Rerun-AI", "url": "http://example.com", "status": "Finished", "error": "string", "tokenUsage": 0, "runtime": 0, "data": {}, // MAIN SCRAPED DATA "htmlPath": "string", "recordingPath": "string", "screenshotPath": "string", "dataPath": "string", "htmlContent": "string" } }
6. Bulk Rerun Manual Scraper
Method: POST Host: https://api.app.mrscraper.com Path: /api/v1/scrapers-manual-rerun/bulk Auth: x-api-token Runs one scraper configuration over multiple URLs. Payload parameters: FieldTypeRequiredDefaultDescriptionscraperIdstringYes—Existing manual scraper configuration IDurlsarray[string]Yes—Target URLs to run Request example: curl -X POST "https://api.app.mrscraper.com/api/v1/scrapers-manual-rerun/bulk" \ -H "x-api-token: " \ -H "Content-Type: application/json" \ -d '{ "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "urls": [ "https://books.toscrape.com/catalogue/a-light-in-the-attic_1000/index.html", "https://books.toscrape.com/catalogue/tipping-the-velvet_999/index.html", "https://books.toscrape.com/catalogue/soumission_998/index.html" ] }' Response example: { "message": "Bulk rerun started successfully", "data": { "bulkResultId": "f89f8f58-3c9a-42e5-a72e-59fa6c389f09", "status": "Running", "totalUrls": 3 } }
7. Fetch Results
Method: GET Host: https://api.app.mrscraper.com Path: /api/v1/results Auth: x-api-token Returns paginated scrape results. Query parameters: FieldTypeRequiredDefaultDescriptionsortFieldstringYesupdatedAtSort columnsortOrderstringYesDESCSort directionpagenumberYes1Page numberpageSizenumberYes10Items per pagesearchstringNoNoneSearch keyworddateRangeColumnstringNocreatedAtDate field to filterstartAtstringNoNoneDate range start (ISO)endAtstringNoNoneDate range end (ISO) Notes: sortField options: createdAt, updatedAt, id, type, url, status, error, tokenUsage, runtime sortOrder options: ASC, DESC dateRangeColumn options: createdAt, updatedAt Request example: curl -X GET "https://api.app.mrscraper.com/api/v1/results?sortField=updatedAt&sortOrder=DESC&pageSize=10&page=1" \ -H "accept: application/json" \ -H "x-api-token: <MRSCRAPER_API_TOKEN>" Response example: { "message": "Successful fetch", "data": [ { "createdAt": "2025-11-11T09:50:09.722Z", "id": "497f6eca-6276-4993-bfeb-53cbbbba6f08", "userId": "2c4a230c-5085-4924-a3e1-25fb4fc5965b", "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "type": "AI", "url": "http://example.com", "status": "Finished", "error": "string", "tokenUsage": 5, "runtime": 0, "data": "{ \"title\": \"Product A\", \"price\": \"$10\" }", "htmlPath": "string", "recordingPath": "string", "screenshotPath": "string", "dataPath": "string" } ], "meta": { "page": 1, "pageSize": 10, "total": 1, "totalPage": 1 } }
8. Fetch Detailed Result by ID
Method: GET Host: https://api.app.mrscraper.com Path: /api/v1/results/{id} Auth: x-api-token Returns one detailed result object for a specific result ID. Query parameters: FieldTypeRequiredDefaultDescriptionidstringYes—Result ID Request example: curl -X GET "https://api.app.mrscraper.com/api/v1/results/497f6eca-6276-4993-bfeb-53cbbbba6f08" \ -H "accept: application/json" \ -H "x-api-token: <MRSCRAPER_API_TOKEN>" Response example: { "message": "Successful fetch", "data": [ { "createdAt": "2025-11-11T09:50:09.722Z", "id": "497f6eca-6276-4993-bfeb-53cbbbba6f08", "userId": "2c4a230c-5085-4924-a3e1-25fb4fc5965b", "scraperId": "6695bf87-aaa6-46b0-b1ee-88586b222b0b", "type": "AI", "url": "http://example.com", "status": "Finished", "error": "string", "tokenUsage": 5, "runtime": 0, "data": "string", "htmlPath": "string", "recordingPath": "string", "screenshotPath": "string", "dataPath": "string" } ] }
Errors
Standard platform API errors: StatusMeaning400Invalid request payload401Missing or invalid API token404Scraper or result not found429Rate limit exceeded500Internal scraper error Error format: { "message": "string", "error": "string", "statusCode": "number" }
Operating Rules
Validate required fields before every call. Use pagination for large result sets. Retry on 429 with exponential backoff. Never expose credentials in outputs.
Category context
Code helpers, APIs, CLIs, browser automation, testing, and developer operations.
Source: Tencent SkillHub
Largest current source with strong distribution and engagement signals.
Package contents
Included in package
1 Docs
- SKILL.md