# Send PulpMiner Web Scraper - Convert Any Webpage to Realtime JSON API to your agent Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually. ## Fast path - Download the package from Yavira. - Extract it into a folder your agent can access. - Paste one of the prompts below and point your agent at the extracted folder. ## Suggested prompts ### New install ```text I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete. ``` ### Upgrade existing ```text I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run. ``` ## Machine-readable fields ```json { "schemaVersion": "1.0", "item": { "slug": "webscraper-pulpminer", "name": "PulpMiner Web Scraper - Convert Any Webpage to Realtime JSON API", "source": "tencent", "type": "skill", "category": "开发工具", "sourceUrl": "https://clawhub.ai/melvin2016/webscraper-pulpminer", "canonicalUrl": "https://clawhub.ai/melvin2016/webscraper-pulpminer", "targetPlatform": "OpenClaw" }, "install": { "downloadUrl": "/downloads/webscraper-pulpminer", "sourceDownloadUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=webscraper-pulpminer", "sourcePlatform": "tencent", "targetPlatform": "OpenClaw", "packageFormat": "ZIP package", "primaryDoc": "SKILL.md", "includedAssets": [ "SKILL.md" ], "downloadMode": "redirect", "sourceHealth": { "source": "tencent", "slug": "webscraper-pulpminer", "status": "healthy", "reason": "direct_download_ok", "recommendedAction": "download", "checkedAt": "2026-05-07T14:20:34.895Z", "expiresAt": "2026-05-14T14:20:34.895Z", "httpStatus": 200, "finalUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=webscraper-pulpminer", "contentType": "application/zip", "probeMethod": "head", "details": { "probeUrl": "https://wry-manatee-359.convex.site/api/v1/download?slug=webscraper-pulpminer", "contentDisposition": "attachment; filename=\"webscraper-pulpminer-1.0.1.zip\"", "redirectLocation": null, "bodySnippet": null, "slug": "webscraper-pulpminer" }, "scope": "item", "summary": "Item download looks usable.", "detail": "Yavira can redirect you to the upstream package for this item.", "primaryActionLabel": "Download for OpenClaw", "primaryActionHref": "/downloads/webscraper-pulpminer" }, "validation": { "installChecklist": [ "Use the Yavira download entry.", "Review SKILL.md after the package is downloaded.", "Confirm the extracted package contains the expected setup assets." ], "postInstallChecks": [ "Confirm the extracted package includes the expected docs or setup files.", "Validate the skill or prompts are available in your target agent workspace.", "Capture any manual follow-up steps the agent could not complete." ] } }, "links": { "detailUrl": "https://openagent3.xyz/skills/webscraper-pulpminer", "downloadUrl": "https://openagent3.xyz/downloads/webscraper-pulpminer", "agentUrl": "https://openagent3.xyz/skills/webscraper-pulpminer/agent", "manifestUrl": "https://openagent3.xyz/skills/webscraper-pulpminer/agent.json", "briefUrl": "https://openagent3.xyz/skills/webscraper-pulpminer/agent.md" } } ``` ## Documentation ### PulpMiner — AI Web Scraping & JSON API PulpMiner converts any webpage into structured JSON using AI. You provide a URL and optionally a JSON template, and PulpMiner scrapes the page, runs it through an LLM, and returns clean structured data. ### Authentication All API calls require the apikey header: apikey: Get your API key from https://pulpminer.com/api — click "Regenerate Key" if you don't have one. ### Core Workflow PulpMiner works in two phases: Create a saved API — Configure a URL, scraper, LLM, and optional JSON template via the PulpMiner dashboard at https://pulpminer.com/api Call the saved API — Use the external endpoint with your API key to fetch structured JSON ### Static API (fixed URL) curl -X GET "https://api.pulpminer.com/external/" \\ -H "apikey: " Returns JSON extracted from the configured webpage. ### Dynamic API (URL with variables) For APIs saved with template URLs like https://example.com/search?q={{query}}&page={{page}}: curl -X POST "https://api.pulpminer.com/external/" \\ -H "apikey: " \\ -H "Content-Type: application/json" \\ -d '{"query": "javascript frameworks", "page": "1"}' The {{variable}} placeholders in the saved URL get replaced with the values you provide. ### Response Format Successful responses return: { "data": { ... }, "errors": null } Error responses return: { "data": null, "errors": "Error message describing what went wrong" } ### Caching API responses are cached for 24 hours by default If cache is older than 15 minutes, PulpMiner serves the cached version while refreshing in the background Cache can be disabled per-API in the dashboard settings ### Configuration Options (Set in Dashboard) When creating a saved API at https://pulpminer.com/api, you can configure: OptionDescriptionURLThe webpage to scrapeJSON TemplateOptional JSON structure for the LLM to follow (e.g., {"name": "", "price": ""})Render JSEnable for SPAs and JS-heavy pages (uses headless browser)CSS SelectorExtract only a specific part of the page (e.g., .product-list, #main-content)Extra InstructionsAdditional guidance for the AI (e.g., "Only extract items with prices above $50")Dynamic URLEnable template variables in the URL with {{variable}} syntaxCacheToggle response caching on/off ### Integration with Zapier For async scraping in Zapier workflows: # Static API curl -X POST "https://api.pulpminer.com/external/zapier/get/" \\ -H "apikey: " \\ -d '{"callbackURL": "https://hooks.zapier.com/..."}' # Dynamic API curl -X POST "https://api.pulpminer.com/external/zapier/post/" \\ -H "apikey: " \\ -d '{"callbackURL": "https://hooks.zapier.com/...", "query": "value"}' Returns 201 immediately. Sends scraped data to the callback URL when complete. ### Integration with n8n Verify authentication: curl -X GET "https://api.pulpminer.com/external/n8n/auth" \\ -H "apikey: " Then use the standard /external/ endpoints for data fetching. ### Credits Each API call costs 0.25–0.4 credits depending on the endpoint JavaScript rendering adds 0.1 credits extra New users get 5 free credits Purchase more at https://pulpminer.com/credits ### Tips Use CSS selectors to narrow down the scraped content and improve accuracy Provide a JSON template for consistent, predictable output structures Enable JS rendering only when needed — static pages scrape faster and cost fewer credits Use extra instructions to guide the AI (e.g., "Return dates in ISO 8601 format") For monitoring use cases, keep caching enabled to reduce credit usage Use the playground first to verify a URL is scrapable before saving an API config Dynamic APIs are ideal for search pages, paginated content, and parameterized URLs ### Links Website: https://pulpminer.com API Dashboard: https://pulpminer.com/api ## Trust - Source: tencent - Verification: Indexed source record - Publisher: melvin2016 - Version: 1.0.1 ## Source health - Status: healthy - Item download looks usable. - Yavira can redirect you to the upstream package for this item. - Health scope: item - Reason: direct_download_ok - Checked at: 2026-05-07T14:20:34.895Z - Expires at: 2026-05-14T14:20:34.895Z - Recommended action: Download for OpenClaw ## Links - [Detail page](https://openagent3.xyz/skills/webscraper-pulpminer) - [Send to Agent page](https://openagent3.xyz/skills/webscraper-pulpminer/agent) - [JSON manifest](https://openagent3.xyz/skills/webscraper-pulpminer/agent.json) - [Markdown brief](https://openagent3.xyz/skills/webscraper-pulpminer/agent.md) - [Download page](https://openagent3.xyz/downloads/webscraper-pulpminer)