Loading...
Loading...
Render and extract web page content via AceDataCloud's WebExtrator API. Use when scraping a page's final rendered HTML, or extracting typed structured data (Article, Product, Recipe, Video, Discussion, Job) plus clean markdown/text from any URL. Real headless Chromium with schema.org + LLM extraction.
npx skill4agent add acedatacloud/skills webextratorSetup: See authentication for token setup.
curl -X POST https://api.acedata.cloud/webextrator/extract \
-H "Authorization: Bearer $ACEDATACLOUD_API_TOKEN" \
-H "Content-Type: application/json" \
-d '{"url": "https://example.com", "expected_type": "general"}'| Path | Purpose |
|---|---|
| Headless Chromium render → raw HTML + clean text + title |
| Render + structured extraction (schema.org + LLM types) + markdown |
| Look up historical render/extract task envelopes (7-day retention, free) |
POST /webextrator/extract
{
"url": "https://example.com",
"expected_type": "general"
}{
"success": true,
"task_id": "604b1cfb-6c5a-42c9-b900-a281e1b9c3c5",
"trace_id": "f2a7c0b0-c17c-4bc9-b6e7-9c59746dd366",
"elapsed": 0.003,
"data": {
"kind": "extract",
"url": "https://example.com",
"finalUrl": "https://example.com/",
"contentType": "general",
"title": "Example Domain",
"description": "This domain is for use in documentation examples without needing permission. Avoid use in operations.",
"language": "en",
"images": [],
"links": [],
"markdown": "...",
"text": "...",
"structured": { "schemaOrg": {}, "openGraph": {}, "jsonLd": [] }
}
}POST /webextrator/render
{
"url": "https://example.com",
"wait_until": "networkidle",
"block_resources": ["image", "media", "font"]
}data.htmldata.textdata.titledata.statusdata.finalUrlPOST /webextrator/tasks
{
"action": "retrieve",
"id": "604b1cfb-6c5a-42c9-b900-a281e1b9c3c5"
}| Parameter | Required | Description |
|---|---|---|
| Yes | Page URL to render ( |
| No | |
| No | Navigation timeout in seconds (default 30) |
| No | Extra wait in seconds after |
| No | CSS selector to wait for before ready |
| No | Drop |
| No | Extra request headers for the target site |
| No | Cookies to install before navigation |
| No | |
| No | Posted the final envelope when |
| No | Skip the Redis result cache for this request |
| No | Override cache TTL; |
| Parameter | Required | Description |
|---|---|---|
| No | |
| No | Allow LLM extractor when schema.org found nothing (default false) |
| Parameter | Required | Description |
|---|---|---|
| Yes | |
| one of | For |
| one of | For |
wait_untilblock_resourcesexpected_typeproductarticlegeneralenable_llmcache_ttl_seconds: 0bypass_cacheMCP:| Hosted:pip install mcp-webextrator| See all MCP servershttps://webextrator.mcp.acedata.cloud/mcp