Loading...
Loading...
Found 5 Skills
Autonomous web scraping — navigate sites, extract structured data, handle pagination, anti-detection, and proxy rotation.
Web scraping via progressive escalation and social media platform scrapers. USE WHEN scraping, crawl, scrape URL, bot detection, CAPTCHA, spider.
High-performance web scraping API with Chrome TLS fingerprint and JS rendering
Expert data extraction guide. Starts with a structured intake to understand the target. Always tries the cheapest path first (HTTP requests → browser fingerprinting → headless browser). Covers TLS/HTTP fingerprint impersonation (curl_cffi, primp, rnet), the modern stealth-browser stack (patchright, camoufox, nodriver), the anti-bot vendor matrix (Cloudflare, DataDome, Kasada, Akamai) with per-vendor bypass, CAPTCHA/Turnstile solving, proxy networks and managed unblockers (Zyte API, Web Unlocker) with geo-targeting, structured-data extraction (JSON-LD/microdata/OpenGraph), AI/LLM-driven and adaptive extraction (scrapling, crawl4ai, firecrawl), site-stack playbooks (Next.js App Router/RSC, Tableau, OData, PX-Web, SDMX, ASP.NET, GraphQL, SPAs), browser request injection, live request interception, and clean OOP architecture standards for scrapers and extracted data. Use whenever the user wants to scrape/extract data from a website or API.
Automate cloud browsers using the Scrapfly Cloud Browser API with Python Playwright. Covers connection options, sessions, anti-bot fingerprinting, and file downloads including streaming large files (up to 500 MB) out of the session with downloads_stream=1 and the CDP IO domain.