close
Scrapfly

Scrape any site, drive any browser, power any agent. One API key.

Anti-bot vendors evolve weekly. Headless browsers crash at scale. We absorb both so your scraper stays up.

1,000 free credits. No credit card.
Capterra review badge
4.9/5 from 235 reviews
POST api.scrapfly.io/scrape
{
  "success": true,
  "result": {
    "status_code": 200,
    "duration": 1.24,
    "antibot": "bypassed",
    "proxy": "residential/us",
    "browser": "chrome/148",
    "content": "<!doctype html>..."
  }
}
STATUS: one call, full stack
FIG. 01 · ONE SCRAPE CALL, FULL STACK RESPONSE

15B+

requests / month

99.99%

pass rate

8PB+

data / month

30K+

enterprises


PRODUCTS

One API key. Web scraping, browser automation, AI agents.

Pick the tool. We handle the rest: proxies, fingerprints, retries, billing.

BERJAYA BERJAYA Web Scraping API

The unblocker. Fetch any URL with anti-bot bypass, proxy rotation, and JS rendering toggle. Clean HTML or markdown, stable JSON.

$> POST https://api.scrapfly.io/scrape

BERJAYA BERJAYA Cloud Browser

Drive a real stealth Chromium over CDP. Full Playwright / Puppeteer compatibility. Hosted, scaled, undetected.

$> wss://browser.scrapfly.io/cdp?key=...

BERJAYA BERJAYA Screenshot API

Full-page, viewport, or element screenshots. PNG / JPEG / WebP. Ad-block, cookie-banner dismiss, custom viewport.

$> POST https://api.scrapfly.io/screenshot

BERJAYA BERJAYA Extraction API

Turn HTML into typed data with a prompt or a JSON schema. LLM-powered, built-in templates for products, articles, reviews, jobs.

$> POST https://api.scrapfly.io/extraction

BERJAYA BERJAYA Crawler API

Traverse entire sites with depth limits, follow rules, rate control. Streams URLs as discovered; every page runs through the Web Scraping API.

$> POST https://api.scrapfly.io/crawler

BERJAYA BERJAYA AI Browser Agent

Stealth Chromium tuned for autonomous agent loops. Browser Use, Stagehand, and Vibium compatible. Pay only for the actions that succeed.

$> POST https://api.scrapfly.io/agent

BERJAYA BERJAYA MCP Server

Connect any MCP client (Claude, Cursor, Cline, Windsurf, ChatGPT) to scrape, screenshot, extract, and crawl with one API key.

$> mcp.scrapfly.io
Get Free API Key


// LIVE

Observability included.

Success rate, throughput, latency.

FIG. 02 · LIVE PLATFORM TELEMETRY, SAMPLED IN REAL TIME

ARCHITECTURE

Every layer, built in-house.

Your API call. Our stack. From clean JSON all the way down to the exit IP.

// LAYER 03 · API

What you call.

One API key. Stable JSON envelope. Seven endpoints for scrapers, browsers, and AI agents.

// LAYER 01 · FOUNDATION

Where we exit.

Global proxy mesh across 190+ countries. Geo-aligned DNS, Accept-Language, and client-hints coherence on every request.

Residential Datacenter TCP / UDP 190+ countries

// INTEGRATIONS

Works with what you already use.

Plug Scrapfly into your favorite AI agents, workflow automations, and first-class SDKs.

// WHY SCRAPFLY

Five reasons teams pick Scrapfly.

What you get with us versus what you get with the rest of the category.

// SCRAPFLY
// MOST SCRAPING APIS
  • Protected-site success rate

    Often well below 60% on the same targets.

  • Failed requests

    Failed requests still consume credits.

  • Pricing

    Tiered pricing with premium-domain surcharges and rigid plans.

  • Product breadth

    Most cover scraping only. Browser or extraction usually means a second vendor.

  • Stack ownership

    Resells someone else's stack.


// TESTIMONIALS

Trusted by 30,000+ enterprises.

Teams pick Scrapfly after testing the alternatives. Here is why they stay.

Love using scrapfly, would highly recommend it. Their scraper set up is easily superior to something like firecrawl (firecrawl gets blocked often and is easy to replicate).

MR
Marcelo R. Managing Member Verified Capterra review

Takes the pain out of dealing with anti-bot protections and lets us focus on what we actually want to do with the data rather than fighting to access it.

MM
Megan M. Principal Investigator, AI research platform Verified Capterra review

Ran a 74k URL scraping job without major issues. Good value with the 200k credits on Discovery plan.

GV
Gilbert V. Growth Verified Capterra review

// PRICING

Try Scrapfly today.

Same API key across every Scrapfly product. Pick a credit budget, every product shares the pool. No per-product lock-in, no surprise line items.

FREE
1,000 credits on signup. Every product, no credit card, no time limit.
Get Free Credits
// DISCOVERY
$30 /mo
$0.15 per 1k credits, prepaid
200,000 API credits / month
  • 5 concurrent requests
  • 1 week log retention
  • No pay-as-you-go
  • Solo account
  • Basic Support
Start Free
// PRO
$100 /mo
$0.10 per 1k credits, prepaid
1,000,000 API credits / month
  • 20 concurrent requests
  • 2 weeks log retention
  • Extra at $3.50 / 10k
  • Solo account
  • Standard Support
Start Free
MOST POPULAR
// STARTUP
$250 /mo
$0.10 per 1k credits, prepaid
2,500,000 API credits / month
  • 50 concurrent requests
  • 3 weeks log retention
  • Extra at $2.00 / 10k
  • Team management
  • Standard Support
Start Free
// ENTERPRISE
$500 /mo
$0.09 per 1k credits, prepaid
5,500,000 API credits / month
  • 100 concurrent requests
  • 4 weeks log retention
  • Extra at $1.20 / 10k
  • Team management
  • Premium Support
Start Free
// CUSTOM
Custom
Negotiated volume contract
Unlimited credits negotiated
  • Committed concurrency
  • Custom log retention
  • MSA, DPA, BAA, HIPAA
  • Dedicated residential pools
  • Premium 24/7 support
Talk to Sales

Full plan details on the pricing page. No annual contract required, upgrade or downgrade anytime.


// USE CASES

Built for every web-scraping workflow.

From price monitoring to AI training corpora. One API, every vertical.


// FROM THE BLOG

Web scraping guides, deep-dives, and updates.

New tutorials and bypass guides every week.

NEW http

HTTP/2 and HTTP/3 Fingerprinting: Protocol-Level Bot Detection

Learn how HTTP/2 and HTTP/3 fingerprinting works at the protocol level, how anti-bot services use SETTINGS frames, pseudo-header ordering, and QUIC transport parameters to detect scrapers, and how to bypass detection with proper fingerprint matching using Python.

13 min read
NEW python

Playwright Stealth: Bypass Bot Detection in Python & Node.js

Complete guide to using playwright-stealth in Python and playwright-extra with stealth plugin in Node.js. Covers how detection works, evasion module breakdown, testing, limitations, and scaling to production with cloud browsers.

19 min read
python

How to Scrape Instagram in 2026

Tutorial on how to scrape instagram.com user and post data using pure Python. How to scrape instagram without loging in or being blocked.

22 min read
python

How to Scrape X.com (Twitter) in 2026

X.com changed the game in 2023 by closing free API access and implementing defenses that shift every 2-4 weeks. This guide explains what breaks, why it breaks, and how ScrapFly's maintained scraper handles it automatically.

14 min read
python

Web Scraping with Playwright and Python

Playwright is the new, big browser automation toolkit - can it be used for web scraping? In this introduction article, we'll take a look how can we use Playwright and Python to scrape dynamic websites.

30 min read

FAQ

Frequently Asked Questions

WHAT IS SCRAPFLY'S WEB SCRAPING API?

A web scraping API is a service that fetches any URL with anti-bot bypass, proxy rotation, and JavaScript rendering on every request, without you maintaining headless browsers or proxy stacks. Scrapfly's Web Scraping API delivers this with one HTTP call returning HTML, markdown, plain text, or structured JSON. You only pay for successful requests.

WHAT'S SCRAPFLY'S SUCCESS RATE ON PROTECTED SITES?

98% on Cloudflare, 97% on Akamai, 96% on DataDome, Imperva, and AWS WAF, 95% on PerimeterX and F5, and 94% on Kasada. Tracked daily against production traffic. See Anti-Bot Bypass for current numbers.

HOW DO YOU BYPASS ANTI-BOT PROTECTION?

Set asp=true on any request. Scrapfly detects which anti-bot system is active on the target and routes through the right engine: Curlium (byte-perfect Chrome HTTP layer for JA4 / HTTP/2 / QUIC fingerprinting) or Scrapium (stealth Chromium for JavaScript challenges, captchas, and behavioral biometrics). Both share the same Chrome identity so detection systems never see a fingerprint change mid-session. One parameter, every vendor, no per-target configuration.

WHAT KIND OF PROXIES DOES SCRAPFLY OFFER?

Two managed options. Use Scrapfly's built-in pools: datacenter (1 credit per request) or residential (25 credits per request, 190+ countries) with auto-rotation, IP cooling, and optional session stickiness. Or bring your own provider via Proxy Saver, which plugs Bright Data, Oxylabs, Webshare, SmartProxy, DataImpulse, or any SOCKS5 / HTTP proxy into the same Web Scraping API endpoint. Either way, anti-bot bypass, JA3 / JA4 fingerprint coherence, and smart retry sit on top.

DOES SCRAPFLY WORK WITH AI AGENTS AND MCP CLIENTS?

Yes. The MCP Server connects any MCP-compatible client (Claude, Cursor, Cline, Windsurf, ChatGPT, and others) to scrape, screenshot, extract, and crawl. The AI Browser Agent supports Browser Use, Stagehand, and Vibium agent loops on stealth Chromium. Native integrations also exist for LangChain, LlamaIndex, and CrewAI.

WHAT OUTPUT FORMATS DOES SCRAPFLY SUPPORT?

Multiple formats from a single API call: HTML (raw or sanitized), Markdown (with link / image stripping for LLM contexts), plain text, JSON (parsed or as the API envelope), screenshots in PNG / JPEG / WebP via the Screenshot API, structured JSON via the Extraction API using LLM prompts, CSS / XPath rules, or pre-trained models, and WARC archives for crawl jobs.

WHICH PROGRAMMING LANGUAGES DOES SCRAPFLY SUPPORT?

Five official SDKs: Python, TypeScript (Node, Deno, Bun), Go, Rust, and a Scrapy extension. The REST API works with any language via plain HTTP. The CLI handles shell pipelines and CI integration.

HOW IS SCRAPFLY DIFFERENT FROM BRIGHT DATA, ZYTE, AND OXYLABS?

Bright Data and Oxylabs are proxy-first platforms with scrapers built on top: strong on proxy infrastructure and managed datasets, heavier configuration per target. Zyte is built around Scrapy and managed services for high-protection enterprise targets. Scrapfly is single-endpoint: one API call with asp=true handles anti-bot, proxy rotation, JavaScript rendering, and structured output across every vendor with no per-target setup. You pay only for successful requests. See per-vendor comparisons on the comparison hub.

IS SCRAPFLY SOC 2 COMPLIANT?

Yes. Scrapfly holds SOC 2 Type I, SOC 2 Type II, and SOC 3 certifications, plus ISO 27001, HIPAA, and GDPR attestations. A HIPAA Business Associate Agreement (BAA) is available to Custom-plan customers. See Compliance for the full list of attestations.

DOES SCRAPFLY OFFER ENTERPRISE PLANS AND DEDICATED SUPPORT?

Yes. The Enterprise tier is $500 / month (5.5M credits, 100 concurrent requests, premium support, team management). Custom plans above 5.5M credits / month include MSA, DPA, BAA, and HIPAA, dedicated residential proxy pools, committed concurrency, premium support, and custom log retention. Contact sales@scrapfly.io. See pricing for the full grid.

WHAT HAPPENS IF A REQUEST FAILS?

You are not charged. Failed bypass attempts do not consume API credits. The API returns a structured error response with retry guidance. Transient failures on heavily protected targets are automatically retried within the same request before returning an error.

WHAT'S THE PRICING?

Usage-based, priced per API credit. Free tier: 1,000 credits, no card, no time limit. Paid plans start at $30 / month (Discovery, 200k credits, 5 concurrent) and scale to $500 / month (Enterprise, 5.5M credits, 100 concurrent), with custom contracts above 5.5M credits / month. Credit cost per call scales with features used (1 credit for HTTP, +5 for JavaScript or anti-bot, +25 for residential, 60 for screenshot). Failed requests are free. See pricing for the full plan grid and credit matrix, or use the cost estimator to size your project.


// GET STARTED

Ship in a minute. Not a sprint.

Free account, 1,000 credits, no credit card. One key, every product.