Headless browser tools for web scraping

Crawlee

Node and Python crawling library with built-in anti-blocking

SOAX

Residential, mobile, and datacenter proxies with a data API

Evomi

Swiss residential and datacenter proxy network with a scraper API

Rayobyte

Proxy network with residential, ISP, and datacenter IPs

Octoparse

No-code scraper that turns web pages into structured data

Apify

Cloud platform for running and sharing scraping bots

ParseHub

Desktop point-and-click scraper for JS-heavy sites, exports JSON/CSV

Stabler

Node-graph builder for JS-rendered scrapers with anti-bot bypass

No-Code Scraper

No-code AI scraper that exports data to CSV, Excel, or JSON

Hexomatic

Cloud-based no-code scraper with 100+ prebuilt automations

Axiom.ai

No-code Chrome extension for browser automation and scraping

ZenRows

Scraping API with proxy rotation, anti-bot bypass, and JS rendering

Scrapeless

Cloud scraping API and proxy network billed only on success

ScrapingAnt

Web scraping API with headless Chrome rendering and rotating proxies

Scrapingdog

Web scraping API with rotating proxies and JS rendering

Scrapfly

API-first scraping platform with anti-bot bypass and proxy rotation

WebScrapingAPI

Hosted scraping API with JS rendering, SERP and Amazon parsers

Scraping Fish

Web scraping API with rotating proxies and headless JS rendering

ScrapeNinja

Web scraping API with proxy rotation and Chrome fingerprinting

ScrapeOwl

Web scraping API with proxy rotation and CAPTCHA bypass

WebScraping.AI

Web scraping API with headless Chrome rendering and AI extraction

HasData

Managed API turning any URL into structured JSON or Markdown data

Scraping Bot

Scraping API with prebuilt endpoints for e-commerce and real estate

Scrape.do

Scraping API with rotating proxies and ready-made site endpoints

Zenscrape

Web scraping API with proxy rotation and headless rendering

ScrapingBee

Scraping API with headless Chrome rendering and AI extraction

ScrapeOps

Aggregates 20+ proxy providers with a scraper ops dashboard

LLM Scraper

TypeScript library that turns webpages into structured data via LLMs

AgentQL

Natural-language query language for structured web data extraction

Jina Reader

Turns any URL into clean markdown via a simple API prefix

Stagehand

Open source AI browser automation SDK from Browserbase

Playwright

Open-source browser automation library for Chromium, Firefox, WebKit

Katana

Open-source Go web crawler with headless JS rendering and JSON output

Puppeteer

Node.js library from Google for headless Chrome automation

Selenium

Open-source browser automation framework for testing and scraping

Scale SERP

Google search results API with structured JSON output

Value SERP

Google SERP scraping API with JSON, HTML, or CSV output

BrowserGym

Gym-style API unifying web-agent benchmarks like WebArena

WebCanvas

Open-source benchmark for evaluating web agents online

Bananalyzer

Open-source Playwright benchmark for evaluating AI web agents

Browserbase

Managed headless-browser API for AI agents and developers

Browserless

Cloud headless browsers you drive with Puppeteer or Playwright

Lightpanda

Headless browser engine built in Zig, not a Chromium fork

BrowserCloud

Cloud browser automation platform for scraping and AI agents

Hyperbrowser

Managed cloud browsers for AI agents with scrape and crawl APIs

Surfsky

Cloud antidetect browsers with proxy management and captcha solving

Steel

Open-source cloud browser API with sessions and stealth for AI agents

Anchor Browser

Cloud browser infrastructure for AI agents to act on websites