Web data tools for AI agents

NodeMaven

Residential and mobile proxy network with ZIP-level targeting

Apify

Cloud platform for running and sharing scraping bots

Databar.ai

No-code GTM data enrichment via 160+ third-party providers

Olostep

Web data API with built-in JS rendering, proxies, and CAPTCHA solving

ScrapeGraphAI

AI-powered API that turns any webpage into structured JSON via prompts

AgentQL

Natural-language query language for structured web data extraction

Exa

Semantic search API for AI agents, returning structured JSON

BrowserOS

Open-source Chromium browser with a built-in AI agent

Linkup

Search, fetch, and research API for AI applications

Tavily

Real-time web search, extract, and crawl API for AI agents

Nstbrowser

Cloud antidetect browser bundling proxies and CAPTCHA solving

Stagehand

Open source AI browser automation SDK from Browserbase

Browser Use

Open-source browser agent framework plus a paid cloud API

Skyvern

Open source browser automation agent using LLMs and vision

Nanobrowser

Open-source Chrome extension for multi-agent browser automation

Bytebot

Open-source AI agent that automates tasks via a virtual desktop

CloudCruise

API platform for browser automation agents in healthcare workflows

rtrvr.ai (Retriever AI)

Browser-extension AI agent for automating tasks and scraping data

Agent-E

Open-source LLM agent framework for browser automation

Asteroid

AI browser agents for healthcare portals and EHR workflows

Notte

Browser automation platform with AI agents and structured scraping

LaVague

Open-source framework for building AI agents to navigate websites

Gumloop

No-code AI agent builder with web scraping and crawling nodes

TinyFish

Unified API platform giving AI agents structured access to the web

Cua

Open-source framework for AI agents to control desktop OS sandboxes

Playwright

Open-source browser automation library for Chromium, Firefox, WebKit

Crawl4AI

Open-source Python crawler built for LLM and AI-agent pipelines

Serper

Google Search API with structured JSON results in 1-2 seconds

Brave Search API

Search API over Brave's independent index, with an LLM endpoint

WebVoyager

Open-source multimodal web agent with a 643-task benchmark

WebArena

Self-hosted, open-source benchmark for autonomous web agents

Mind2Web

Benchmark of 2,350 tasks across 137 real websites for web agents

BrowserGym

Gym-style API unifying web-agent benchmarks like WebArena

MiniWoB++

Benchmark suite of 100+ simulated web tasks for web agents

AssistantBench

Academic benchmark testing AI agents on realistic web tasks

WebCanvas

Open-source benchmark for evaluating web agents online

GAIA

Benchmark for evaluating general AI agents on reasoning and tool use

Bananalyzer

Open-source Playwright benchmark for evaluating AI web agents

OSWorld

Benchmark for evaluating computer-use AI agents on real tasks

VisualWebArena

Benchmark of 910 visually grounded tasks for multimodal web agents

WebShop

Simulated e-commerce benchmark for training web-shopping agents

Browserbase

Managed headless-browser API for AI agents and developers

Lightpanda

Headless browser engine built in Zig, not a Chromium fork

BrowserCloud

Cloud browser automation platform for scraping and AI agents

Hyperbrowser

Managed cloud browsers for AI agents with scrape and crawl APIs

Surfsky

Cloud antidetect browsers with proxy management and captcha solving

Steel

Open-source cloud browser API with sessions and stealth for AI agents

Anchor Browser

Cloud browser infrastructure for AI agents to act on websites

Airtop

Cloud browsers that let AI agents log in and act on websites

Coresignal

Structured company, employee, and job data via API and bulk files