Tool directory
Every scraping API, crawler framework, and AI web agent we track, in one place.
Self-hosted libraries for building crawlers you run and own, with no per-request pricing.
Node and Python crawling library with built-in anti-blocking
Mature Python framework for building and running your own crawlers
