Tool directory
Every scraping API, crawler framework, and AI web agent we track, in one place.
Tools with a real free tier or no price at all. Good for prototypes and side projects; check the request caps before you build anything serious on one.
Mature Python framework for building and running your own crawlers
Node and Python crawling library with built-in anti-blocking
