Web Scraping & Crawling Tools

Build powerful web scrapers and crawlers. Browse self-hosted open source alternatives to Scrapy and Puppeteer for automated web data extraction.

firecrawl

52,2514,515

Firecrawl is an API that turns any URL into clean, LLM‑ready data. It crawls sites (no sitemap required), scrapes dynamic pages, and outputs markdown, HTML, structured JSON, screenshots, links, and metadata.

llm-data-extraction

web-crawling

website-crawler

Last updated: 8/26/20254515 contributors