All 166 Dependencies
Every package Firecrawl depends on, ranked by repo health score.
Firecrawl is an open-source web data API that gives AI agents and developers a single endpoint to search, scrape, crawl, map, and interact with the web at scale. It converts any URL into clean Markdown, structured JSON, or screenshots — handling JS rendering, rotating proxies, bot detection, and rate limits transparently so you never have to think about them.
At its core, Firecrawl operates a multi-engine scraping pipeline that intelligently selects the best method for each URL: from simple HTTP fetch for static pages all the way to headless Chromium via Playwright or its proprietary Fire Engine for bot-protected sites. The result is 96% web coverage at P95 latencies under 3.5 seconds, benchmarked against millions of real pages.
Beyond basic scraping, Firecrawl exposes a natural-language Agent endpoint powered by its Spark model family. Give it a plain-English prompt — 'Find the pricing plans for Notion' — and the agent searches, navigates, and extracts structured data without you specifying a single URL. It also supports browser interaction sessions, allowing scrape-then-click workflows for dynamic applications like e-commerce search.
Firecrawl is available as a managed cloud service at firecrawl.dev with generous free tiers, and as a fully self-hostable stack via Docker Compose. The self-hosted version supports the full scrape, crawl, map, and search API surface, with optional Playwright-based JavaScript rendering and SearXNG-powered search — making it viable for organizations that need data sovereignty without giving up developer experience.