“Firecrawl”

Any live-web task via the Firecrawl CLI — including ordinary web research: searching the web, reading or extracting pages, gathering sources, discovering site…

Firecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.

Bulk-extract many pages from one site or section.

Discover and list a site's URLs, with search filtering.

Find the papers that answer a research query in Firecrawl's research paper index — a corpus of paper abstracts whose largest share is biomedical and…

Read a known webpage or execute a discovered workflow or data-provider capability.

Autonomously navigate websites and extract structured data across pages.

Convert a local file (PDF, DOCX, XLSX, HTML, …) to markdown, or answer questions about its content.

Find web sources with query-relevant page excerpts and optional full-page content, and discover workflows, data APIs, and indexes.

Searches current documentation, release notes, API references and public repository issues for libraries, frameworks, SDKs, APIs and CLI tools with `firecrawl…

Alert by webhook/email on web changes — use for "monitor/watch/track/alert me when": recurring checks on known URLs (prefer over repeated one-off scrapes) or…

Drive a live browser on a scraped page: click, fill forms, log in, paginate, infinite-scroll.

Save a site or section as local files (markdown, screenshots).

Find a direct path to structured data through ready-made workflows, data APIs, and indexes.

Fastcrawl

fastcrawl.netOfficial

Cloud scraping & crawling API for AI agents.