Crawl4AI

Open-source web crawler that turns pages into LLM-ready Markdown, with an optional hosted cloud API.

Infrastructure by Crawl4AI

IndexedApache-2.0★ 86,173

Install

Pick your client. Read the repository before you give any tool access to your data.

pip install crawl4ai

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

Crawl4AI is an open-source crawler and scraper that converts websites into Markdown for RAG and agent pipelines. It runs as a Python library or as a Docker server on your own machine. Crawl4AI Cloud offers hosted /scrape, /extract, /search, /serp and /answer endpoints, plus an MCP endpoint for agents.

Use cases: web-scraping, web-search

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Category: Scraping · llm ready crawl
Self-host: Yesraw.githubusercontent.com
Open source: Yesraw.githubusercontent.com
Regions: EU, Singapore, USdocs.crawl4ai.com
Protocols: mcp, restraw.githubusercontent.com

Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.

Signals

Stars: 86,173
Forks: 8,962
Open issues: 46
Last commit: Oct 22, 2026 (3 days ago)
Last release: Oct 14, 2026 (12 days ago)

From GitHub (fetched Oct 24, 2026).

Details

Packages: pypi crawl4ai
License: Apache-2.0
Repository: github.com/unclecode/crawl4ai
Website: docs.crawl4ai.com
Docs: docs.crawl4ai.com
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: README Website Docs github-graphql

Cite this page

Crawl4AI. Agent Mart. https://agentmart.dev/infrastructure/crawl4ai (last updated 2026-10-24)