Skip to content
Agentmart
Submit a tool

Agent skills for web scraping in Claude Code

369 agent skills for web scraping in the catalog list Claude Code as a supported host. These are the 15 that rank highest, ordered by adoption, freshness and documentation. browser-use, seo-firecrawl and sitemap-audit lead the list. Claude Code reads them from .claude/skills/<name>/SKILL.md in the project, or ~/.claude/skills/<name>/ for every project. A skill is a folder with a SKILL.md file; Claude Code loads it when a task matches its description. Every listing links to its source and shows a freshness grade.

Updated Oct 26, 2026 · Built from catalog data; how we rank and grade

How to install in Claude Code

npx skills add <owner>/<repo> --skill <name> -a claude-code

Where it goes: .claude/skills/<name>/SKILL.md in the project, or ~/.claude/skills/<name>/ for every project.

The host's docs describe copying a folder with a SKILL.md into a skills directory; the npx skills command is a third-party shortcut for the same thing.

Each listing page has the exact command for that listing.

Top 15 of 369

  1. 1
    browser-use

    browser-use

    Direct browser control via CDP for web interaction: automation, scraping, testing, screenshots, and site/app work.

    • Repository has 119K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 119KLast active Oct 16, 2026Claude Code, Claude apps, Codex, Cursor +6

  2. 2
    seo-firecrawl

    AgriciDaniel

    Full-site crawling, scraping, and site mapping via Firecrawl MCP.

    • Repository has 20.1K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 20.1KLast active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  3. 3
    sitemap-audit

    nowork-studio

    XML sitemap audit — find and fix the sitemap problems that quietly waste crawl budget and slow indexing.

    • Repository has 4.1K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.1KLast active Oct 9, 2026Claude Code, Claude apps, Codex, Cursor +6

  4. 4
    seo-analysis

    nowork-studio

    Full SEO audit combining Google Search Console, URL Inspection API, PageSpeed Insights, a technical crawl, keyword research, and metadata, schema, search…

    • Repository has 4.1K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.1KLast active Oct 9, 2026Claude Code, Claude apps, Codex, Cursor +6

  5. 5
    scrape

    garrytan

    Pull data from a web page through the Aside browser — your real, already signed-in sessions.

    • Largest repository here (137,493 stars)
    • Active in the last 30 days
    • Open source (MIT)

    ★ 137.5KLast active Oct 19, 2026Claude Code, Claude apps, Codex, Cursor +6

  6. 6
    boss-zhipin-scraper

    eatmoreduck

    Scrape BOSS直聘 (job listing site) via Chrome CDP.

    • Repository has 1.6K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 1.6KLast active Oct 14, 2026Claude Code, Claude apps, Codex, Cursor +6

  7. 7
    deepapi

    davidondrej

    Use DeepAPI for all web search, deep research, and web scraping (websites, LinkedIn, GitHub, X/Twitter, YouTube, Instagram) instead of built-in search…

    • Repository has 4.2K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.2KLast active Oct 21, 2026Claude Code, Claude apps, Codex, Cursor +6

  8. 8
    browser-search

    Johell1NS

    Multi-engine web search (SearXNG) + browsing/scraping (Camofox, CloakBrowser).

    • Active in the last 30 days
    • Open source (MIT)
    • Ships helper scripts

    ★ 537Last active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  9. 9
    deep-scrape

    davidondrej

    Build sourced JSON dossiers on people, companies, or topics with DeepAPI.

    • Repository has 4.2K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.2KLast active Oct 18, 2026Claude Code, Claude apps, Codex, Cursor +6

  10. 10
    firecrawl-scrape

    firecrawlOfficial

    Read a known webpage or execute a discovered workflow or data-provider capability.

    • Published by the vendor
    • Active in the last 30 days

    ★ 664Last active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  11. 11
    firecrawl-alexandria

    firecrawlOfficial

    Find a direct path to structured data through ready-made workflows, data APIs, and indexes.

    • Published by the vendor
    • Active in the last 30 days

    ★ 664Last active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  12. 12
    x-twitter-scraper

    Xquik

    Use Xquik to fetch X (Twitter) data or act through a connected account.

    • Active in the last 30 days
    • Open source (MIT)

    ★ 220Last active Oct 13, 2026Claude Code, Claude apps, Codex, Cursor +6

  13. 13
    hackernews-frontpage

    garrytan

    Scrape the Hacker News front page (titles, points, comment counts).

    • Largest repository here (137,493 stars)
    • Open source (MIT)
    • Ships helper scripts

    ★ 137.5KLast active Aug 17, 2026Claude Code, Claude apps, Codex, Cursor +6

  14. 14
    xquik-social-research

    Xquik-dev

    Research X data with Xquik, the world's fastest and cheapest X Twitter scraper service with the most complete X data.

    • Active in the last 30 days
    • Open source (MIT)

    ★ 220Last active Oct 13, 2026Claude Code, Claude apps, Codex, Cursor +6

  15. 15
    tavily-hikari-crawl

    IvanLi-CN

    Crawl bounded sites through Tavily Hikari with tvly-hikari.

    • Active in the last 30 days
    • Open source (MIT)

    ★ 367Last active Oct 24, 2026Claude Code, Claude apps, Codex, Cursor +6

Related