Skip to content
Agentmart
Submit a tool

Best agent skills for web scraping

We found 369 agent skills for web scraping in the catalog; these are the 15 that rank highest. The order comes from our rank, which weighs adoption, freshness, documentation and publisher identity. Nobody can pay for a place on this list. browser-use, seo-firecrawl and sitemap-audit lead it. firecrawl-scrape and firecrawl-alexandria are published by the company that makes them. scrape comes from the largest repository here (137,493 stars). 14 of the 15 had activity in the last 30 days. Each entry lists why it made the list and links to its install page.

Updated Oct 26, 2026 · Built from catalog data; how we rank and grade

Top 15 of 369

  1. 1
    browser-use

    browser-use

    Direct browser control via CDP for web interaction: automation, scraping, testing, screenshots, and site/app work.

    • Repository has 119K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 119KLast active Oct 16, 2026Claude Code, Claude apps, Codex, Cursor +6

  2. 2
    seo-firecrawl

    AgriciDaniel

    Full-site crawling, scraping, and site mapping via Firecrawl MCP.

    • Repository has 20.1K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 20.1KLast active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  3. 3
    sitemap-audit

    nowork-studio

    XML sitemap audit — find and fix the sitemap problems that quietly waste crawl budget and slow indexing.

    • Repository has 4.1K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.1KLast active Oct 9, 2026Claude Code, Claude apps, Codex, Cursor +6

  4. 4
    seo-analysis

    nowork-studio

    Full SEO audit combining Google Search Console, URL Inspection API, PageSpeed Insights, a technical crawl, keyword research, and metadata, schema, search…

    • Repository has 4.1K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.1KLast active Oct 9, 2026Claude Code, Claude apps, Codex, Cursor +6

  5. 5
    scrape

    garrytan

    Pull data from a web page through the Aside browser — your real, already signed-in sessions.

    • Largest repository here (137,493 stars)
    • Active in the last 30 days
    • Open source (MIT)

    ★ 137.5KLast active Oct 19, 2026Claude Code, Claude apps, Codex, Cursor +6

  6. 6
    boss-zhipin-scraper

    eatmoreduck

    Scrape BOSS直聘 (job listing site) via Chrome CDP.

    • Repository has 1.6K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 1.6KLast active Oct 14, 2026Claude Code, Claude apps, Codex, Cursor +6

  7. 7
    deepapi

    davidondrej

    Use DeepAPI for all web search, deep research, and web scraping (websites, LinkedIn, GitHub, X/Twitter, YouTube, Instagram) instead of built-in search…

    • Repository has 4.2K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.2KLast active Oct 21, 2026Claude Code, Claude apps, Codex, Cursor +6

  8. 8
    browser-search

    Johell1NS

    Multi-engine web search (SearXNG) + browsing/scraping (Camofox, CloakBrowser).

    • Active in the last 30 days
    • Open source (MIT)
    • Ships helper scripts

    ★ 537Last active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  9. 9
    deep-scrape

    davidondrej

    Build sourced JSON dossiers on people, companies, or topics with DeepAPI.

    • Repository has 4.2K stars
    • Active in the last 30 days
    • Open source (MIT)

    ★ 4.2KLast active Oct 18, 2026Claude Code, Claude apps, Codex, Cursor +6

  10. 10
    firecrawl-scrape

    firecrawlOfficial

    Read a known webpage or execute a discovered workflow or data-provider capability.

    • Published by the vendor
    • Active in the last 30 days

    ★ 664Last active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  11. 11
    firecrawl-alexandria

    firecrawlOfficial

    Find a direct path to structured data through ready-made workflows, data APIs, and indexes.

    • Published by the vendor
    • Active in the last 30 days

    ★ 664Last active Oct 22, 2026Claude Code, Claude apps, Codex, Cursor +6

  12. 12
    x-twitter-scraper

    Xquik

    Use Xquik to fetch X (Twitter) data or act through a connected account.

    • Active in the last 30 days
    • Open source (MIT)

    ★ 220Last active Oct 13, 2026Claude Code, Claude apps, Codex, Cursor +6

  13. 13
    hackernews-frontpage

    garrytan

    Scrape the Hacker News front page (titles, points, comment counts).

    • Largest repository here (137,493 stars)
    • Open source (MIT)
    • Ships helper scripts

    ★ 137.5KLast active Aug 17, 2026Claude Code, Claude apps, Codex, Cursor +6

  14. 14
    xquik-social-research

    Xquik-dev

    Research X data with Xquik, the world's fastest and cheapest X Twitter scraper service with the most complete X data.

    • Active in the last 30 days
    • Open source (MIT)

    ★ 220Last active Oct 13, 2026Claude Code, Claude apps, Codex, Cursor +6

  15. 15
    tavily-hikari-crawl

    IvanLi-CN

    Crawl bounded sites through Tavily Hikari with tvly-hikari.

    • Active in the last 30 days
    • Open source (MIT)

    ★ 367Last active Oct 24, 2026Claude Code, Claude apps, Codex, Cursor +6

Related