Crawlberg
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
Connector by xberg-io · GitHub account verified by the MCP Registry
Install
Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.
npx agentmarket install connector/xberg-io-crawlberg
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Use cases: web-scraping
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this server can do and what it asks for, from its tool list and install config. Checked Oct 25, 2026.
- Tools
- 0 read · 0 write · 0 delete · 3 not yet classified
- Secrets
- None asked for
- Install scripts
- Not scanned yet
- Runs as
- Docker image
Tools by what they do 3
Read from the source code; the running server may list different tools.
Not yet classified 3 · We could not tell from the name and description.
crawlberg_crawlcrawlberg_mapcrawlberg_scrape
Tools (3)
Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].
crawlberg_crawlCrawl one or more seed URLs to JSON or Markdown with the crawlberg CLI.
crawlberg_mapEnumerate URLs from sitemaps and link extraction with the crawlberg CLI.
crawlberg_scrapeScrape one URL to JSON or Markdown with the crawlberg CLI.
Compare and alternatives
Featured in
Signals
- Stars
- 190
- Forks
- 29
- Open issues
- 4
- Contributors
- 11
- Last commit
- Oct 23, 2026 (5 days ago)
- Last release
- Oct 22, 2026 (6 days ago)
From GitHub (fetched Oct 24, 2026).
Details
- Registry name
io.github.xberg-io/crawlberg- Version
- 1.12.0
- Auth
- No auth
- Packages
- oci
ghcr.io/xberg-io/crawlberg:1.12.0 - License
- MIT
- Repository
- github.com/xberg-io/crawlberg
- Website
- xberg.io
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
More from xberg-io
- 0.769score
config-loading-precedence
xberg-io
How Xberg resolves configuration — CLI-mode and server/MCP-mode precedence orders, project config walk-up, user config fallback, field-level inline JSON merge…
SkillAFreshness: A★ 9.4KClaude Code +9 - 0.769score
feature-flag-policy
xberg-io
Cargo feature flags for crates/xberg — ORT-incompatible targets (WASM, Android x86_64 emulator), type-only and tract inference companion features…
SkillAFreshness: A★ 9.4KClaude Code +9 - 0.769score
wasm-constraints
xberg-io
WASM build constraints for the crates/xberg-wasm crate — the wasm-target feature set, no-tokio sync-only internal APIs, the crate-private SyncExtractor trait…
SkillAFreshness: A★ 9.4KClaude Code +9 - 0.769score
alef-generated-bindings
xberg-io
Alef-managed generated bindings in packages/* and binding crates — the regeneration workflow (task alef:generate / alef:verify), the alef.toml section layout…
SkillAFreshness: A★ 9.4KClaude Code +9 - 0.769score
crate-structure
xberg-io
The Xberg workspace layout — the version source of truth (root Cargo.toml [workspace.package] version), the 19 workspace members and 3 excluded crates, the…
SkillAFreshness: A★ 9.4KClaude Code +9 - 0.769score
mime-detection-routing
xberg-io
MIME type detection and extractor routing in core/mime.rs — the FORMATS registry that EXT_TO_MIME and SUPPORTED_MIME_TYPES are derived from, the path-based…
SkillAFreshness: A★ 9.4KClaude Code +9
Cite this page
Crawlberg MCP server. Agent Mart. https://agentmart.dev/connectors/xberg-io-crawlberg (last updated 2026-10-24)