Skip to content
Agentmart
Submit a tool

Gguf MCP

Inspect local GGUF/safetensors models: quantization, params, VRAM fit — headers only.

Connector by arose26 · GitHub account verified by the MCP Registry

IndexedMITLocal (stdio)
Write a review

Install

Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.

npx agentmarket install connector/arose26-gguf-mcp

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Inspect local GGUF/safetensors models: quantization, params, VRAM fit — headers only.

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this server can do and what it asks for, from its tool list and install config. Checked Oct 25, 2026.

Tools
4 read · 0 write · 0 deleteRead-only
Secrets
None asked for
Install scripts
Not scanned yet
Runs as
Node.js package

Tools by what they do 4

Read from the source code; the running server may list different tools.

Read 4 · Look things up without changing anything.

  • estimate_vram
  • get_metadata
  • inspect_model
  • list_tensors

Files it touches

  • Any path the agent passes to its tools

Tools (4)

Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].

  • estimate_vramEstimate VRAM needed

    Will this model fit? Estimates memory as exact weights size plus a modeled fp16 KV cache (GGUF; context defaults to min(model context, 8192)). Safetensors models get a weights-only figure.

  • get_metadataGet model metadata

    The model's metadata key-value store (GGUF) or __metadata__ block (safetensors). Large arrays arrive as {count, sample} summaries and long strings are truncated, so tokenizer vocabularies can't flood the context. Filter keys by substring (e.g. 'tokenizer' or 'rope').

  • inspect_modelInspect a local model file

    Summarize a local GGUF or safetensors model: architecture, parameter count, quantization, context length, file size, tensor count. Reads only headers — inspecting a 70 GB model is instant. Works on extension-less GGUF blobs (e.g. Ollama's).

  • list_tensorsList tensors

    Tensor names, shapes, and storage types inside a model file. Filter by substring (e.g. 'attn' or 'blk.0').

Signals

Stars
0
Forks
0
Open issues
0
Last commit
Oct 18, 2026 (11 days ago)
Last release
Aug 14, 2026 (2 months ago)

From GitHub (fetched Oct 24, 2026).

Details

Registry name
io.github.arose26/gguf-mcp
Version
0.1.1
Auth
No auth
Packages
npm gguf-mcp
License
MIT
Repository
github.com/arose26/gguf-mcp
First seen
Oct 24, 2026
Last checked
Oct 25, 2026
Source
Official MCP Registrygithub-graphql

More from arose26

Cite this page

Gguf MCP. Agent Mart. https://agentmart.dev/connectors/arose26-gguf-mcp (last updated 2026-10-25)