Skip to content
Agentmart
Submit a tool

Ollama / vLLM Bridge

Call your local Ollama or vLLM model over MCP with schema-validated JSON output

Connector by setheerwagen · GitHub account verified by the MCP Registry

IndexedMITLocal (stdio)
Write a review

Chalk Labs

Need help deploying Ollama / vLLM Bridge?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.

npx agentmarket install connector/setheerwagen-mcp-ollama-vllm

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Call your local Ollama or vLLM model over MCP with schema-validated JSON output

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this server can do and what it asks for, from its tool list, install config and code. Checked Oct 25, 2026.

Tools
4 read · 0 write · 0 deleteRead-only
Secrets
1 (API keys, tokens or passwords)
Install scripts
None found
Runs as
Python package

Tools by what they do 4

Read from the source code; the running server may list different tools.

Read 4 · Look things up without changing anything.

  • list_models
  • local_ask
  • local_embed
  • local_structured

Secrets and settings it asks for

Secrets: values you paste in that let it act as you.

  • LOCAL_API_KEY

Other settings (environment variables or headers).

  • LOCAL_BACKEND
  • LOCAL_EMBED_MODEL
  • LOCAL_EMBED_PATH
  • LOCAL_HOST
  • LOCAL_SCHEMA_MODE
  • LOCAL_TIMEOUT

Network hosts it talks to 4

  • 8.8.8.8 · found in code
  • api.openai.com · found in code
  • github.com · found in code
  • multi-addr.local.test · found in code

Tools (4)

Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].

  • list_models

    Lists the models available on the local instance. Returns per model the name, parameter size, quantization and on-disk size, as far as the backend reports them. With vLLM it additionally shows whether an entry is a LoRA adapter and which base model it belongs to. Sensible before any other tool, to pick a fitting and actually present model name.

  • local_ask

    Asks a local model a question and returns the answer as text. For free-text tasks: writing, rewriting, summarizing, explaining. If a machine-processable result is needed, use 'local_structured' instead. Args: model: Model name as in 'list_models', for example 'llama3.2:3b'. prompt: The actual instruction for the model. system: Optional role/behavior instruction. temperature: 0 means as deterministic as possible (default), higher means more creative. max_tokens: Optional cap on the number of generated tokens. context: Optional text prepended to the prompt (source, exce…

  • local_embed

    Computes embedding vectors for a list of texts. Useful for similarity comparisons, duplicate detection or a rough sort by topic, without troubling a large language model. Args: texts: List of texts to embed. model: Embedding model, with Ollama preset to 'nomic-embed-text'.

  • local_structured

    Has a local model return a result that conforms to a JSON schema. Uses the respective backend's schema enforcement (Ollama's 'format' field, vLLM's 'response_format' with 'json_schema') and then additionally validates the answer against the schema itself. If the output does not satisfy the schema, it retries up to twice, passing the model the concrete violations. Only then an error, but then with the invalid raw output, so it is visible what went wrong. Args: model: Model name, for example 'llama3.2:3b'. prompt: Instruction on what should be extracted from which text. schema: JSO…

Signals

Stars
0
Forks
0
Open issues
0
Weekly downloads
276
Last commit (this folder)
Oct 22, 2026 (10 days ago)
Last release
Oct 22, 2026 (10 days ago)
Last package publish
Oct 22, 2026 (10 days ago)

From GitHub (fetched Oct 24, 2026) and the package registry.

Details

Registry name
io.github.setheerwagen/mcp-ollama-vllm
Version
1.0.6
Auth
API key
Packages
pypi mcp-ollama-vllm
License
MIT
Repository
github.com/setheerwagen/local-ai-mcp-servers
First seen
Oct 24, 2026
Last checked
Oct 24, 2026
Source
Official MCP Registrygithub-graphql

More from setheerwagen

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped
50+
launches shipped
media placements
500+
media placements
founders on every account
2
founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get Ollama / vLLM Bridge running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Goes to the Chalk Labs founders, not the newsletter. Privacy

Need help deploying Ollama / vLLM Bridge?

CallGet help
Cite this page

Ollama / vLLM Bridge MCP server. Agent Mart. https://agentmart.dev/connectors/setheerwagen-mcp-ollama-vllm (last updated 2026-10-24)