Skip to content
Agentmart
Submit a tool

LLM Preflight

Local, cross-provider preflight checks for LLM integration changes.

Connector by feronovak · GitHub account verified by the MCP Registry

IndexedMITLocal (stdio)★ 3
Write a review

Chalk Labs

Need help deploying LLM Preflight?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.

npx agentmarket install connector/feronovak-llm-preflight

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

Local, cross-provider preflight checks for LLM integration changes.

Use cases: llm-evaluation, model-inference

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this server can do and what it asks for, from its tool list, install config and code. Checked Oct 25, 2026.

Tools
5 read · 2 write · 0 delete
Secrets
None asked for
Install scripts
None found
Runs as
Python package

Tools by what they do 7

Read from the source code; the running server may list different tools.

Read 5 · Look things up without changing anything.

  • audit_source
  • diff_baseline
  • gate
  • validate_config
  • verify

Write 2 · Create, change, send or run things.

  • dry_run_plan
  • run_preflight

Network hosts it talks to 22

  • ai.google.dev · found in code
  • alibabacloud.com · found in code
  • anthropic.com · found in code
  • api-docs.deepseek.com · found in code
  • api.anthropic.com · found in code
  • api.deepseek.com · found in code
  • api.openai.com · found in code
  • api.typesafe.ai · found in code
  • api.x.ai · found in code
  • api.z.ai · found in code
  • dashscope-intl.aliyuncs.com · found in code
  • developers.openai.com · found in code
  • docs.typesafe.ai · found in code
  • docs.x.ai · found in code
  • docs.z.ai · found in code
  • generativelanguage.googleapis.com · found in code
  • github.com · found in code
  • in-toto.io · found in code
  • mock.local · found in code
  • openrouter.ai · found in code
  • platform.claude.com · found in code
  • qwencloud.com · found in code

Files it touches

  • Your home directory (~)

Tools (7)

Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].

  • audit_source

    Audit literal model IDs in workspace source files for retirement and pricing verdicts. Needs no benchmark config; makes no provider request.

  • diff_baseline

    Compare two saved local benchmark result files without provider access.

  • dry_run_plan

    Return a redacted local run and cost plan without provider access.

  • gate

    Decide offline whether the workspace has a fresh passing CI record for its contract under the selection CI runs. Reads workspace files only; makes no provider request. A gate pass is not approval of a model, a budget, a merge or paid work.

  • run_preflight

    Run a local preflight. Live provider requests require explicit paid-run confirmation.

  • validate_config

    Validate a local benchmark config without provider access.

  • verify

    Report a proof-of-preflight record's integrity and freshness separately. Reads workspace files only; makes no provider request. An intact, fresh record is not approval.

Signals

Stars
3
Forks
0
Open issues
0
Weekly downloads
652
Last commit
Oct 19, 2026 (11 days ago)
Last release
Oct 19, 2026 (11 days ago)
Last package publish
Oct 19, 2026 (11 days ago)

From GitHub (fetched Oct 24, 2026) and the package registry.

Details

Registry name
io.github.feronovak/llm-preflight
Version
2.22.2
Auth
No auth
Packages
pypi llm-preflight
License
MIT
Repository
github.com/feronovak/llm-preflight
First seen
Oct 24, 2026
Last checked
Oct 24, 2026
Source
Official MCP Registrygithub-graphql

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped
50+
launches shipped
media placements
500+
media placements
founders on every account
2
founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get LLM Preflight running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Goes to the Chalk Labs founders, not the newsletter. Privacy

Need help deploying LLM Preflight?

CallGet help
Cite this page

LLM Preflight MCP server. Agent Mart. https://agentmart.dev/connectors/feronovak-llm-preflight (last updated 2026-10-24)