Skip to content
Agentmart
Submit a tool

BenchGecko

AI model prices per provider, benchmarks, own AI behavior tests and AI economy data, with sources.

Connector by benchgecko.aiOfficial · Domain verified by the MCP Registry

IndexedLicense unknownRemote (HTTP)
Write a review

Chalk Labs

Need help deploying BenchGecko?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, VS Code, Cursor, Windsurf. Read the repository before you give any tool access to your data.

npx agentmarket install connector/benchgecko-ai-benchgecko

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Remote endpoint

  • https://benchgecko.ai/api/mcp Remote (HTTP)

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

We use your email only for this newsletter. Privacy

About

AI model prices per provider, benchmarks, own AI behavior tests and AI economy data, with sources.

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this server can do and what it asks for, from its tool list and install config. Checked Oct 25, 2026.

Tools
9 read · 0 write · 0 deleteRead-only
Secrets
None asked for
Install scripts
Nothing to install (hosted)
Runs as
Hosted (remote endpoint)

Tools by what they do 9

From the running server's own tool list (tools/list) on Oct 25, 2026.

Read 9 · Look things up without changing anything.

  • cheapest_provider
  • compare_models
  • fetch
  • get_gecko_test
  • get_model
  • get_scorecard
  • latest_findings
  • search
  • search_models

Network hosts it talks to 1

  • benchgecko.ai · found in remote endpoint, install command

Tools (9)

As the server listed them on Oct 25, 2026. Descriptions are the server’s own words; hidden characters are shown as [U+…].

  • cheapest_providerCheapest provider for a modelread-only

    Every provider serving a model, sorted by input price per 1M tokens (refreshed daily from provider endpoints), with output price, quantization and 1 day uptime.

  • compare_modelsCompare two modelsread-only

    Side by side: BenchGecko score, list price, cheapest provider, context window, shared benchmark scores and Gecko Tests grades for two models.

  • fetchFetch a BenchGecko recordread-only

    Fetch the full record for an id returned by search (model:<slug>, gecko-test:<slug> or scorecard).

  • get_gecko_testGecko Test resultsread-only

    Results of one of BenchGecko's own tests (own measurements, CC BY 4.0): who-are-you (Does the model know which lab made it?) world-map (How well does the model draw the world map from memory?) censorship-index (How often does the model refuse legitimate questions?) knowledge-horizon (Where does the model's knowledge of world events actually stop?) tokenizer-tax (How many more tokens does the same text cost outside English?) same-model-different-host (Do providers serving the same open model give the same quality?) model-drift-index (Do models quietly change behind the same name?)

  • get_modelGet model factsread-only

    Core facts for one AI model: BenchGecko score and rank, list price, price at every provider, benchmark scores with their original sources, Gecko Tests grades and as-of dates.

  • get_scorecardGecko Scorecardread-only

    BenchGecko Gecko Scorecard: every model across BenchGecko's own profile tests with a letter grade per test and an overall Gecko Score (behavior, not intelligence).

  • latest_findingsLatest findingsread-only

    Latest notable results detected in the Gecko Tests and price data (fixed rules, numbers and quotes from stored results).

  • searchSearch BenchGeckoread-only

    Search BenchGecko models and Gecko Tests. Returns ids for fetch.

  • search_modelsSearch AI modelsread-only

    Find AI models in the BenchGecko catalog by name, slug or lab. Returns slugs to use with get_model, cheapest_provider and compare_models, with BenchGecko score and list price.

Signals

Stars
0
Forks
0
Open issues
0
Last commit
Oct 21, 2026 (9 days ago)
Last release
Oct 5, 2026 (25 days ago)

From GitHub (fetched Oct 24, 2026).

Details

Registry name
ai.benchgecko/benchgecko
Version
1.0.0
Auth
Auth not stated
License
License unknown
First seen
Oct 24, 2026
Last checked
Oct 25, 2026

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped
50+
launches shipped
media placements
500+
media placements
founders on every account
2
founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get BenchGecko running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Goes to the Chalk Labs founders, not the newsletter. Privacy

Need help deploying BenchGecko?

CallGet help
Cite this page

BenchGecko MCP server. Agent Mart. https://agentmart.dev/connectors/benchgecko-ai-benchgecko (last updated 2026-10-25)