Model Finder
Find the cheapest AI model that passes your tests: audit repo models, build evals, routing, sizing
Connector by indigloo.co · Domain verified by the MCP Registry
Chalk Labs
Need help deploying Model Finder?
Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.
Install
Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.
npx agentmarket install connector/indigloo-co-model-finder
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this server can do and what it asks for, from its tool list, install config and code. Checked Oct 25, 2026.
- Tools
- 6 read · 2 write · 0 delete · 2 not yet classified
- Secrets
- None asked for
- Install scripts
- None found
- Runs as
- Python package
Tools by what they do 10
Read from the source code; the running server may list different tools.
Read 6 · Look things up without changing anything.
modelfinder_audit_modelsmodelfinder_estimate_costmodelfinder_estimate_memorymodelfinder_rank_eval_resultsmodelfinder_scan_sensitive_datamodelfinder_validate_eval_config
Write 2 · Create, change, send or run things.
modelfinder_create_eval_configmodelfinder_draft_eval_examples
Not yet classified 2 · We could not tell from the name and description.
modelfinder_check_outputmodelfinder_generate_routing
Network hosts it talks to 9
agent-plugins.org· found in codeapi.anthropic.com· found in codeapi.openai.com· found in codecode.claude.com· found in codedocs.litellm.ai· found in codegenerativelanguage.googleapis.com· found in codegithub.com· found in codeglama.ai· found in codeindigloo.co· found in code
Files it touches
- Your home directory (~)
Tools (10)
Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].
modelfinder_audit_modelsList AI model IDs (quoted literals) and AI SDKs used in the repository, with file:line locations, provider family, route hints (Bedrock, Vertex AI, Azure, OpenRouter), usage counts and whether each ID is hard-coded or an environment-variable default. Read-only; skips secret-like files and dependency folders; never returns line content. Results are sorted by usage and paginated.
modelfinder_check_outputRun deterministic checks on one model reply. Use it to design eval checks and routing guards before spending money on a run.
modelfinder_create_eval_configAssemble an eval config from candidate models, examples with checks, and settings; validate it and screen the examples for personal data and secrets. Returns the config to save as JSON for eval_models.py. Keys are referenced by environment variable name only.
modelfinder_draft_eval_examplesDraft eval examples from prompt files and fixtures (prompts/, evals/, fixtures/, *.prompt.md, and JSON/JSONL with input, prompt or chat messages). Drops any candidate with detected personal data or secrets and reports only categories and counts. Drafts have empty checks: agree checks with the user before modelfinder_create_eval_config. Paginated; ids are stable across pages.
modelfinder_estimate_costPlanning estimate of monthly token cost from requests, average tokens per request and USD-per-million prices, with optional cached-input share and pass rate (cost per accepted result, counting retries). Prices must come from the provider's official pricing page.
modelfinder_estimate_memoryEstimate memory to run an open-weight model locally: weights at a precision plus KV cache for a context length and concurrency (standard MHA/GQA attention only), with headroom against available memory. Give all four of layers, kv_heads, head_dim and context to include the KV cache.
modelfinder_generate_routingTurn a results.json object into a cheapest-first routing.json (with guards and a personal-data policy) and a LiteLLM proxy config. Returns both; nothing is written or deployed.
modelfinder_rank_eval_resultsRead a results.json object and return the cheapest model that met the pass threshold, ranked by cost per passing call, plus the cost/reliability cascade and models dropped as dominated.
modelfinder_scan_sensitive_dataDetect Aadhaar (Verhoeff checked), PAN, payment cards (Luhn checked), email addresses, UPI IDs, Indian mobile numbers and API or private keys in text. Returns categories and counts only, never the values.
modelfinder_validate_eval_configCheck an eval config before running: schema, no keys in the config, HTTPS endpoints, no template placeholders, valid checks. Reports API call count, required environment variable names, unpriced models, and whether the personal-data guard would block the run. Makes no network calls.
Signals
- Stars
- 3
- Forks
- 1
- Open issues
- 0
- Weekly downloads
- 192
- Last commit
- Oct 18, 2026 (13 days ago)
- Last release
- Oct 17, 2026 (13 days ago)
- Last package publish
- Oct 17, 2026 (13 days ago)
From GitHub (fetched Oct 24, 2026) and the package registry.
Details
- Registry name
co.indigloo/model-finder- Version
- 1.3.5
- Auth
- No auth
- Packages
- pypi model-finder-mcp
- License
- MIT
- Repository
- github.com/Abhiindigloo/EvalHarness
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
Done for you
Rather not set it up yourself?
Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.
See how we build AI agents →Read the case studies
Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.
- launches shipped
- 50+
- launches shipped
- media placements
- 500+
- media placements
- founders on every account
- 2
- founders on every account
Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block
Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.
Get Model Finder running in your business
Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.
Cite this page
Model Finder MCP server. Agent Mart. https://agentmart.dev/connectors/indigloo-co-model-finder (last updated 2026-10-24)