Ragmetric MCP

RAG retrieval IR metrics: recall@k, hit@k, MRR, NDCG@k, evaluate_batch.

Connector by MukundaKatta · GitHub account verified by the MCP Registry

IndexedApache-2.0Local (stdio)

Chalk Labs

Need help deploying Ragmetric MCP?

Chalk Labs sets up agents like this inside real teams: connected to your tools, tested on your data, with a human in the loop where it matters.

Book a call

Install

Works with Claude Code, Codex, VS Code, Cursor, Windsurf, Claude Desktop. Read the repository before you give any tool access to your data.

npx agentmarket install connector/mukundakatta-ragmetric-mcp

Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

RAG retrieval IR metrics: recall@k, hit@k, MRR, NDCG@k, evaluate_batch.

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Permissions

What this server can do and what it asks for, from its tool list and install config. Checked Oct 25, 2026.

Tools: 1 read · 0 write · 0 delete · 4 not yet classified
Secrets: None asked for
Install scripts: Not scanned yet
Runs as: Node.js package

Tools by what they do 5

Read from the source code; the running server may list different tools.

Read 1 · Look things up without changing anything.

recall_at_k

Not yet classified 4 · We could not tell from the name and description.

evaluate_batch
hit_at_k
mrr
ndcg_at_k

Tools (5)

Read from the source code; the running server may differ. Descriptions are the server’s own words; hidden characters are shown as [U+…].

evaluate_batch
Run all four metrics over a batch of queries and return per-metric means. Use this when you have multiple eval queries and want one summary number per metric.
hit_at_k
Hit@k: 1.0 if any relevant doc appears in top k, else 0.0. Useful when 'did we get at least one right?' is what matters.
mrr
Mean Reciprocal Rank: 1 / rank of first relevant doc, 0 if none retrieved. Ranks are 1-based. For a single query.
ndcg_at_k
NDCG@k with binary relevance. Discount = log2(rank + 1). Returns DCG@k / IDCG@k. Penalizes putting relevant docs lower in the ranking.
recall_at_k
Recall@k: fraction of relevant doc IDs in the top k retrieved. Use this when you have ground-truth relevance for a query and want to measure how well the retriever surfaced the right docs.

Signals

Stars: 0
Forks: 0
Open issues: 1
Weekly downloads: 23
Last commit (this folder): May 10, 2026 (5 months ago)
Last release: May 10, 2026 (5 months ago)
Last package publish: May 10, 2026 (5 months ago)

From GitHub (fetched Oct 24, 2026) and the package registry.

Details

Registry name: io.github.MukundaKatta/ragmetric-mcp
Version: 0.1.1
Auth: No auth
Packages: npm @mukundakatta/ragmetric-mcp
License: Apache-2.0
Repository: github.com/MukundaKatta/mcp-stack
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: Official MCP Registry github-graphql

More from MukundaKatta

Done for you

Rather not set it up yourself?

Chalk Labs scopes, builds and runs agents for your team: the task audit, the eval harness, the integrations and the weekly ops report. Fixed scope, priced before we start.

See how we build AI agents →Read the case studies

Chalk Labs is a two-founder AI and growth studio. We build AI agents, CRMs and MVPs for Web3 and AI companies, and have shipped 50+ product and token launches.

launches shipped: 50+; launches shipped
media placements: 500+; media placements
founders on every account: 2; founders on every account

Press we've placed: Forbes · CoinDesk · Decrypt · Cointelegraph · The Block

Rahil Jain, Co-founder, Chalk Labs. Ex-Goldman Sachs engineer. You talk to the person who builds it.

Get Ragmetric MCP running in your business

Tell us what you want to automate. A founder replies within one working day with a plan, not a pitch deck.

Need help deploying Ragmetric MCP?

Call Get help

Cite this page

Ragmetric MCP. Agent Mart. https://agentmart.dev/connectors/mukundakatta-ragmetric-mcp (last updated 2026-10-24)