agentcheck
Synthetic checks, nightly regression replay and model-drift alerts for AI agents
Connector by agentwares · GitHub account verified by the MCP Registry
Install
Works with Claude Code, VS Code, Cursor, Windsurf. Read the repository before you give any tool access to your data.
npx agentmarket install connector/agentwares-agentcheck
Asks which of your tools to add it to (Claude Code, Codex, Cursor, VS Code, Windsurf, Gemini CLI, Claude Desktop) and shows the change first. See https://agentmart.dev/cli.
Remote endpoint
https://agentwares-agentcheck.vercel.app/api/mcpRemote (HTTP)
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Permissions
What this server can do and what it asks for, from its tool list and install config. Checked Oct 25, 2026.
- Tools
- 6 read · 4 write · 1 delete
- Secrets
- 1 (API keys, tokens or passwords)
- Install scripts
- Nothing to install (hosted)
- Runs as
- Hosted (remote endpoint)
Tools by what they do 11
From the running server's own tool list (tools/list) on Oct 25, 2026.
Read 6 · Look things up without changing anything.
agentcheck_api_sunsetsagentcheck_get_pricingagentcheck_get_statusagentcheck_list_incidentsagentcheck_model_retirementsagentcheck_statuspage_preview
Write 4 · Create, change, send or run things.
agentcheck_add_checkagentcheck_promote_traceagentcheck_recordagentcheck_run_now
Delete 1 · Delete, drop, revoke or wipe things.
agentcheck_create_target
Secrets and settings it asks for
Secrets: values you paste in that let it act as you.
Authorization
Network hosts it talks to 1
agentwares-agentcheck.vercel.app· found in remote endpoint, install command
Tools (11)
As the server listed them on Oct 25, 2026. Descriptions are the server’s own words; hidden characters are shown as [U+…].
agentcheck_add_checkAdd a check to one of your targets. A check runs an input (http path/prompt, mcp tool call, a2a message) on a schedule and judges the answer with a golden: exact, contains, regex and json_schema cost nothing; rubric and baseline use the LLM judge (baseline = same outcome as the last known-good answer). Returns the check id. Requires an API key.
agentcheck_api_sunsetsread-onlyWhen does the API version this code pins stop working, and what happens then? Pass provider and version pairs as your code pins them (shopify 2025-10, meta v21.0, google-ads v22, hubspot v1, twilio-flex 2.16.2, twilio-notify v1, keap xml-rpc, exchange-online ews, stripe 2024-06-20). For each, returns every dated end the provider's own versioning, changelog or retirement page lists: status, end date (and whether the provider gives only a month), what happens after it (error, silent fall-forward to another version, app delisting, or unsupported), whether the failure is silent, the replacement ve…
agentcheck_create_targetcan change or delete dataEnroll something to monitor: an http endpoint (JSON or OpenAI-style chat), a remote MCP server (Streamable HTTP url) or an A2A agent (origin with /.well-known/agent-card.json). Pass `checks` to create checks in the same call (POST /api/v1/probe proposes three). Returns the target id, the public status page, the badge SVG URL and a README snippet. The first check runs on the next scheduled tick, within five minutes; call agentcheck_run_now to run immediately. Free tier: 1 target, hourly; Starter+: 5-minute checks. Requires an API key.
agentcheck_get_pricingread-onlyMachine-readable pricing for agentcheck: tiers with monthly USD price, target limits, check interval and features, plus per-run add-ons. Same data as /pricing.json. No API key needed.
agentcheck_get_statusread-onlyCurrent status of a public monitored target: overall state, uptime over 24h/7d/30d, last check time, last nightly scores, open incidents and the badge/status URLs. Use the owner (GitHub login) and target slug from the status page URL https://agentwares-agentcheck.vercel.app/<owner>/<slug>. No API key needed.
agentcheck_list_incidentsread-onlyOpen and recent incidents across your targets (or one target): when they opened/closed, the failing check and the cause. Requires an API key.
agentcheck_model_retirementsread-onlyIs this model retiring? Pass model IDs as your code or config names them (gpt-5-mini, claude-sonnet-4-5-20250929, gemini-2.5-flash, openai/o3-mini). For each, returns every announced shutdown on OpenAI's, Anthropic's and Google's own deprecation pages (OpenAI API, Claude API, Gemini API, Vertex AI): status, shutdown date, recommended replacement, the replacement's list-price ratio per token, the API changes the provider documents, the source URL with the date it was read, and a page with the details. retiring: false means no shutdown for that ID is on those pages. Language models only. No API …
agentcheck_promote_traceTurn an imported or recorded trace into a replayable check whose golden is the recorded outcome (tool sequence + final-answer rubric). The check runs daily and in the nightly replay (Pro). Returns the check. Requires an API key.
agentcheck_recordRecord one production interaction with your agent (the prompt or messages, the final answer, the tools it called, optionally the model) as a trace on a target. Call it from your agent or from a proxy in front of it after each task; promote a good trace with agentcheck_promote_trace to replay it nightly and catch regressions. Requires an API key.
agentcheck_run_nowRun every check of one of your targets immediately (outside the schedule) and return pass/fail per check with latency, judge cost and any incident opened or closed. Use it right after enrolling, or to confirm a fix. Requires an API key.
agentcheck_statuspage_previewread-onlyRead a public Atlassian Statuspage page once: its name, overall status, components (id, name, status, group) and unresolved incidents, from the page's own /api/v2/summary.json. Pass any address on the page: status.example.com, https://status.example.com/history or the JSON URL. Use it before POST /api/v1/statuspage, which turns the components you give a URL into a live agentcheck status page checked by agentcheck itself, with no signup; the answer carries that request's body. Same read as /statuspage/preview: only public addresses, 5-second timeout, 512 KB cap. Private pages cannot be read. No…
Signals
- Last release
- Sep 7, 2026 (1 month ago)
- Repository
- Not found on GitHub (deleted or private)
Details
- Registry name
io.github.agentwares/agentcheck- Version
- 0.1.1
- Auth
- Bearer token
- License
- License unknown
- Repository
- github.com/agentwares/servers
- First seen
- Oct 24, 2026
- Last checked
- Oct 25, 2026
- Source
- Official MCP Registry
More from agentwares
- 0.575score
seatledger
agentwares
Local ledger of Claude Code and Codex tokens, API-equivalent cost, limits and token-rate changes.
ConnectorAFreshness: ALocalClaude Code +5 - 0.570score
agentguard
agentwares
MCP policy proxy: spend caps, approvals for destructive tools, kill switch, dry-run, audit log.
ConnectorAFreshness: ALocal↓ 48/wkClaude Code +5 - 0.568score
MCP Liveness
agentwares
Does an MCP server work for a stock client?
ConnectorAFreshness: ARemoteRead-onlyClaude Code +3 - 0.533score
Real estate deal memo
agentwares
Real estate deal memo from a US address: AVM, rent, comps, cap rate, cash-on-cash, DSCR, red flags.
ConnectorBFreshness: BRemoteClaude Code +3 - 0.533score
Readiness scorer — can an agent sign up to your SaaS?
agentwares
Probe a signup URL you own and score whether an AI agent can sign up unaided.
ConnectorBFreshness: BRemoteClaude Code +3 - 0.533score
agentguard — policy proxy for agent tool calls
agentwares
Free spend report from an agent log, no key.
ConnectorBFreshness: BRemoteClaude Code +3
Cite this page
agentcheck MCP server. Agent Mart. https://agentmart.dev/connectors/agentwares-agentcheck (last updated 2026-10-25)