Everything in the catalog

Open protocol for agents built on different frameworks and vendors to discover each other and collaborate on tasks.

Event-based protocol that streams agent state, messages and tool calls between an agent backend and a user-facing app.

Open folder format (a SKILL.md plus optional scripts and files) for packaging instructions an agent loads on demand.

Open payment standard that uses the HTTP 402 status code so clients, including agents, can pay per request.

Plain Markdown file at a repository root that tells coding agents how to build, test and work in the project.

JSON-RPC protocol that lets any code editor run any coding agent, locally over stdio or remotely over HTTP.

Open standard for agentic commerce covering discovery, checkout and post-purchase between platforms, agents and businesses.

Revised version of OSWorld, a benchmark of open-ended tasks on real desktop operating systems for computer-use agents.

Human-validated set of 500 real GitHub issues from Python repositories for testing coding agents.

Simulated customer-service benchmark where an agent follows domain policies and uses tools while a simulated user also acts.

Benchmark of hard, realistic command-line tasks that agents must complete inside a terminal sandbox.

Proposal for a Markdown /llms.txt file that gives language models a short, curated map of a website's content.

Benchmark and framework that tests models and agents on tasks using real-world MCP servers.

2,500 expert-written, closed-ended questions across dozens of academic subjects, including multimodal items.

OpenTelemetry attribute names and signal shapes for tracing LLM calls, agents, tool execution and MCP operations.

Leaderboard that tests how accurately models call functions and tools, from single calls to multi-turn agentic use.

Open protocol for agent-initiated payments, built as an extension to A2A and MCP, with signed user mandates.

Framework-neutral configuration language for describing agents and flows so they can be serialized and run on different runtimes.

Harder, long-horizon software engineering tasks from public and proprietary codebases, with a held-out set.

Open checkout standard from OpenAI and Stripe for buyers and AI agents to complete purchases with businesses.

Open protocol suite for agent identity, discovery and messaging on the open web, built on W3C DIDs.

1,266 hard-to-find questions with short answers for testing how persistently agents can search the web.

Stress test for realistic MCP use across Notion, GitHub, filesystem, PostgreSQL and Playwright servers.

Self-hosted web environment with realistic sites (shopping, forums, code hosting, maps) for testing web agents.