“coding”

JSON-RPC protocol that lets any code editor run any coding agent, locally over stdio or remotely over HTTP.

Plain Markdown file at a repository root that tells coding agents how to build, test and work in the project.

Continuously refreshed coding benchmark built from new contest problems to limit training-data contamination.

Human-validated set of 500 real GitHub issues from Python repositories for testing coding agents.

Harder, long-horizon software engineering tasks from public and proprietary codebases, with a held-out set.

Open payment standard that uses the HTTP 402 status code so clients, including agents, can pay per request.

Benchmark of hard, realistic command-line tasks that agents must complete inside a terminal sandbox.

Self-hosted web environment with realistic sites (shopping, forums, code hosting, maps) for testing web agents.