249 listed
Agent infrastructure
The services agents run on: memory, code sandboxes, browsers, voice, search and scraping APIs, vector databases, LLM gateways, inference, durable execution and hosting. Facts such as self-hosting and compliance come from each vendor's own pages, with links.
Showing 1–24 of 24
- 0.867score
LiteLLM
BerriAI
Open-source AI gateway with a Python SDK that calls 100+ LLM providers through the OpenAI format.
InfrastructureAFreshness: A★ 62Kgateway - 0.860score
Kong AI Gateway
Kong
Cloud-native API, LLM and MCP gateway with multi-LLM routing, AI analytics and an extensible plugin system.
InfrastructureAFreshness: A★ 44.3Kgateway - 0.832score
MLflow AI Gateway
Linux Foundation (MLflow)
Unified gateway for deploying and managing multiple LLM providers behind one secure endpoint.
InfrastructureAFreshness: A★ 28.5Kgateway - 0.805score
Apache APISIX AI Gateway
Apache Software Foundation
Open-source API gateway with AI plugins for multi-provider LLM proxying, token limits and observability.
InfrastructureAFreshness: A★ 17.2Kgateway - 0.778score
Bifrost
Maxim AI
Open-source AI gateway with one OpenAI-compatible API for 23+ providers, with fallbacks and semantic caching.
InfrastructureAFreshness: A★ 9.1Kgateway - 0.756score
Plano
Katanemo
AI-native proxy and data plane for agent apps: agent orchestration, LLM routing, guardrails and traces.
InfrastructureAFreshness: A★ 7.1Kgateway - 0.751score
agentgateway
agentgateway (Linux Foundation)
Open source gateway for HTTP, gRPC, LLM, MCP and agent-to-agent traffic in one data plane.
InfrastructureAFreshness: A★ 5.5Kgateway - 0.742score
ContextForge MCP Gateway
IBM
Open source registry and proxy that federates MCP, A2A and REST/gRPC APIs under central governance.
InfrastructureAFreshness: A★ 4.7Kgateway - 0.720score
Agent Router
Agent Router project (formerly Envoy AI Gateway)
Open source control plane for AI and agent traffic, powered by Envoy, with one OpenAI-compatible API.
InfrastructureAFreshness: A★ 2.3Kgateway - 0.702score
Docker MCP Gateway
Docker
Docker's open source MCP Gateway that runs MCP servers in isolated containers with credentials and access control.
InfrastructureAFreshness: A★ 1.6Kgateway - 0.694score
Portkey AI Gateway
Portkey
AI gateway giving one API to 250+ models, with observability, guardrails and prompt management.
InfrastructureCFreshness: C★ 13.3Kgateway - 0.599score
LangDB
LangDB
AI gateway and agent observability for 250+ LLMs, with tracing, analytics, guardrails and cost controls.
InfrastructureAFreshness: Agateway - 0.597score
TrueFoundry AI Gateway
TrueFoundry
Enterprise AI gateway for 1000+ LLMs with governance, observability, guardrails and an MCP gateway.
InfrastructureAFreshness: Agateway - 0.597score
Vercel AI Gateway
Vercel
Managed gateway with one API key for 400+ models across providers, with fallbacks and no token markup.
InfrastructureAFreshness: Agateway - 0.597score
Zuplo AI Gateway
Zuplo
AI gateway on the same platform as your APIs, with multi-provider routing, per-team budgets and guardrails.
InfrastructureAFreshness: Agateway - 0.596score
Requesty
Requesty
AI gateway and OpenAI-compatible router for 600+ models, with routing, failover, caching and observability.
InfrastructureAFreshness: Agateway - 0.595score
Cloudflare AI Gateway
Cloudflare
Gateway for AI apps that adds analytics, logging, caching, rate limiting and retries to model calls.
InfrastructureAFreshness: Agateway - 0.594score
Eden AI
Eden AI
AI gateway with one OpenAI-compatible API to about 1,000 models, with per-request cost tracking and team budgets.
InfrastructureAFreshness: Agateway - 0.594score
Helicone AI Gateway
Helicone
Single OpenAI-compatible API to 100+ LLM providers, with routing, fallbacks and unified observability.
InfrastructureAFreshness: Agateway - 0.594score
Not Diamond
Not Diamond
Model router that predicts which LLM to call for each request, aimed at cutting coding-agent costs.
InfrastructureAFreshness: Agateway - 0.592score
AI/ML API
AI/ML API
Single API to 1,000+ AI models across chat, image, video, audio and voice, billed under one account.
InfrastructureAFreshness: Agateway - 0.592score
OpenRouter
OpenRouter
Unified OpenAI-compatible API in front of hundreds of LLMs, with routing, fallbacks and cost tracking.
InfrastructureAFreshness: Agateway - 0.577score
Turbo MCP
Turbo MCP
Self-hosted MCP gateway and management platform with audit trails, DLP features and an AI kill-switch.
InfrastructureAFreshness: Agateway - 0.450score
Azure API Management AI Gateway
Microsoft
AI gateway capabilities in Azure API Management to secure, scale, monitor and govern AI backends.
InfrastructureAFreshness: Agateway