MLflow AI Gateway

Unified gateway for deploying and managing multiple LLM providers behind one secure endpoint.

Infrastructure by Linux Foundation (MLflow)

IndexedApache-2.0★ 28,516

Install

Pick your client. Read the repository before you give any tool access to your data.

pip install mlflow

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

MLflow's AI Gateway provides a unified interface for deploying and managing multiple LLM providers in an organization. It offers traffic splitting for A/B testing, automatic fallback chains and passthrough endpoints in providers' native formats. API keys are stored in one place with request and response logging.

Use cases: model-inference

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Category: LLM gateways · open source
Self-host: Yesraw.githubusercontent.com
Open source: Yesraw.githubusercontent.com
Protocols: opentelemetry, mcpraw.githubusercontent.com

Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.

Signals

Stars: 28,516
Forks: 6,516
Open issues: 1,520
Last commit: Oct 24, 2026 (4 days ago)
Last release: Oct 21, 2026 (7 days ago)

Details

Packages: pypi mlflow
License: Apache-2.0
Repository: github.com/mlflow/mlflow
Website: mlflow.org
Docs: mlflow.org/docs/latest/genai/governance/ai-gateway/
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: README Website Docs

Cite this page

MLflow AI Gateway. Agent Mart. https://agentmart.dev/infrastructure/mlflow-ai-gateway (last updated 2026-10-24)