“Model inference”

Unified inference platform for deploying and scaling AI models on any cloud, with an open-source Python serving framework.

Inference and training platform for hosted and dedicated models, deployable in your cloud or Baseten's.

Open-source platform for serving LLM, embedding and multimodal models on your own premises or in the cloud.

Access to hundreds of open models from partner inference providers through one Hugging Face token and SDK.

Inference infrastructure for AI teams: hosted open-source and fine-tuned models, plus tracing and evaluation.

Managed Ray platform for distributed training, batch inference and data processing on GPU clusters.

Plain C/C++ LLM inference engine that runs quantized models on many hardware backends, with an OpenAI-compatible server.

Fast AI inference cloud on wafer-scale hardware, with an OpenAI-compatible API and a free trial.

Managed Hugging Face service for deploying your own AI models to production on dedicated endpoints.

Containerized inference microservices for foundation models, sold as part of NVIDIA AI Enterprise and deployable on any cloud or data center.

Open-source inference framework for LLMs and multimodal models, built for agentic workloads and large-scale serving.

OpenAI-compatible inference API for open models, with dedicated GPUs, post-training and batch inference.

Runs open models locally or in the cloud, with a REST API and Python and JavaScript libraries.

Open-source AI runtime that runs text, voice, image and agent workloads on your own hardware behind OpenAI-compatible APIs.

Cloud platform for deploying and observing voice, video and physical AI agents, built on an open-source agents framework.

Serverless inference API with access to 40,000+ open-weight models through one API key.

One API for open and commercial LLM and multimodal models, with pay-as-you-go pricing and fast inference.

Hosted API for running, fine-tuning and deploying AI models, including image, video, speech, music and LLMs.

Open source gateway for HTTP, gRPC, LLM, MCP and agent-to-agent traffic in one data plane.

Open-source platform for search, ranking and ML inference over vectors, tensors, text and structured data.

Fast LLM inference API that is OpenAI-compatible, for running open models.

Inference cloud for open-weight and custom models, with 99.99% uptime SLAs and dedicated GPU endpoints.

Open source control plane for AI and agent traffic, powered by Envoy, with one OpenAI-compatible API.

Inference cloud for large open models on SambaNova dataflow hardware, with per-token pricing.