Everything in the catalog

Runs open models locally or in the cloud, with a REST API and Python and JavaScript libraries.

Fast, easy-to-use open-source library for LLM inference and serving, with an OpenAI-compatible server.

Plain C/C++ LLM inference engine that runs quantized models on many hardware backends, with an OpenAI-compatible server.

Open-source AI runtime that runs text, voice, image and agent workloads on your own hardware behind OpenAI-compatible APIs.

Managed Ray platform for distributed training, batch inference and data processing on GPU clusters.

Open-source inference framework for LLMs and multimodal models, built for agentic workloads and large-scale serving.

Single-file executable that bundles llama.cpp with Cosmopolitan Libc, so an LLM runs locally with no installation.

Open-source platform for serving LLM, embedding and multimodal models on your own premises or in the cloud.

Unified inference platform for deploying and scaling AI models on any cloud, with an open-source Python serving framework.

Inference and training platform for hosted and dedicated models, deployable in your cloud or Baseten's.

Open-source library that optimizes LLM and visual generation inference with specialized kernels and a Python framework.

Open-source, datacenter-scale orchestration layer that coordinates multi-node inference across engines such as SGLang, TensorRT-LLM and vLLM.

Inference and fine-tuning platform for open-source models, on serverless per-token or dedicated GPU deployments.

Inference cloud for large open models on SambaNova dataflow hardware, with per-token pricing.

Inference cloud for open-weight and custom models, with 99.99% uptime SLAs and dedicated GPU endpoints.

Desktop app for running open LLMs locally, with a built-in agent called Bionic.

Containerized inference microservices for foundation models, sold as part of NVIDIA AI Enterprise and deployable on any cloud or data center.