Search
“Python”
Showing 1–8 of 8 for “Python”
- 0.885score
Ollama
Ollama
Runs open models locally or in the cloud, with a REST API and Python and JavaScript libraries.
InfrastructureAFreshness: A★ 184.6Kinference - 0.777score
BentoML
BentoML
Unified inference platform for deploying and scaling AI models on any cloud, with an open-source Python serving framework.
InfrastructureAFreshness: A★ 8.9Kinference - 0.699score
TensorRT-LLM
NVIDIA
Open-source library that optimizes LLM and visual generation inference with specialized kernels and a Python framework.
InfrastructureAFreshness: A★ 14.9Kinference - 0.677score
RunPod
RunPod
Cloud GPU platform for AI with pods, pay-per-second serverless endpoints and clusters across 31 regions.
InfrastructureAFreshness: A★ 317inference - 0.674score
NVIDIA Dynamo
NVIDIA
Open-source, datacenter-scale orchestration layer that coordinates multi-node inference across engines such as SGLang, TensorRT-LLM and vLLM.
InfrastructureAFreshness: A★ 8.4Kinference - 0.591score
Hugging Face Inference Providers
Hugging Face
Access to hundreds of open models from partner inference providers through one Hugging Face token and SDK.
InfrastructureAFreshness: Ainference - 0.594score
Vast.ai
Vast.ai
GPU cloud marketplace for renting and hosting GPU compute.
InfrastructureAFreshness: Ainference - 0.590score
LM Studio
Element Labs
Desktop app for running open LLMs locally, with a built-in agent called Bionic.
InfrastructureAFreshness: Ainference