Search
“API development”
Showing 1–5 of 5 for “API development”
- 0.883score
vLLM
vLLM project
Fast, easy-to-use open-source library for LLM inference and serving, with an OpenAI-compatible server.
InfrastructureAFreshness: A★ 95.3Kinference - 0.590score
LM Studio
Element Labs
Desktop app for running open LLMs locally, with a built-in agent called Bionic.
InfrastructureAFreshness: Ainference - 0.594score
SambaNova Cloud
SambaNova Systems
Inference cloud for large open models on SambaNova dataflow hardware, with per-token pricing.
InfrastructureAFreshness: Ainference - 0.591score
Hugging Face Inference Providers
Hugging Face
Access to hundreds of open models from partner inference providers through one Hugging Face token and SDK.
InfrastructureAFreshness: Ainference - 0.592score
Cerebras Inference
Cerebras Systems
Fast AI inference cloud on wafer-scale hardware, with an OpenAI-compatible API and a free trial.
InfrastructureAFreshness: Ainference