Search
“performance”
Showing 1–8 of 8 for “performance”
- 0.848score
SGLang
SGLang project (LMSYS)
Open-source inference framework for LLMs and multimodal models, built for agentic workloads and large-scale serving.
InfrastructureAFreshness: A★ 37.7Kinference - 0.575score
Milvus
LF AI & Data Foundation
Open-source, high-performance vector database for large-scale search, with a managed option on Zilliz Cloud.
InfrastructureAFreshness: Avector db - 0.805score
Apache APISIX AI Gateway
Apache Software Foundation
Open-source API gateway with AI plugins for multi-provider LLM proxying, token limits and observability.
InfrastructureAFreshness: A★ 17.2Kgateway - 0.778score
Bifrost
Maxim AI
Open-source AI gateway with one OpenAI-compatible API for 23+ providers, with fallbacks and semantic caching.
InfrastructureAFreshness: A★ 9.1Kgateway - 0.761score
Vespa
Vespa.ai
Open-source platform for search, ranking and ML inference over vectors, tensors, text and structured data.
InfrastructureAFreshness: A★ 7.1Kvector db - 0.674score
NVIDIA Dynamo
NVIDIA
Open-source, datacenter-scale orchestration layer that coordinates multi-node inference across engines such as SGLang, TensorRT-LLM and vLLM.
InfrastructureAFreshness: A★ 8.4Kinference - 0.592score
Zyte API
Zyte
Web scraping API with automatic ban handling, browser rendering, sessions and extraction, plus a Python client.
InfrastructureAFreshness: Ascraping - 0.587score
ElevenLabs Agents
ElevenLabs
Build, test and deploy voice, chat and email AI agents for websites, apps and call centers, in 90+ languages.
InfrastructureAFreshness: Avoice