Search
“performance”
Showing 1–4 of 4 for “performance”
- 0.848score
SGLang
SGLang project (LMSYS)
Open-source inference framework for LLMs and multimodal models, built for agentic workloads and large-scale serving.
InfrastructureAFreshness: A★ 37.7Kinference - 0.805score
Apache APISIX AI Gateway
Apache Software Foundation
Open-source API gateway with AI plugins for multi-provider LLM proxying, token limits and observability.
InfrastructureAFreshness: A★ 17.2Kgateway - 0.778score
Bifrost
Maxim AI
Open-source AI gateway with one OpenAI-compatible API for 23+ providers, with fallbacks and semantic caching.
InfrastructureAFreshness: A★ 9.1Kgateway - 0.761score
Vespa
Vespa.ai
Open-source platform for search, ranking and ML inference over vectors, tensors, text and structured data.
InfrastructureAFreshness: A★ 7.1Kvector db