SGLang

Open-source inference framework for LLMs and multimodal models, built for agentic workloads and large-scale serving.

Infrastructure by SGLang project (LMSYS)

IndexedApache-2.0★ 37,723

Install

Pick your client. Read the repository before you give any tool access to your data.

pip install sglang

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

SGLang is a high-performance serving framework for large language and multimodal models. It targets low-latency, high-throughput inference with RadixAttention, prefix caching and multi-GPU parallelism. It is compatible with Hugging Face and OpenAI APIs and runs on NVIDIA, AMD, Intel, Google TPU and Ascend NPU hardware.

Use cases: model-inference

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Category: Inference · open source server
Self-host: Yesraw.githubusercontent.com
Open source: Yesraw.githubusercontent.com
Protocols: openai-compatibledocs.sglang.io

Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.

Signals

Stars: 37,723
Forks: 9,861
Open issues: 971
Last commit: Oct 24, 2026 (3 days ago)
Last release: Oct 19, 2026 (9 days ago)

From GitHub (fetched Oct 24, 2026).

Details

Packages: pypi sglang
License: Apache-2.0
Repository: github.com/sgl-project/sglang
Website: github.com/sgl-project/sglang
Docs: docs.sglang.io
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: README Docs github-graphql

Cite this page

SGLang. Agent Mart. https://agentmart.dev/infrastructure/sglang (last updated 2026-10-24)