AI infrastructure Product
SGLang serves language and vision-language models
SGLang is a serving framework for running large language models and vision-language models. [1]
Sources and verification
Catalog evidence checked How we verify records
- Primary source sglang
- Other source Fast and Expressive LLM Inference with RadixAttention and SGLang - LMSYS Org
- Primary source sglang 0.1.3, Python Package Index
- Primary source sglang 0.5.23, Python Package Index
Related profiles
AI infrastructure
Azure Cobalt 200 virtual machines
Microsoft Azure
The Arm-based CPU platform supports databases, applications and tool execution around AI models.
AI infrastructure
Sarvam Token Factory
Sarvam AI
It exposes hosted model inference through supported developer interfaces.
AI infrastructure
NVIDIA Rubin HPC
NVIDIA
It is designed to accelerate high-performance computing workloads in compatible systems.