AI infrastructure Product
vLLM serves language models with efficient memory management
vLLM is an inference engine for serving language models to multiple requests. [1]
Sources and verification
Catalog evidence checked How we verify records
- Primary source vllm
- Primary source vllm 0.0.1, Python Package Index
- Primary source vllm 0.34.0, Python Package Index
Related profiles
AI infrastructure
Sarvam Token Factory
Sarvam AI
It exposes hosted model inference through supported developer interfaces.
AI infrastructure
NVIDIA Rubin HPC
NVIDIA
It is designed to accelerate high-performance computing workloads in compatible systems.
AI infrastructure
Intel Crescent Island (D270) GPU
Intel
It is a data-center GPU design for workloads described in Intel's reported technical presentations.