AI infrastructure Product
Azure previews Guest RDMA on supported Boost virtual machines
Microsoft opened public preview of Guest RDMA for Azure Boost, bringing a direct memory-access networking path to selected general-purpose Azure virtual machines. [1]
- Release status
- Public preview on explicitly supported Azure Boost VM families. [1]
What it does
Applications use RDMA operations while Azure Boost handles transport processing outside the guest networking stack. Microsoft describes uses including AI checkpoint transfers and moving inference key-value caches between GPU hosts and memory-rich virtual machines. [1]
Why it matters
Eligible workloads gain another networking option for moving data with less guest CPU involvement, including infrastructure supporting distributed AI systems. [1]
Who it’s for
Azure infrastructure teams running data-intensive AI, storage and computing workloads. [1]
Key dates
- Azure opens Guest RDMA public preview [1]
Where it fits
Teams must check the supported VM list and configure compatible Linux software, accelerated networking and Guest RDMA enablement. [1]
Limits and trade-offs
This is a public preview, restricted to listed Intel and AMD VM families. Regional availability does not mean all Azure VM sizes qualify. Workload-specific performance must be evaluated separately. [1]
Sources and verification
Catalog evidence checked How we verify records
- Primary source Announcing Public Preview of Guest RDMA for Azure Boost
Related profiles
AI infrastructure
AMD ROCm
AMD
Release notes list PyTorch 2.15, JAX 0.11.2, vLLM 0.32 and SGLang 0.5.21 support, plus runtime and mathematical-library changes. The accompanying announcement emphasizes stability and development workflows.
AI infrastructure
Amazon SageMaker AI cross-Region inference routing
Amazon Web Services
The routing resource can coordinate endpoints across AWS Regions and accounts, prefer local capacity and redirect requests when eligible destinations encounter defined service problems.
AI infrastructure
Azure Cobalt 200 virtual machines
Microsoft Azure
The Arm-based CPU platform supports databases, applications and tool execution around AI models.