Skip to main content
Rase AI Intelligence Newsletter

AI infrastructure Product

Azure previews Guest RDMA on supported Boost virtual machines

Microsoft opened public preview of Guest RDMA for Azure Boost, bringing a direct memory-access networking path to selected general-purpose Azure virtual machines. [1]

Release status
Public preview on explicitly supported Azure Boost VM families. [1]

What it does

Applications use RDMA operations while Azure Boost handles transport processing outside the guest networking stack. Microsoft describes uses including AI checkpoint transfers and moving inference key-value caches between GPU hosts and memory-rich virtual machines. [1]

Why it matters

Eligible workloads gain another networking option for moving data with less guest CPU involvement, including infrastructure supporting distributed AI systems. [1]

Who it’s for

Azure infrastructure teams running data-intensive AI, storage and computing workloads. [1]

Key dates

  1. Azure opens Guest RDMA public preview [1]

Where it fits

Teams must check the supported VM list and configure compatible Linux software, accelerated networking and Guest RDMA enablement. [1]

Limits and trade-offs

This is a public preview, restricted to listed Intel and AMD VM families. Regional availability does not mean all Azure VM sizes qualify. Workload-specific performance must be evaluated separately. [1]

Sources and verification

Catalog evidence checked How we verify records

  1. Primary source Announcing Public Preview of Guest RDMA for Azure Boost

Related profiles

AI infrastructure

AMD ROCm

AMD

Release notes list PyTorch 2.15, JAX 0.11.2, vLLM 0.32 and SGLang 0.5.21 support, plus runtime and mathematical-library changes. The accompanying announcement emphasizes stability and development workflows.

High confidenceEvidence checked

AI infrastructure

Amazon SageMaker AI cross-Region inference routing

Amazon Web Services

The routing resource can coordinate endpoints across AWS Regions and accounts, prefer local capacity and redirect requests when eligible destinations encounter defined service problems.

High confidenceEvidence checked

AI infrastructure

Azure Cobalt 200 virtual machines

Microsoft Azure

The Arm-based CPU platform supports databases, applications and tool execution around AI models.

High confidenceEvidence checked