Skip to main content
Rase AI Intelligence Newsletter

AI infrastructure Product

Google announced separate TPU designs for confidential inference and longer contexts

Google’s TPU 8tx and TPU 8i Max are two accelerators announced for distinct inference needs. [1]

What it does

The 8tx adds hardware support for confidential computing. The 8i Max is designed for inference workloads that need to keep much longer contexts in memory. [1]

Why it matters

The two designs give infrastructure teams separate hardware paths for workloads driven by data security requirements and those driven by context size. [1]

Key dates

  1. Google introduces TPU 8tx and TPU 8i Max [1]

Sources and verification

Catalog evidence checked How we verify records

  1. Primary source Introducing TPU 8tx and TPU 8i Max

Related profiles

AI infrastructure

Azure Cobalt 200 virtual machines

Microsoft Azure

The Arm-based CPU platform supports databases, applications and tool execution around AI models.

High confidenceEvidence checked

AI infrastructure

Sarvam Token Factory

Sarvam AI

It exposes hosted model inference through supported developer interfaces.

High confidenceEvidence checked

AI infrastructure

NVIDIA Rubin HPC

NVIDIA

It is designed to accelerate high-performance computing workloads in compatible systems.

High confidenceEvidence checked