Google TPU v4

Google · TPU v4

Operational (GCP only) traininginferencetpugooglealternativelegacy
Memory
32GB HBM3
FP8 TFLOPS
N/A
Power
TBDW
Released
Jun 1, 2021

Technical Specifications

ManufacturerGoogle
ArchitectureTPU v4
Memory32GB HBM3
Memory Bandwidth1.2 TB/s
FP16 TFLOPS275
FP8 TFLOPSN/A
InterconnectICI (3D Torus, 4K pod)
Power (TDP)TBDW
ReleasedJun 1, 2021
StatusOperational (GCP only)

Availability

GCP only — prior-gen, still widely deployed for training and inference