NVIDIA H100 PCIe

NVIDIA · Hopper

Shipping traininginferencepcie
Memory
80GB HBM3
FP8 TFLOPS
3026
Power
350W
Released
Apr 1, 2023

Technical Specifications

ManufacturerNVIDIA
ArchitectureHopper
Memory80GB HBM3
Memory Bandwidth2.0 TB/s
FP16 TFLOPS1513
FP8 TFLOPS3026
InterconnectPCIe Gen5 (128GB/s)
Power (TDP)350W
ReleasedApr 1, 2023
StatusShipping

Availability

Available — lower-power variant for inference and smaller training clusters