NVIDIA L4

NVIDIA · Ada Lovelace

Shipping (widely available) inferenceavailablelow-poweredge
Memory
24GB GDDR6
FP8 TFLOPS
242
Power
72W
Released
Jan 1, 2023

Technical Specifications

ManufacturerNVIDIA
ArchitectureAda Lovelace
Memory24GB GDDR6
Memory Bandwidth0.300 TB/s
FP16 TFLOPS121
FP8 TFLOPS242
InterconnectPCIe Gen4
Power (TDP)72W
ReleasedJan 1, 2023
StatusShipping (widely available)

Availability

Widely available — low-power inference GPU for edge and cloud