NVIDIA L40
NVIDIA · Ada Lovelace
Shipping
inferenceavailablemid-range
Memory
48GB GDDR6
FP8 TFLOPS
362
Power
300W
Released
Oct 1, 2022
Technical Specifications
| Manufacturer | NVIDIA |
|---|---|
| Architecture | Ada Lovelace |
| Memory | 48GB GDDR6 |
| Memory Bandwidth | 0.864 TB/s |
| FP16 TFLOPS | 181 |
| FP8 TFLOPS | 362 |
| Interconnect | PCIe Gen4 |
| Power (TDP) | 300W |
| Released | Oct 1, 2022 |
| Status | Shipping |
Availability
Available — graphics and inference workloads, lower FP8 than L40S
Pricing
Retail (estimated)
6000-9000
Cloud Pricing ($/hr)
| runpod | $0.65/hr |
|---|
Key Specs
Memory: 48GB GDDR6
Bandwidth: 0.864 TB/s
FP8: 362 TFLOPS
Power: 300W