NVIDIA L40S
NVIDIA · Ada Lovelace
Shipping (widely available)
inferenceavailablemid-range
Memory
48GB GDDR6
FP8 TFLOPS
733
Power
350W
Released
Aug 1, 2023
Technical Specifications
| Manufacturer | NVIDIA |
|---|---|
| Architecture | Ada Lovelace |
| Memory | 48GB GDDR6 |
| Memory Bandwidth | 0.864 TB/s |
| FP16 TFLOPS | 362 |
| FP8 TFLOPS | 733 |
| Interconnect | PCIe Gen4 |
| Power (TDP) | 350W |
| Released | Aug 1, 2023 |
| Status | Shipping (widely available) |
Availability
Widely available — primary choice for inference workloads
Pricing
Retail (estimated)
8000-12000
Cloud Pricing ($/hr)
| coreweave | $0.8/hr |
|---|---|
| runpod | $0.79/hr |
Key Specs
Memory: 48GB GDDR6
Bandwidth: 0.864 TB/s
FP8: 733 TFLOPS
Power: 350W