AMD Instinct MI300X
AMD · CDNA 3
Shipping
traininginferenceamdalternative
Memory
192GB HBM3
FP8 TFLOPS
2614
Power
750W
Released
Dec 1, 2023
Technical Specifications
| Manufacturer | AMD |
|---|---|
| Architecture | CDNA 3 |
| Memory | 192GB HBM3 |
| Memory Bandwidth | 5.3 TB/s |
| FP16 TFLOPS | 1307 |
| FP8 TFLOPS | 2614 |
| Interconnect | Infinity Fabric (896GB/s) |
| Power (TDP) | 750W |
| Released | Dec 1, 2023 |
| Status | Shipping |
Availability
Available — gaining adoption; Meta, Microsoft, Oracle deploying
Pricing
Retail (estimated)
15000-20000
Cloud Pricing ($/hr)
| coreweave | $1.99/hr |
|---|
Key Specs
Memory: 192GB HBM3
Bandwidth: 5.3 TB/s
FP8: 2614 TFLOPS
Power: 750W