2017-2018 Architecture
β’ 2nd Gen Tensor Cores
β’ FP32 & FP16 Precision
β’ Limited Multi-GPU Scaling
β’ Lower Memory Bandwidth
β’ FP32 & FP16 Precision
β’ Limited Multi-GPU Scaling
β’ Lower Memory Bandwidth
20x
2x
400GB/s
80GB
| GPU Model | CPU | Memory | Disk | Bandwidth | Price | |
|---|---|---|---|---|---|---|
RTX 2060ξ
| 40-Core Dual Gold 6148 | 128GB RAM | 120GB SSD + 960GB SSD | 100Mbps Unmeteredξ
| $119.50/mo | Order Now |
A100(80GB)ξ
| 36-Core Dual E5-2697v4 | 256GB RAM | 240GB SSD+2TB NVMe+8TB SATA | 100Mbps Unmeteredξ
| $764.55/mo | Order Now |
4 x RTX A6000ξ
| 44-core Dual E5-2699v4 | 512GB RAM | 240GB SSD+4TB NVMe+16TB SATA | 1000Mbps Unmeteredξ
| $1599.00/mo | Order Now |
4 x A100ξ
| 44-core Dual E5-2699v4 | 512GB RAM | 240GB SSD+4TB NVMe+16TB SATA | 1000Mbps Unmeteredξ
| $1124.55/mo | Order Now |
A100ξ
| 36-Core Dual E5-2697v4 | 256GB RAM | 240GB SSD+2TB NVMe+8TB SATA | 100Mbps Unmeteredξ
| $359.55/mo | Order Now |
3 x RTX A6000ξ
| 36-Core Dual E5-2697v4 | 256GB RAM | 240GB SSD+2TB NVMe+8TB SATA | 1000Mbps Unmeteredξ
| $1199.00/mo | Order Now |
3 x RTX A5000ξ
| 36-Core Dual E5-2697v4 | 256GB RAM | 240GB SSD+2TB NVMe+8TB SATA | 1000Mbps Unmeteredξ
| $699.00/mo | Order Now |
RTX A6000ξ
| 36-Core Dual E5-2697v4 | 256GB RAM | 240GB SSD+2TB NVMe+8TB SATA | 100Mbps Unmeteredξ
| $274.50/mo | Order Now |
A40ξ
| 36-Core Dual E5-2697v4 | 256GB RAM | 240GB SSD+2TB NVMe+8TB SATA | 100Mbps Unmeteredξ
| $409.00/mo | Order Now |
RTX A5000ξ
| 24-Core Dual E5-2697v2 | 128GB RAM | 240GB SSD+2TB SSD | 100Mbps Unmeteredξ
| $349.00/mo | Order Now |
RTX A4000ξ
| 24-Core Dual E5-2697v2 | 128GB RAM | 240GB SSD+2TB SSD | 100Mbps Unmeteredξ
| $279.00/mo | Order Now |
RTX 3060 Tiξ
| 24-Core Dual E5-2697v2 | 128GB RAM | 240GB SSD+2TB SSD | 100Mbps Unmeteredξ
| $107.55/mo | Order Now |
RTX 2060ξ
| 16-Core Dual E5-2660 | 128GB RAM | 120GB SSD + 960GB SSD | 100Mbps Unmeteredξ
| $199.00/mo | Order Now |

| GPU | Target Workload | Memory | CUDA Cores | Tensor Cores | RT Cores | Memory Bandwidth | NVLink Support | FP16 Performance | FP32 Performance | FP64 Performance |
|---|---|---|---|---|---|---|---|---|---|---|
| RTX 2060 | Entry-Level AI, Video Encoding | 6 GB GDDR6 | 1,920 | 120, 2nd Gen | 30 | 336 GB/s | No | 6.5 TFLOPS | 6.5 TFLOPS | 162 GFLOPS |
| RTX 3060 Ti | Prototyping AI Models, Gaming, Streaming | 8 GB GDDR6 | 4,864 | 152, 2nd Gen | 38 | 448 GB/s | No | 16.2 TFLOPS | 16.2 TFLOPS | 405 GFLOPS |
| A4000 | Professional ML & Medium Models, CAD Rendering | 16 GB GDDR6 ECC | 6,144 | 192, 3rd Gen | 48 | 448 GB/s | No | 19.2 TFLOPS | 19.2 TFLOPS | 480 GFLOPS |
| A5000 | Large Model Fine-Tuning, Medium-Large AI Workloads | 24 GB GDDR6 ECC | 8,192 | 256, 3rd Gen | 64 | 768 GB/s | No | 40.0 TFLOPS | 40.0 TFLOPS | 1.0 TFLOPS |
| A6000 | Enterprise AI, Large Models, High-End Rendering | 48 GB GDDR6 ECC | 10,752 | 336, 3rd Gen | 84 | 768 GB/s | Yes | 66.9 TFLOPS | 66.9 TFLOPS | 1.05 TFLOPS |
| A40 | Scientific Computing, HPC, Multi-GPU Large Models | 48 GB GDDR6 ECC | 10,752 | 336, 3rd Gen | 84 | 696 GB/s | No | 65.0 TFLOPS | 65.0 TFLOPS | 1.0 TFLOPS |
| A100 40GB | Flagship AI Training, Extra-Large Models | 40 GB HBM2e | 6,912 | 432, 3rd Gen | 0 | 1,555 GB/s | Yes | 312 TFLOPS | 19.5 TFLOPS (FP32) | 9.7 TFLOPS |
| A100 80GB | Flagship AI Training, Huge Models | 80 GB HBM2e | 6,912 | 432, 3rd Gen | 0 | 2,039 GB/s | Yes | 312 TFLOPS | 19.5 TFLOPS (FP32) | 9.7 TFLOPS |