Consumer GPUs
| Model | VRAM | Half Precision (TFLOPS) | Single Precision (TFLOPS) | CUDA Cores | Tensor Cores | Architecture | Memory Type |
|---|
| RTX 5090 | 32GB | 209.6 | 104.8 | 21760 | 680 (3352 AI TOPS) | Blackwell 2.0 | GDDR7 |
| RTX 5090D | 32GB | 209.6 | 104.8 | 21760 | 680 (2375 AI TOPS) | Blackwell 2.0 | GDDR7 |
| RTX 5080 | 16GB | 112.56 | 56.28 | 10752 | 336 (1801 AI TOPS) | Blackwell 2.0 | GDDR7 |
| RTX 5070 Ti | 16GB | 88.7 | 44.35 | 8960 | 280 (1406 AI TOPS) | Blackwell 2.0 | GDDR7 |
| RTX 5070 | 12GB | 61.68 | 30.84 | 6144 | 192 (988 AI TOPS) | Blackwell 2.0 | GDDR7 |
| RTX 4090 | 24GB | 165.16 | 82.58 | 16384 | 512 (1321 AI TOPS) | Ada Lovelace | GDDR6X |
| RTX 4090D | 24GB | 147.08 | 73.54 | 14592 | 456 (1177 AI TOPS) | Ada Lovelace | GDDR6X |
| RTX 4080 | 16GB | 97.48 | 48.74 | 9728 | 304 (780 AI TOPS) | Ada Lovelace | GDDR6X |
| RTX 4070 Ti | 12GB | 80.18 | 40.09 | 7680 | 240 (641 AI TOPS) | Ada Lovelace | GDDR6X |
| RTX 4070 | 12GB | 58.30 | 29.15 | 5888 | 184 (466 AI TOPS) | Ada Lovelace | GDDR6X |
| RTX 4060 Ti | 16GB | 44.12 | 22.06 | 4352 | 136 (353 AI TOPS) | Ada Lovelace | GDDR6 |
| RTX 4060 Ti | 8GB | 44.12 | 22.06 | 4352 | 136 (353 AI TOPS) | Ada Lovelace | GDDR6 |
| RTX 4060 | 8GB | 30.22 | 15.11 | 3072 | 96 (242 AI TOPS) | Ada Lovelace | GDDR6 |
| RTX 3090Ti | 24GB | 80.00 | 40.00 | 10752 | 336 (320 AI TOPS) | Ampere | GDDR6X |
| RTX 3090 | 24GB | 71.16 | 35.58 | 10496 | 328 (285 AI TOPS) | Ampere | GDDR6X |
| RTX 3080Ti | 12GB | 68.20 | 34.10 | 10240 | 320 | Ampere | GDDR6X |
| RTX 3080 | 12GB | 61.28 | 30.64 | 8960 | 280 | Ampere | GDDR6X |
| RTX 3080 | 10GB | 59.54 | 29.77 | 8704 | 272 | Ampere | GDDR6X |
| RTX 3070 Ti | 8GB | 43.50 | 21.75 | 6144 | 192 | Ampere | GDDR6X |
| RTX 3070 | 8GB | 40.62 | 20.31 | 5888 | 184 | Ampere | GDDR6 |
| RTX 3060 Ti | 8GB | 33.40 | 16.20 | 4864 | 152 | Ampere | GDDR6X |
| RTX 3060 Ti | 8GB | 33.40 | 16.20 | 4864 | 152 | Ampere | GDDR6 |
| RTX 3060 | 12GB | 25.48 | 12.74 | 3584 | 112 | Ampere | GDDR6 |
| RTX 3060 | 8GB | 25.48 | 12.74 | 3584 | 112 | Ampere | GDDR6 |
| RTX 2080 Ti | 11GB | 26.90 | 13.45 | 4352 | 544 | Turing | GDDR6 |
| GTX 1080 Ti | 11GB | 22.68 | 11.34 | 3584 | None | Pascal | GDDR5X |
Professional GPUs
| Model | VRAM | Half Precision (TFLOPS) | Single Precision (TFLOPS) | Double Precision (TFLOPS) | CUDA Cores | Tensor Cores | Architecture | Memory Type |
|---|
| NVIDIA RTX A6000 | 48GB | 77.42 | 38.71 | 1.209 | 10752 | 336 | Ampere | GDDR6 |
| NVIDIA RTX A5000 | 24GB | 55.54 | 27.77 | 0.867 | 10752 | 256 | Ampere | GDDR6 |
| NVIDIA RTX A4000 | 16GB | 38.34 | 19.17 | 0.599 | 6144 | 192 | Ampere | GDDR6 |
| Quadro RTX 8000 | 48GB | 32.62 | 16.31 | 0.509 | 4608 | 576 | Turing | GDDR6 |
| Quadro RTX 6000 | 24GB | 32.62 | 16.31 | 0.509 | 4608 | 576 | Turing | GDDR6 |
| Quadro RTX 5000 | 16GB | 22.30 | 11.15 | 0.348 | 3072 | 384 | Turing | GDDR6 |
Cloud and Data Center GPUs
Tesla NVIDIA A Series GPUs
| Model | VRAM | Half Precision (TFLOPS) | Single Precision (TFLOPS) | Double Precision (TFLOPS) | CUDA Cores | Tensor Cores | Architecture | Memory Type |
|---|
| NVIDIA A100 SXM4 | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A100 SXM4 | 40GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A100 PCIe | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A100 PCIe | 40GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A800 PCIe | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A800 SXM4 | 80GB | 38.98 | 19.49 | 9.746 | 6912 | 432 | Ampere | HBM2e |
| NVIDIA A40 PCIe | 48GB | 74.84 | 37.42 | 1.169 | 10752 | 336 | Ampere | GDDR6 |
| NVIDIA A30 PCIe | 24GB | 20.64 | 10.32 | 0.322 | 3584 | 224 | Ampere | HBM2e |
| NVIDIA A10 PCIe | 24GB | 62.48 | 31.24 | 0.976 | 9216 | 288 | Ampere | GDDR6 |
Tesla NVIDIA V Series GPUs
| Model | VRAM | Half Precision (TFLOPS) | Single Precision (TFLOPS) | Double Precision (TFLOPS) | CUDA Cores | Tensor Cores | Architecture | Memory Type |
|---|
| Tesla V100 PCIe | 16GB | 28.26 | 14.13 | 7.066 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 PCIe | 32GB | 28.26 | 14.13 | 7.066 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 SXM2 | 16GB | 32.71 | 16.35 | 8.177 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 SXM2 | 32GB | 31.33 | 15.67 | 7.834 | 5120 | 640 | Volta | HBM2 |
| Tesla V100 SXM3 | 32GB | 32.71 | 16.35 | 8.177 | 5120 | 640 | Volta | HBM2 |
| Tesla V100S PCIe | 32GB | 32.71 | 16.35 | 8.177 | 5120 | 640 | Volta | HBM2 |
Tesla NVIDIA T Series GPUs
| Model | VRAM | Half Precision | Single Precision (TFLOPS) | Double Precision | CUDA Cores | Tensor Cores | Architecture | Memory Type |
|---|
| NVIDIA Tesla T4 | 16GB | 65.13 TFLOPS (8:1) | 8.141 | 254.4 GFLOPS (1:32) | 2560 | 320 | Turing | GDDR6 |
Tesla NVIDIA P Series GPUs
| Model | VRAM | Half Precision | Single Precision (TFLOPS) | Double Precision | CUDA Cores | Tensor Cores | Architecture | Memory Type |
|---|
| NVIDIA Tesla P4 | 8GB | 89.12 GFLOPS (1:64) | 5.704 | 178.2 GFLOPS (1:32) | 2560 | - | Pascal | GDDR5 |
| NVIDIA Tesla P40 | 24GB | 183.7 GFLOPS (1:64) | 11.76 | 367.4 GFLOPS (1:32) | 3840 | - | Pascal | GDDR5 |
Tesla NVIDIA L Series GPUs
| Model | VRAM | Half Precision (TFLOPS) | Single Precision (TFLOPS) | Double Precision | CUDA Cores | Tensor Cores | Architecture | Memory Type |
|---|
| NVIDIA L40 | 48GB | 90.52 | 90.52 | 1414 GFLOPS (1:64) | 18176 | 568 | Ada Lovelace | GDDR6 |
| NVIDIA L40S | 48GB | 91.61 | 91.61 | 1431 GFLOPS (1:64) | 18176 | 568 | Ada Lovelace | GDDR6 |