Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 54 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.144 365.55 105.12 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1457 310.95 106.35 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.188 471.82 137.22 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 24 16 1.2252 0.3895 894.39 284.3 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 17 0.9829 0.3049 717.55 222.56 467.12 436 329.35 286.66
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 6 2.095 0.5311 1529.35 387.74 963.49 899.26 660.68 575.04
p2.xlarge 4 2.7 61 1 NVIDIA K80 12 11 1.2785 0.3132 933.27 228.65 656.34 612.43 487.31 424.15
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.201 483.93 146.75 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2194 444.55 160.13 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 87 1.1511 0.2646 840.31 193.14 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 24 16 1.4761 0.4554 1077.54 332.46 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 17 1.194 0.3589 871.61 261.99 567.42 529.58 400.07 348.21
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.0073 2666.39 735.3 1838.38 1716 1073.65 934.53
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 6 2.524 0.6368 1842.52 464.83 1160.79 1083.42 795.97 692.79
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2858 720.67 208.62 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.365 712.21 266.48 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4293 1121.62 313.4 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 24 17 1.9927 0.5492 1454.7 400.91 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 17 1.6161 0.4539 1179.74 331.35 768.01 716.81 541.5 471.31
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 6 3.382 0.8794 2468.85 641.93 1555.38 1451.67 1066.54 928.29
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.4862 1376.18 354.95 895.9 836.18 631.67 549.79
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4155 1194.14 303.35 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.7238 1424.41 528.4 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7296 1951.87 532.61 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 24 17 3.0038 0.8068 2192.8 588.97 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 17 2.4603 0.6691 1796.01 488.42 1169.2 1091.26 824.37 717.5
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.3384 10665.54 3167.03 7354.32 6864.03 4294.96 3738.13
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 6 5.098 1.2047 3721.52 879.42 2344.56 2188.25 1607.7 1399.29
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.7981 2187.3 582.6 1423.93 1329.01 1003.97 873.82
p2.8xlarge 32 2.7 488 8 NVIDIA K80 96 11 10.2276 6.5385 7466.17 4773.13 5251.29 4899.38 3898 3393.22
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.564 3508.99 1141.7 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 96 16 6.9079 2.407 5042.74 1757.11 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 357 17 5.6202 1.5016 4102.71 1096.17 2670.87 2492.8 1883.15 1639.04
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 715 6 11.812 2.7482 8622.74 2006.17 5432.33 5070.15 3725.02 3242.16
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.689 2388.29 502.98 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.5785 2388.29 422.28 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.2269 2848.82 895.66 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.3133 3903.74 958.68 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 24 16 4.9885 1.3092 3641.59 955.7 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 17 4.1487 1.0273 3028.53 749.9 1971.58 1840.14 1390.1 1209.9
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 12.0151 21331.09 8771.06 14708.65 13728.03 8589.67 7476.25
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 6 8.5299 1.8856 6226.85 1376.45 3922.92 3661.38 2690 2341.3
p2.16xlarge 64 2.3 732 16 NVIDIA K80 192 11 20.4553 11.9172 14932.35 8699.58 10502.71 9798.77 7796.27 6786.45
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.4808 7010.22 2541.02 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 96 16 9.9185 2.9987 7240.5 2189.02 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 357 17 8.1527 2.0299 5951.5 1481.83 3874.43 3616.12 2731.74 2377.63
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 2.3925 9569.6 1746.49 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 715 6 16.9599 3.9464 12380.74 2880.9 7799.87 7279.88 5348.48 4655.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 14.2014 26015.5 10367.06 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 12 40.3835 20.8281 29479.96 15204.53 17970.71 16772.65 11421.87 9941.26
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 192 16 19.837 5.8073 14481 4239.32 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 1430 17 16.3055 3.5562 11903.01 2596.04 7748.86 7232.27 5463.48 4755.25
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 2861 6 33.9198 7.1807 24761.48 5241.92 15599.73 14559.75 10696.96 9310.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 13 116.4941 17.2752 85040.67 12610.89 N/A N/A 37813.42 32911.68