Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 54 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1594 365.55 116.39 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1521 310.95 111.01 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.195 471.82 142.37 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 24 16 1.2252 0.3797 894.39 277.21 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 17 0.9829 0.3334 717.55 243.38 467.12 436 329.35 286.66
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 6 2.095 0.7445 1529.35 543.49 963.49 899.26 660.68 575.04
p2.xlarge 4 2.7 61 1 NVIDIA K80 12 11 1.2785 0.3584 933.27 261.61 N/A N/A N/A N/A
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2089 483.93 152.47 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2268 444.55 165.57 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 87 1.1511 0.2801 840.31 204.44 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 24 16 1.4761 0.4636 1077.54 338.45 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 17 1.194 0.4108 871.61 299.87 567.42 529.58 400.07 348.21
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.124 2666.39 820.53 1838.38 1716 1073.65 934.53
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 6 2.524 0.8828 1842.52 644.44 1160.79 1083.42 795.97 692.79
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2888 720.67 210.82 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.362 712.21 264.3 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4562 1121.62 333.06 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 24 17 1.9927 0.579 1454.7 422.64 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 17 1.6161 0.5312 1179.74 387.79 768.01 716.81 541.5 471.31
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 6 3.382 1.038 2468.85 757.76 1555.38 1451.67 1066.54 928.29
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.5458 1376.18 398.44 895.9 836.18 631.67 549.79
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4719 1194.14 344.5 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.7214 1424.41 526.59 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7822 1951.87 570.99 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 24 17 3.0038 0.8458 2192.8 617.43 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 17 2.4603 0.7557 1796.01 551.64 1169.2 1091.26 824.37 717.5
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.8026 10665.54 3505.92 7354.32 6864.03 4294.96 3738.13
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 6 5.098 1.4914 3721.52 1088.73 2344.56 2188.25 1607.7 1399.29
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.861 2187.3 628.53 1423.93 1329.01 1003.97 873.82
p2.8xlarge 32 2.7 488 8 NVIDIA K80 96 11 10.2276 8.8872 7466.17 6487.68 N/A N/A N/A N/A
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.6281 3508.99 1188.52 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 96 16 6.9079 2.2384 5042.74 1634.04 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 357 17 5.6202 1.6711 4102.71 1219.94 2670.87 2492.8 1883.15 1639.04
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 715 6 11.812 3.7381 8622.74 2728.81 5432.33 5070.15 3725.02 3242.16
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.8335 2388.29 608.48 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.7511 2388.29 548.28 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.3438 2848.82 980.99 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.3653 3903.74 996.66 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 24 16 4.9885 1.4489 3641.59 1057.72 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 17 4.1487 1.2056 3028.53 880.06 1971.58 1840.14 1390.1 1209.9
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 11.3515 21331.09 8286.59 14708.65 13728.03 8589.67 7476.25
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 6 8.5299 2.5505 6226.85 1861.85 3922.92 3661.38 2690 2341.3
p2.16xlarge 64 2.3 732 16 NVIDIA K80 192 11 20.4553 18.0013 14932.35 13140.97 N/A N/A N/A N/A
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.5427 7010.22 2586.18 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 96 16 9.9185 3.7355 7240.5 2726.95 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 357 17 8.1527 2.2671 5951.5 1654.96 3874.43 3616.12 2731.74 2377.63
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 3.7454 9569.6 2734.11 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 715 6 16.9599 4.702 12380.74 3432.44 7799.87 7279.88 5348.48 4655.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 13.5516 26015.5 9892.63 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 12 40.3835 18.0331 29479.96 13164.14 17970.71 16772.65 11421.87 9941.26
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 192 16 19.837 5.8022 14481 4235.58 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 1430 17 16.3055 4.3193 11903.01 3153.07 7748.86 7232.27 5463.48 4755.25
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 2861 6 33.9198 9.8742 24761.48 7208.2 15599.73 14559.75 10696.96 9310.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 13 116.4941 30.9361 85040.67 22583.37 N/A N/A 37813.42 32911.68