Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 54 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1405 365.55 102.6 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.15 310.95 109.52 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.1935 471.82 141.22 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 24 16 1.2252 0.3936 894.39 287.32 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 17 0.9829 0.3404 717.55 248.51 467.12 436 329.35 286.66
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 6 2.095 0.7593 1529.35 554.29 963.49 899.26 660.68 575.04
p2.xlarge 4 2.7 61 1 NVIDIA K80 12 11 1.2785 0.2945 933.27 215.02 N/A N/A N/A N/A
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2022 483.93 147.64 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.225 444.55 164.26 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 88 1.1494 0.2698 839.1 196.93 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 24 16 1.4761 0.4845 1077.54 353.67 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 17 1.194 0.4127 871.61 301.25 567.42 529.58 400.07 348.21
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.9785 2666.39 714.28 1838.38 1716 1073.65 934.53
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 6 2.524 1.0127 1842.52 739.26 1160.79 1083.42 795.97 692.79
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.275 720.67 200.78 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3656 712.21 266.91 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4377 1121.62 319.51 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 24 17 1.9927 0.5782 1454.7 422.09 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 17 1.6161 0.5168 1179.74 377.23 768.01 716.81 541.5 471.31
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 6 3.382 1.1284 2468.85 823.73 1555.38 1451.67 1066.54 928.29
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.5457 1376.18 398.33 895.9 836.18 631.67 549.79
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4265 1194.14 311.34 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.7058 1424.41 515.22 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7196 1951.87 525.29 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 24 17 3.0038 0.7969 2192.8 581.75 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 17 2.4603 0.759 1796.01 554.09 1169.2 1091.26 824.37 717.5
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.1957 10665.54 3062.86 7354.32 6864.03 4294.96 3738.13
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 6 5.098 1.5586 3721.52 1137.74 2344.56 2188.25 1607.7 1399.29
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.7901 2187.3 576.8 1423.93 1329.01 1003.97 873.82
p2.8xlarge 32 2.7 488 8 NVIDIA K80 96 11 10.2276 8.6198 7466.17 6292.42 N/A N/A N/A N/A
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.5699 3508.99 1146.05 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 96 16 6.9079 2.0703 5042.74 1511.29 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 357 17 5.6202 1.6435 4102.71 1199.74 2670.87 2492.8 1883.15 1639.04
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 715 6 11.812 4.0555 8622.74 2960.51 5432.33 5070.15 3725.02 3242.16
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6577 2388.29 480.14 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.582 2388.29 424.83 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.2574 2848.82 917.89 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.2013 3903.74 876.94 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 24 16 4.9885 1.2676 3641.59 925.36 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 17 4.1487 1.2021 3028.53 877.51 1971.58 1840.14 1390.1 1209.9
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 9.7491 21331.09 7116.86 14708.65 13728.03 8589.67 7476.25
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 6 8.5299 2.5238 6226.85 1842.36 3922.92 3661.38 2690 2341.3
p2.16xlarge 64 2.3 732 16 NVIDIA K80 192 11 20.4553 16.6006 14932.35 12118.41 N/A N/A N/A N/A
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.3203 7010.22 2423.85 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 96 16 9.9185 2.8699 7240.5 2095.02 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 357 17 8.1527 2.2835 5951.5 1666.97 3874.43 3616.12 2731.74 2377.63
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 2.9615 9569.6 2161.89 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 715 6 16.9599 5.4285 12380.74 3962.78 7799.87 7279.88 5348.48 4655.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 10.8652 26015.5 7931.6 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 13 40.2949 15.4906 29415.27 11308.16 17973.94 16775.67 11604.57 10100.28
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 192 16 19.837 5.412 14481 3950.77 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 1430 17 16.3055 4.5247 11903.01 3303.05 7748.86 7232.27 5463.48 4755.25
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 2861 6 33.9198 8.8075 24761.48 6429.5 15599.73 14559.75 10696.96 9310.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 13 116.4941 31.5418 85040.67 23025.49 N/A N/A 37813.42 32911.68