Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 53 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1652 365.55 120.63 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1401 310.95 102.26 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2011 471.82 146.83 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 16 1.2252 0.4023 894.39 293.66 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 17 0.9829 0.3291 717.55 240.24 467.12 436 329.35 286.66
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.6626 1535.92 483.67 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2053 483.93 149.89 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.216 444.55 157.7 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2788 837.91 203.55 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 16 1.4761 0.5088 1077.54 371.42 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 17 1.194 0.4099 871.61 299.22 567.42 529.58 400.07 348.21
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.8422 2666.39 614.81 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 0.9104 1850.43 664.58 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.3087 720.67 225.34 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3658 712.21 267.01 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4344 1121.62 317.09 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 17 1.9927 0.5988 1454.7 437.13 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 17 1.6161 0.4953 1179.74 361.59 768.01 716.81 541.5 471.31
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.0518 2479.46 767.81 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.5156 1376.18 376.41 895.9 836.18 631.67 549.79
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4764 1194.14 347.78 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.6684 1424.41 487.96 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.6589 1951.87 481 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 17 3.0038 0.8269 2192.8 603.63 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 17 2.4603 0.7134 1796.01 520.78 1169.2 1091.26 824.37 717.5
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 3.1936 10665.54 2331.31 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.4771 3737.51 1078.31 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.7812 2187.3 570.28 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.5435 3508.99 1126.75 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 16 6.9079 1.8266 5042.74 1333.4 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 17 5.6202 1.6497 4102.71 1204.29 2670.87 2492.8 1883.15 1639.04
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 4.0935 8659.78 2988.25 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6501 2388.29 474.54 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.5965 2388.29 435.44 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.1937 2848.82 871.37 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.1104 3903.74 810.62 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 16 4.9885 1.2657 3641.59 923.99 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 17 4.1487 1.1167 3028.53 815.21 1971.58 1840.14 1390.1 1209.9
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 10.0408 21331.09 7329.8 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 2.1854 6253.61 1595.31 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.1542 7010.22 2302.6 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 16 9.9185 2.6718 7240.5 1950.42 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 17 8.1527 2.1628 5951.5 1578.85 3874.43 3616.12 2731.74 2377.63
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 2.8066 9569.6 2048.78 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 4.6408 12433.93 3387.78 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 10.3191 26015.5 7532.94 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 13 40.2949 11.1756 29415.27 8158.17 17973.94 16775.67 11604.57 10100.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 5 47.0785 6.8167 34367.31 4976.23 21171.89 19760.45 13113.89 11413.94
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 16 19.837 7.3582 14481 5371.47 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 17 16.3055 4.2072 11903.01 3071.29 7748.86 7232.27 5463.48 4755.25
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 7.5174 24867.86 5487.7 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 13 116.4941 29.7622 85040.67 21726.44 N/A N/A 37813.42 32911.68
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 10 103.88 17.9067 75832.4 13071.88 N/A N/A N/A N/A