Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 59 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 1 NVIDIA L4 2 11 0.245 N/A 178.86 N/A N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1682 365.55 122.79 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1516 310.95 110.68 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.1963 471.82 143.28 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 16 1.2252 0.4345 894.39 317.16 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 17 0.9829 0.3721 717.55 271.65 467.12 436 329.35 286.66
g6f.xlarge 4 3.4 16 1 NVIDIA L4 2 11 0.2881 N/A 210.29 N/A N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.9146 1535.92 667.64 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.237 483.93 173.04 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2323 444.55 169.56 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.268 837.91 195.67 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 16 1.4761 0.5191 1077.54 378.94 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 17 1.194 0.459 871.61 335.05 567.42 529.58 400.07 348.21
g6f.2xlarge 8 3.4 32 1 NVIDIA L4 5 11 0.5761 N/A 420.58 N/A N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.1036 2666.39 805.65 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 1.0499 1850.43 766.46 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2997 720.67 218.79 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3987 712.21 291.03 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4569 1121.62 333.57 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 17 1.9927 0.6649 1454.7 485.35 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 17 1.6161 0.5584 1179.74 407.6 768.01 716.81 541.5 471.31
g6f.4xlarge 16 3.4 64 1 NVIDIA L4 11 11 1.1523 N/A 841.15 N/A N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.2268 2479.46 895.59 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.6049 1376.18 441.59 895.9 836.18 631.67 549.79
gr6f.4xlarge 16 3.4 128 1 NVIDIA L4 11 11 1.293 N/A 943.87 N/A N/A N/A N/A N/A
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.5187 1194.14 378.65 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.7281 1424.41 531.52 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7304 1951.87 533.23 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 17 3.0038 0.965 2192.8 704.45 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 17 2.4603 0.8101 1796.01 591.39 1169.2 1091.26 824.37 717.5
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.0782 10665.54 2977.11 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.6361 3737.51 1194.35 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.9349 2187.3 682.5 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.6009 3508.99 1168.68 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 16 6.9079 2.171 5042.74 1584.81 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 17 5.6202 2.0283 4102.71 1480.63 2670.87 2492.8 1883.15 1639.04
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 5.0054 8659.78 3653.91 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.8749 2388.29 638.65 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.7985 2388.29 582.93 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.3624 2848.82 994.53 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.2741 3903.74 930.08 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 16 4.9885 1.637 3641.59 1195.03 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 17 4.1487 1.3654 3028.53 996.76 1971.58 1840.14 1390.1 1209.9
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 11.3234 21331.09 8266.09 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 2.9281 6253.61 2137.5 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.5372 7010.22 2582.18 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 16 9.9185 3.5354 7240.5 2580.83 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 17 8.1527 2.6973 5951.5 1969.02 3874.43 3616.12 2731.74 2377.63
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 2.3239 9569.6 1696.41 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 5.8331 12433.93 4258.16 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 11.8421 26015.5 8644.73 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 13 26.9975 7.3384 19708.19 5357 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 14.168 23763.63 10342.62 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 16 19.837 7.6909 14481 5614.38 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 17 16.3055 5.0134 11903.01 3659.82 7748.86 7232.27 5463.48 4755.25
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 11.9128 24867.86 8696.36 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 14 65.9694 19.7398 48157.64 14410.02 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 12 74.6893 17.0945 54523.17 12479 N/A N/A 23953.23 20848.19
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 3 113.9328 13.2112 83170.94 9644.18 N/A N/A N/A N/A