Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 53 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1527 365.55 111.45 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1424 310.95 103.92 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2007 471.82 146.48 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 16 1.2252 0.3915 894.39 285.79 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 17 0.9829 0.3236 717.55 236.24 467.12 436 329.35 286.66
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.686 1535.92 500.81 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2112 483.93 154.18 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2204 444.55 160.88 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2744 837.91 200.35 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 16 1.4761 0.4876 1077.54 355.92 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 17 1.194 0.412 871.61 300.74 567.42 529.58 400.07 348.21
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.8321 2666.39 607.45 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 0.9638 1850.43 703.55 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.3113 720.67 227.25 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.375 712.21 273.77 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4325 1121.62 315.74 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 17 1.9927 0.5806 1454.7 423.83 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 17 1.6161 0.4917 1179.74 358.91 768.01 716.81 541.5 471.31
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.0627 2479.46 775.73 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.5141 1376.18 375.29 895.9 836.18 631.67 549.79
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4969 1194.14 362.74 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.681 1424.41 497.11 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.6707 1951.87 489.61 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 17 3.0038 0.8018 2192.8 585.3 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 17 2.4603 0.7053 1796.01 514.87 1169.2 1091.26 824.37 717.5
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 3.1146 10665.54 2273.62 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.4325 3737.51 1045.73 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.768 2187.3 560.66 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.5446 3508.99 1127.56 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 16 6.9079 1.7792 5042.74 1298.78 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 17 5.6202 1.6302 4102.71 1190.06 2670.87 2492.8 1883.15 1639.04
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 4.0865 8659.78 2983.13 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.7166 2388.29 523.09 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6631 2388.29 484.04 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.169 2848.82 853.4 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.1277 3903.74 823.22 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 16 4.9885 1.2335 3641.59 900.48 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 17 4.1487 1.1177 3028.53 815.89 1971.58 1840.14 1390.1 1209.9
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 9.5837 21331.09 6996.13 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 2.3188 6253.61 1692.76 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.0946 7010.22 2259.08 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 16 9.9185 2.8649 7240.5 2091.38 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 17 8.1527 2.1243 5951.5 1550.72 3874.43 3616.12 2731.74 2377.63
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 2.5609 9569.6 1869.46 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 4.8455 12433.93 3537.19 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 10.6823 26015.5 7798.12 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 13 40.2949 10.6688 29415.27 7788.21 17973.94 16775.67 11604.57 10100.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 5 47.0785 9.5186 34367.31 6948.58 21171.89 19760.45 13113.89 11413.94
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 16 19.837 7.0321 14481 5133.41 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 17 16.3055 4.0125 11903.01 2929.13 7748.86 7232.27 5463.48 4755.25
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 8.3791 24867.86 6116.77 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 13 116.4941 31.0243 85040.67 22647.71 N/A N/A 37813.42 32911.68
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 10 103.88 19.9874 75832.4 14590.83 N/A N/A N/A N/A