Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 60 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 11 0.245 0.0615 178.86 44.93 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1789 365.55 130.58 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1459 310.95 106.51 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2055 471.82 150.05 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 16 1.2252 0.439 894.39 320.44 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 19 0.9849 0.3526 718.96 257.39 467.26 436.13 329.45 286.74
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 11 0.2881 0.0838 210.29 61.2 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.8026 1535.92 585.92 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2479 483.93 181 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.232 444.55 169.37 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2825 837.91 206.22 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 16 1.4761 0.5456 1077.54 398.29 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 19 1.1963 0.4396 873.33 320.88 567.59 529.74 400.19 348.32
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 11 0.5761 0.1729 420.58 126.18 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.181 2666.39 862.14 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 0.9718 1850.43 709.4 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.3443 720.67 251.36 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.387 712.21 282.52 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4752 1121.62 346.88 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 17 1.9927 0.6436 1454.7 469.82 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 19 1.6193 0.5685 1182.07 415.02 768.24 717.03 541.66 471.45
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 11 1.1523 0.3329 841.15 243.03 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.1345 2479.46 828.2 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.6014 1376.18 439.03 895.9 836.18 631.67 549.79
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 11 1.293 0.3771 943.87 275.28 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 1.9976 5775.76 1458.28 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.5885 1194.14 429.58 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.723 1424.41 527.78 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7554 1951.87 551.41 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 17 3.0038 1.0514 2192.8 767.49 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 19 2.4651 0.8184 1799.54 597.44 1169.55 1091.59 824.61 717.72
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.5051 10665.54 3288.75 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.6315 3737.51 1191.01 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.8901 2187.3 649.75 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.5107 3532.98 1102.84 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 16 6.9079 2.4242 5042.74 1769.63 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 19 5.6312 1.9079 4110.79 1392.79 2671.67 2493.55 1883.71 1639.53
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 4.3724 8659.78 3191.83 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 1.0554 2388.29 770.41 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.9286 2440.11 677.9 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.2764 2848.82 931.74 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.3231 3903.74 965.89 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 16 4.9885 1.6135 3641.59 1177.87 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 19 4.1568 1.3767 3034.49 1004.98 1972.17 1840.69 1390.51 1210.26
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 12.6228 21331.09 9214.66 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 2.8521 6253.61 2082.07 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.2761 7010.22 2391.54 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 16 9.9185 4.0915 7240.5 2986.81 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 19 8.1688 2.7527 5963.22 2009.47 3875.59 3617.21 2732.56 2378.34
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 4.05 9569.6 2956.5 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 5.7151 12433.93 4172 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 14.0853 26015.5 10282.29 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 13 26.9975 8.3893 19708.19 6124.2 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 19.9381 23763.63 14554.83 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 16 19.837 9.3371 14481 6816.05 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 19 16.3376 5.124 11926.43 3740.54 7751.18 7234.44 5465.12 4756.68
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 11.3478 24867.86 8283.88 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 14 65.9694 20.6408 48157.64 15067.81 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 12 74.6893 19.9153 54523.17 14538.15 N/A N/A 23953.23 20848.19
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 4 113.9328 26.6881 83170.94 19482.33 N/A N/A N/A N/A