Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 53 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

โœ… Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1545 365.55 112.76 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1433 310.95 104.59 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.1911 471.82 139.5 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 16 1.2252 0.4271 894.39 311.8 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 17 0.9829 0.3669 717.55 267.81 467.12 436 329.35 286.66
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.885 1535.92 646.05 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2266 483.93 165.39 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2287 444.55 166.93 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2627 837.91 191.74 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 16 1.4761 0.5211 1077.54 380.41 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 17 1.194 0.4262 871.61 311.16 567.42 529.58 400.07 348.21
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.9593 2666.39 700.28 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 1.1482 1850.43 838.16 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2784 720.67 203.22 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3778 712.21 275.8 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4436 1121.62 323.79 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 17 1.9927 0.6411 1454.7 467.97 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 17 1.6161 0.5234 1179.74 382.08 768.01 716.81 541.5 471.31
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.1438 2479.46 834.94 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.5882 1376.18 429.38 895.9 836.18 631.67 549.79
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4882 1194.14 356.4 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.6988 1424.41 510.15 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7032 1951.87 513.31 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 17 3.0038 0.9245 2192.8 674.88 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 17 2.4603 0.7657 1796.01 558.95 1169.2 1091.26 824.37 717.5
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 3.5161 10665.54 2566.77 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.5104 3737.51 1102.62 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.8519 2187.3 621.86 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.5228 3508.99 1111.66 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 16 6.9079 1.9674 5042.74 1436.21 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 17 5.6202 1.8008 4102.71 1314.57 2670.87 2492.8 1883.15 1639.04
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 4.7646 8659.78 3478.13 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6948 2388.29 507.18 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6407 2388.29 467.69 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.2875 2848.82 939.91 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.2096 3903.74 883.02 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 16 4.9885 1.3979 3641.59 1020.46 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 17 4.1487 1.2081 3028.53 881.94 1971.58 1840.14 1390.1 1209.9
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 10.6522 21331.09 7776.07 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 2.2616 6253.61 1650.94 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.2361 7010.22 2362.33 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 16 9.9185 2.9474 7240.5 2151.63 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 17 8.1527 2.3182 5951.5 1692.29 3874.43 3616.12 2731.74 2377.63
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 1.4055 9569.6 1026.05 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 4.7531 12433.93 3469.77 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 10.6112 26015.5 7746.18 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 13 26.9975 8.4596 19708.19 6175.47 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 9.1978 23763.63 6714.38 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 16 19.837 6.5768 14481 4801.09 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 17 16.3055 4.4411 11903.01 3241.99 7748.86 7232.27 5463.48 4755.25
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 9.358 24867.86 6831.31 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 14 65.9694 20.963 48157.64 15302.99 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 12 74.6893 15.5889 54523.17 11379.91 N/A N/A 23953.23 20848.19