Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 66 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0538 178.05 39.24 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1082 365.55 78.98 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1276 310.95 93.18 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2092 471.82 152.74 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4304 908.29 314.16 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.345 718.28 251.86 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.071 209.34 51.8 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 9 2.1239 0.7729 1550.44 564.2 976.78 911.66 669.79 582.97
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1736 483.93 126.76 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2252 444.55 164.39 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.287 837.91 209.49 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.4923 1094.28 359.36 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.4222 872.51 308.19 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1481 418.68 108.13 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.701 2666.39 511.76 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 9 2.5588 0.9055 1867.92 661.03 1176.79 1098.34 806.94 702.34
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 3 3.3631 1.0372 2455.08 757.13 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2342 720.67 170.97 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3643 712.21 265.96 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4442 1121.62 324.26 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.7098 1475.28 518.17 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.4988 1180.96 364.14 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.2692 837.35 196.54 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 9 3.4286 1.0276 2502.9 750.13 1576.82 1471.69 1081.25 941.09
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 3 3.9982 1.1567 2918.66 844.42 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4375 1378.41 319.39 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.4038 939.6 294.77 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 5.6876 5775.76 4151.93 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4158 1194.14 303.53 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.5919 1424.41 432.09 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.592 1951.87 432.18 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8575 2223.83 625.94 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.7235 1797.85 528.15 1168.5 1090.61 823.87 717.07
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.2008 10665.54 3066.56 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 9 5.1683 1.3635 3772.84 995.34 2376.89 2218.42 1629.87 1418.59
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 3 5.2682 1.5386 3845.82 1123.2 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.6079 2190.84 443.74 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.4856 3532.98 1084.5 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 2.5379 5121.09 1852.7 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.7011 4106.93 1241.83 2669.26 2491.3 1882.01 1638.05
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 9 11.9748 3.323 8741.64 2425.78 5507.23 5140.07 3776.39 3286.86
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 3 8.2861 2.4676 6048.84 1801.37 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.4873 2388.29 355.73 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.5023 2440.11 366.71 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 0.9185 2848.82 670.53 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.8639 3903.74 630.62 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.0616 3698.17 774.97 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 0.9522 3031.65 695.14 1970.39 1839.03 1389.26 1209.17
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 11.5397 21331.09 8423.95 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 9 8.6476 1.9017 6312.72 1388.23 3977.01 3711.86 2727.1 2373.58
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.1565 7010.22 2304.23 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 4.9291 7352.99 3598.26 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 2.2583 5957.62 1648.58 3872.1 3613.95 2730.1 2376.19
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 9.6996 9569.6 7080.71 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 9 17.1938 4.4872 12551.47 3275.63 7907.42 7380.26 5422.23 4719.35
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 10.9078 26015.5 7962.73 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 3 16.5722 4.7197 12097.68 3445.36 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 11.0022 19617.76 8031.63 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 9.7927 23763.63 7148.71 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 9.6768 14705.99 7064.09 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 4.6266 11915.25 3377.45 7744.19 7227.92 5460.19 4752.39
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 9 34.3876 9.1948 25102.93 6712.2 15814.85 14760.53 10844.47 9438.7
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 3 33.1443 9.6628 24195.35 7053.84 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 29.3081 48643.62 21394.95 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 25.7268 54523.17 18780.58 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 4 113.9328 14.892 83170.94 10871.16 N/A N/A N/A N/A