Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 66 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0733 178.05 53.5 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1206 365.55 88.01 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1229 310.95 89.74 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2026 471.82 147.88 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4739 908.29 345.93 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.4302 718.28 314.05 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.1126 209.34 82.23 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 9 2.1239 0.7346 1550.44 536.27 976.78 911.66 669.79 582.97
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1715 483.93 125.19 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2107 444.55 153.82 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2731 837.91 199.35 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.5741 1094.28 419.06 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.4724 872.51 344.86 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1715 418.68 125.17 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.4425 2666.39 1053.04 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 9 2.5588 0.8777 1867.92 640.69 1176.79 1098.34 806.94 702.34
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 6 3.7742 0.8818 2755.2 643.69 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.232 720.67 169.34 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3446 712.21 251.59 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4092 1121.62 298.68 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.621 1475.28 453.32 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.5328 1180.96 388.95 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.3416 837.35 249.39 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 9 3.4286 0.9671 2502.9 705.95 1576.82 1471.69 1081.25 941.09
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 6 4.4869 0.9363 3275.45 683.51 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4154 1378.41 303.25 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.3988 939.6 291.14 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 4.8654 5775.76 3551.76 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.3406 1194.14 248.62 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.4551 1424.41 332.24 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.5936 1951.87 433.29 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8604 2223.83 628.1 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.6247 1797.85 456.01 1168.5 1090.61 823.87 717.07
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 8.9031 10665.54 6499.28 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 9 5.1683 1.2828 3772.84 936.43 2376.89 2218.42 1629.87 1418.59
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 6 5.9123 0.9395 4315.95 685.87 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.5911 2190.84 431.49 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.4836 3532.98 1083.06 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 2.9456 5121.09 2150.29 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.8343 4106.93 1339.03 2669.26 2491.3 1882.01 1638.05
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 9 11.9748 2.6128 8741.64 1907.37 5507.23 5140.07 3776.39 3286.86
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 6 9.299 1.4112 6788.29 1030.2 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.5317 2388.29 388.11 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.4678 2440.11 341.49 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.1071 2848.82 808.15 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.9461 3903.74 690.67 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.1541 3698.17 842.51 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 0.8834 3031.65 644.9 1970.39 1839.03 1389.26 1209.17
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 21.4031 21331.09 15624.24 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 9 8.6476 1.8515 6312.72 1351.57 3977.01 3711.86 2727.1 2373.58
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 2.9866 7010.22 2180.2 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 4.833 7352.99 3528.07 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 2.394 5957.62 1747.65 3872.1 3613.95 2730.1 2376.19
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 10.4162 9569.6 7603.86 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 9 17.1938 3.7013 12551.47 2701.92 7907.42 7380.26 5422.23 4719.35
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 9.1009 26015.5 6643.69 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 6 18.5981 2.8785 13576.58 2101.32 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 13.6141 19617.76 9938.26 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 16.5953 23763.63 12114.59 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 9.2616 14705.99 6760.94 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 4.5982 11915.25 3356.69 7744.19 7227.92 5460.19 4752.39
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 9 34.3876 8.3803 25102.93 6117.64 15814.85 14760.53 10844.47 9438.7
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 6 37.1961 6.2108 27153.15 4533.91 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 28.5592 48643.62 20848.22 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 17.2715 54523.17 12608.19 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 4 113.9328 21.8032 83170.94 15916.37 N/A N/A N/A N/A