Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 64 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0779 178.05 56.86 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1308 365.55 95.45 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1158 310.95 84.52 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2017 471.82 147.27 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4357 908.29 318.06 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.333 718.28 243.12 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.0943 209.34 68.82 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 12 2.1903 0.7882 1598.94 575.37 1007.33 940.17 690.74 601.21
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1845 483.93 134.65 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2249 444.55 164.19 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2722 837.91 198.7 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.5381 1094.28 392.79 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.383 872.51 279.59 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1794 418.68 130.94 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 12 2.6389 0.8435 1926.36 615.73 1213.61 1132.71 832.19 724.31
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 7 4.0701 1.4088 2971.18 1028.46 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.246 720.67 179.56 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3437 712.21 250.92 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4236 1121.62 309.21 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.649 1475.28 473.77 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.4801 1180.96 350.46 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.4577 837.35 334.15 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 12 3.5359 1.1025 2581.2 804.8 1626.15 1517.73 1115.08 970.53
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 8 4.9036 1.6733 3579.61 1221.51 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.3615 1378.41 263.93 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.4551 939.6 332.21 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 4.2268 5775.76 3085.59 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.3866 1194.14 282.21 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.4481 1424.41 327.13 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.582 1951.87 424.83 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8906 2223.83 650.17 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.7032 1797.85 513.31 1168.5 1090.61 823.87 717.07
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 12 5.33 1.4587 3890.87 1064.86 2451.25 2287.83 1680.86 1462.97
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 8 6.4613 2.0959 4716.73 1530 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.5921 2190.84 432.23 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.5566 3532.98 1136.35 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 3.4309 5121.09 2504.56 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.4391 4106.93 1050.52 2669.26 2491.3 1882.01 1638.05
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 12 12.3495 2.5912 9015.12 1891.57 5679.52 5300.88 3894.53 3389.69
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 7 10.028 3.1154 7320.43 2274.21 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6841 2388.29 499.4 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.5132 2440.11 374.65 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 0.9901 2848.82 722.8 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.885 3903.74 646.02 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.1342 3698.17 827.95 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 1.0285 3031.65 750.82 1970.39 1839.03 1389.26 1209.17
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 12 8.9181 1.6864 6510.21 1231.06 4101.43 3827.99 2812.41 2447.84
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 2.9729 7010.22 2170.2 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 5.2778 7352.99 3852.82 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 1.7942 5957.62 1309.73 3872.1 3613.95 2730.1 2376.19
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 13.109 9569.6 9569.57 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 12 17.7317 3.4054 12944.13 2485.96 8154.8 7611.14 5591.87 4866.99
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 10.521 26015.5 7680.33 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 7 20.056 5.4991 14640.85 4014.37 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 10.1976 19617.76 7444.21 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 14.3838 23763.63 10500.14 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 9.5745 14705.99 6989.39 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 3.779 11915.25 2758.7 7744.19 7227.92 5460.19 4752.39
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 12 35.4634 6.412 25888.26 4680.77 16309.6 15222.31 11183.73 9733.99
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 7 40.1119 17.8072 29281.71 12999.25 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 29.7398 48643.62 21710.04 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 25.0159 54523.17 18261.59 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 7 121.5283 31.9022 88715.67 23288.62 N/A N/A N/A N/A
p6-b300.48xlarge 192 2.4 4096 8 NVIDIA B300 2148 4 151.9107 30.7188 110894.79 22424.75 N/A N/A N/A N/A