Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 66 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0474 178.05 34.62 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1285 365.55 93.82 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1364 310.95 99.57 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2068 471.82 150.99 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4525 908.29 330.3 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.3573 718.28 260.85 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.0752 209.34 54.87 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.7652 1535.92 558.57 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2064 483.93 150.67 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2262 444.55 165.12 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2811 837.91 205.17 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.5343 1094.28 390.07 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.4285 872.51 312.81 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1597 418.68 116.57 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.6956 2666.39 507.79 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 0.9145 1850.43 667.58 1165.77 1088.06 799.39 695.77
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 2 3.3631 1.519 2455.08 1108.87 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2499 720.67 182.41 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3675 712.21 268.27 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4272 1121.62 311.89 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.7339 1475.28 535.74 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.4814 1180.96 351.41 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.3067 837.35 223.86 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.1108 2479.46 810.9 1562.06 1457.91 1071.13 932.28
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 2 3.9982 1.8173 2918.66 1326.63 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4471 1378.41 326.37 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.3597 939.6 262.58 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 7.3211 5775.76 5344.37 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4033 1194.14 294.4 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.6283 1424.41 458.67 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.5785 1951.87 422.28 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8268 2223.83 603.54 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.7242 1797.85 528.65 1168.5 1090.61 823.87 717.07
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 2.5481 10665.54 1860.09 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.3583 3737.51 991.54 2354.63 2197.65 1614.6 1405.3
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 2 5.2682 2.3666 3845.82 1727.62 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.6362 2190.84 464.45 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.4585 3532.98 1064.69 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 2.3773 5121.09 1735.44 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.6885 4106.93 1232.64 2669.26 2491.3 1882.01 1638.05
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 3.0794 8659.78 2247.99 5455.66 5091.94 3741.03 3256.08
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 2 8.2861 3.7531 6048.84 2739.76 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.5518 2388.29 402.85 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.463 2440.11 338 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 0.9264 2848.82 676.29 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.8742 3903.74 638.18 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.0777 3698.17 786.72 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 1.0274 3031.65 750 1970.39 1839.03 1389.26 1209.17
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 9.7946 21331.09 7150.05 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 1.7295 6253.61 1262.53 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.038 7010.22 2217.74 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 4.829 7352.99 3525.19 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 1.9062 5957.62 1391.51 3872.1 3613.95 2730.1 2376.19
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 3.7621 9569.6 2746.33 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 4.4577 12433.93 3254.11 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 7.6581 26015.5 5590.43 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 2 16.5722 7.4329 12097.68 5426.05 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 9.7039 19617.76 7083.82 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 11.2883 23763.63 8240.45 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 9.9017 14705.99 7228.27 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 3.4415 11915.25 2512.32 7744.19 7227.92 5460.19 4752.39
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 8.7255 24867.86 6369.61 15666.75 14622.3 10742.91 9350.32
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 2 33.1443 14.9271 24195.35 10896.82 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 31.6842 48643.62 23129.5 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 20.5048 54523.17 14968.49 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 4 113.9328 20.5051 83170.94 14968.69 N/A N/A N/A N/A