Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 69 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

โœ… Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0885 178.05 64.58 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1368 365.55 99.9 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1192 310.95 87.03 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.234 471.82 170.82 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 19 1.2363 0.4846 902.47 353.79 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.3976 718.28 290.22 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.1338 209.34 97.7 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 12 2.1903 1.0735 1598.94 783.67 1007.33 940.17 690.74 601.21
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2354 483.93 171.86 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2097 444.55 153.08 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.297 837.91 216.81 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 19 1.4894 0.5535 1087.27 404.04 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.4145 872.51 302.6 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.2272 418.68 165.87 N/A N/A N/A N/A
g7.2xlarge 8 3.9 32 1 NVIDIA RTX PRO 4500 32 4 2.5515 0.7927 1862.59 578.65 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 12 2.6389 1.1204 1926.36 817.89 1213.61 1132.71 832.19 724.31
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 10 4.4555 1.5132 3252.48 1104.64 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.3083 720.67 225.08 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.352 712.21 256.96 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4312 1121.62 314.79 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 20 2.0075 0.7571 1465.46 552.68 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.5611 1180.96 409.62 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.5104 837.35 372.59 N/A N/A N/A N/A
g7.4xlarge 16 3.9 64 1 NVIDIA RTX PRO 4500 32 4 3.0801 0.9302 2248.48 679.08 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 12 3.5359 1.3226 2581.2 965.49 1626.15 1517.73 1115.08 970.53
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 11 5.3023 1.7468 3870.7 1275.16 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4879 1378.41 356.17 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.5062 939.6 369.51 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 6.542 5775.76 4775.63 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4425 1194.14 323.06 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.6112 1424.41 446.19 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.614 1951.87 448.21 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 20 3.026 0.9375 2209.02 684.4 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.728 1797.85 531.41 1168.5 1090.61 823.87 717.07
g7.8xlarge 32 3.9 128 1 NVIDIA RTX PRO 4500 32 4 4.1373 1.0304 3020.24 752.21 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 12 5.33 1.4951 3890.87 1091.42 2451.25 2287.83 1680.86 1462.97
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 11 6.9867 2.0353 5100.29 1485.78 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.721 2190.84 526.34 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.679 3532.98 1225.65 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 19 6.9702 3.0544 5088.28 2229.72 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.7776 4106.93 1297.65 2669.26 2491.3 1882.01 1638.05
g7.12xlarge 48 3.9 192 2 NVIDIA RTX PRO 4500 64 4 7.2174 1.7063 5268.72 1245.58 N/A N/A N/A N/A
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 12 12.3495 4.4539 9015.12 3251.35 5679.52 5300.88 3894.53 3389.69
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 10 10.9774 3.1907 8013.49 2329.22 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6412 2388.29 468.04 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.5458 2440.11 398.41 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.0737 2848.82 783.8 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.9835 3903.74 717.99 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 19 5.0335 1.5002 3674.47 1095.11 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 1.1637 3031.65 849.49 1970.39 1839.03 1389.26 1209.17
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 12 8.9181 2.0262 6510.21 1479.14 4101.43 3827.99 2812.41 2447.84
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.2832 7010.22 2396.72 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 19 10.0081 6.5139 7305.88 4755.13 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 2.6208 5957.62 1913.19 3872.1 3613.95 2730.1 2376.19
g7.24xlarge 96 3.9 384 4 NVIDIA RTX PRO 4500 128 4 14.4348 3.6012 10537.44 2628.84 N/A N/A N/A N/A
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 12 17.7317 5.6425 12944.13 4119.02 8154.8 7611.14 5591.87 4866.99
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 7.2636 26015.5 5302.39 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 10 21.9548 6.9295 16026.98 5058.53 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 15.0387 19617.76 10978.23 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 20.3902 23763.63 14884.81 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 19 20.0161 11.6662 14611.76 8516.32 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 5.2419 11915.25 3826.59 7744.19 7227.92 5460.19 4752.39
g7.48xlarge 192 3.9 768 8 NVIDIA RTX PRO 4500 256 4 28.8697 6.5657 21074.88 4793 N/A N/A N/A N/A
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 12 35.4634 16.4222 25888.26 11988.21 16309.6 15222.31 11183.73 9733.99
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 10 43.9095 13.167 32053.97 9611.93 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 34.1904 48643.62 24958.98 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 32.1581 54523.17 23475.44 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 7 121.5283 44.7899 88715.67 32696.64 N/A N/A N/A N/A
p6-b300.48xlarge 192 2.4 4096 8 NVIDIA B300 2148 4 151.9107 46.9333 110894.79 34261.28 N/A N/A N/A N/A