Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 64 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0785 178.05 57.29 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1327 365.55 96.88 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1163 310.95 84.92 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.1927 471.82 140.68 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4604 908.29 336.11 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.3152 718.28 230.08 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.1081 209.34 78.88 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 11 2.1863 0.7757 1595.98 566.28 1005.47 938.43 689.46 600.09
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1929 483.93 140.83 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2072 444.55 151.26 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2632 837.91 192.15 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.5025 1094.28 366.85 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.3695 872.51 269.76 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.211 418.68 154.06 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 11 2.634 0.8356 1922.79 610.02 1211.36 1130.61 830.64 722.97
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 7 4.0701 1.3008 2971.18 949.6 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2516 720.67 183.66 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3342 712.21 243.98 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4069 1121.62 297.02 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.611 1475.28 446.06 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.4556 1180.96 332.59 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.4316 837.35 315.08 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 11 3.5293 1.1006 2576.41 803.45 1623.14 1514.92 1113.01 968.73
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 8 4.9036 1.4122 3579.61 1030.87 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.3604 1378.41 263.06 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.4174 939.6 304.71 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 4.5044 5775.76 3288.22 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.3817 1194.14 278.67 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.4706 1424.41 343.55 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.5688 1951.87 415.26 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8587 2223.83 626.87 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.6841 1797.85 499.37 1168.5 1090.61 823.87 717.07
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 11 5.3201 1.2344 3883.66 901.09 2446.7 2283.58 1677.74 1460.26
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 8 6.4613 2.4948 4716.73 1821.24 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.5323 2190.84 388.59 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.5085 3532.98 1101.23 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 3.2901 5121.09 2401.78 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.6185 4106.93 1181.53 2669.26 2491.3 1882.01 1638.05
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 11 12.3266 2.833 8998.4 2068.11 5668.99 5291.05 3887.31 3383.4
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 7 10.028 4.0026 7320.43 2921.88 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.555 2388.29 405.14 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.4535 2440.11 331.02 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 0.9252 2848.82 675.36 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.8696 3903.74 634.8 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.2015 3698.17 877.07 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 0.908 3031.65 662.81 1970.39 1839.03 1389.26 1209.17
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 11 8.9016 1.8273 6498.14 1333.91 4093.83 3820.89 2807.2 2443.3
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 2.9432 7010.22 2148.52 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 5.5154 7352.99 4026.22 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 2.238 5957.62 1633.72 3872.1 3613.95 2730.1 2376.19
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 13.109 9569.6 9569.57 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 11 17.6988 2.7671 12920.13 2019.98 8139.68 7597.03 5581.5 4857.97
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 7.9194 26015.5 5781.2 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 7 20.056 7.7879 14640.85 5685.15 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 11.7371 19617.76 8568.06 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 17.9834 23763.63 13127.85 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 9.4197 14705.99 6876.36 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 4.0707 11915.25 2971.64 7744.19 7227.92 5460.19 4752.39
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 11 35.3976 6.7265 25840.27 4910.32 16279.37 15194.08 11162.99 9715.94
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 7 40.1119 17.3216 29281.71 12644.79 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 27.867 48643.62 20342.88 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 29.0561 54523.17 21210.93 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 5 118.4901 32.8178 86497.78 23957.03 N/A N/A N/A N/A
p6-b300.48xlarge 192 2.4 4096 8 NVIDIA B300 2148 3 151.9107 28.3138 110894.79 20669.07 N/A N/A N/A N/A