Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 66 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0789 178.05 57.57 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1165 365.55 85.06 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1224 310.95 89.33 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2092 471.82 152.7 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.5384 908.29 393.04 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.4028 718.28 294.03 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.1001 209.34 73.08 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 10 2.1814 0.8948 1592.42 653.24 1003.23 936.34 687.93 598.75
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1794 483.93 130.97 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2053 444.55 149.85 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2759 837.91 201.43 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.5024 1094.28 366.76 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.4174 872.51 304.72 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1754 418.68 128.06 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.9728 2666.39 1440.12 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 10 2.6281 0.9641 1918.5 703.8 1208.66 1128.08 828.79 721.36
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 6 3.7742 0.8694 2755.2 634.67 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2148 720.67 156.84 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3408 712.21 248.77 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4139 1121.62 302.13 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.6176 1475.28 450.83 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.4588 1180.96 334.89 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.3567 837.35 260.39 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 10 3.5215 1.1191 2570.67 816.98 1619.52 1511.54 1110.53 966.57
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 6 4.4869 0.9722 3275.45 709.73 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4559 1378.41 332.83 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.3842 939.6 280.49 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 4.2303 5775.76 3088.11 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.3576 1194.14 261.03 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.478 1424.41 348.93 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.5979 1951.87 436.48 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8829 2223.83 644.54 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.6863 1797.85 501.03 1168.5 1090.61 823.87 717.07
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 9.0031 10665.54 6572.27 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 10 5.3082 1.4465 3875 1055.96 2441.25 2278.49 1674 1457
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 6 5.9123 1.072 4315.95 782.55 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.6565 2190.84 479.24 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.556 3532.98 1135.88 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 3.3114 5121.09 2417.29 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.7964 4106.93 1311.38 2669.26 2491.3 1882.01 1638.05
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 10 12.2991 2.9667 8978.35 2165.67 5656.36 5279.26 3878.65 3375.86
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 6 9.299 1.7177 6788.29 1253.9 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6182 2388.29 451.3 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.4996 2440.11 364.72 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.1519 2848.82 840.86 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.9554 3903.74 697.45 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.1541 3698.17 842.47 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 1.0241 3031.65 747.59 1970.39 1839.03 1389.26 1209.17
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 20.9788 21331.09 15314.53 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 10 8.8817 1.8534 6483.66 1352.97 4084.7 3812.38 2800.94 2437.86
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 2.9669 7010.22 2165.81 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 5.0177 7352.99 3662.9 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 2.2992 5957.62 1678.43 3872.1 3613.95 2730.1 2376.19
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 10.3721 9569.6 7571.63 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 10 17.6594 3.4872 12891.34 2545.66 8121.54 7580.1 5569.06 4847.14
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 6.7929 26015.5 4958.82 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 6 18.5981 3.2676 13576.58 2385.34 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 12.1222 19617.76 8849.23 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 16.2272 23763.63 11845.86 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 9.4102 14705.99 6869.47 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 4.4364 11915.25 3238.6 7744.19 7227.92 5460.19 4752.39
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 10 35.3187 7.8516 25782.67 5731.66 16243.08 15160.22 11138.12 9694.29
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 6 37.1961 6.8497 27153.15 5000.24 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 30.2606 48643.62 22090.27 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 22.8869 54523.17 16707.45 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 4 113.9328 30.1845 83170.94 22034.7 N/A N/A N/A N/A