Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 60 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0443 178.05 32.37 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1311 365.55 95.7 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1315 310.95 95.98 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2061 471.82 150.47 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4572 908.29 333.79 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 19 0.9849 0.3575 718.96 260.96 467.26 436.13 329.45 286.74
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.0778 209.34 56.81 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.7543 1535.92 550.66 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2398 483.93 175.07 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2189 444.55 159.81 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2772 837.91 202.37 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.5772 1094.28 421.36 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 19 1.1963 0.4216 873.33 307.75 567.59 529.74 400.19 348.32
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1546 418.68 112.86 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.7302 2666.39 533.07 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 0.9482 1850.43 692.19 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2778 720.67 202.79 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3692 712.21 269.54 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.3958 1121.62 288.92 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.6818 1475.28 497.69 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 19 1.6193 0.5152 1182.07 376.07 768.24 717.03 541.66 471.45
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.3003 837.35 219.21 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.15 2479.46 839.47 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4714 1378.41 344.1 895.9 836.18 631.67 549.79
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.3291 939.6 240.21 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 7.1856 5775.76 5245.46 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.395 1194.14 288.37 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.6284 1424.41 458.75 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.5653 1951.87 412.66 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8836 2223.83 645.05 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 19 2.4651 0.7245 1799.54 528.88 1169.55 1091.59 824.61 717.72
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 2.4596 10665.54 1795.48 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.3496 3737.51 985.2 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.6693 2190.84 488.59 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.4573 3532.98 1063.85 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 2.5472 5121.09 1859.46 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 19 5.6312 1.7568 4110.79 1282.48 2671.67 2493.55 1883.71 1639.53
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 3.6126 8659.78 2637.23 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.5331 2388.29 389.19 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.5079 2440.11 370.75 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 0.9478 2848.82 691.91 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.8799 3903.74 642.34 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.0519 3698.17 767.85 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 19 4.1568 1.0531 3034.49 768.76 1972.17 1840.69 1390.51 1210.26
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 10.0282 21331.09 7320.59 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 1.8845 6253.61 1375.7 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 2.9688 7010.22 2167.21 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 4.9659 7352.99 3625.09 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 19 8.1688 1.9001 5963.22 1387.06 3875.59 3617.21 2732.56 2378.34
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 2.843 9569.6 2075.35 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 4.869 12433.93 3554.37 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 6.3078 26015.5 4604.68 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 9.8587 19617.76 7196.85 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 13.1791 23763.63 9620.73 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 10.0097 14705.99 7307.07 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 19 16.3376 3.4777 11926.43 2538.74 7751.18 7234.44 5465.12 4756.68
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 9.4991 24867.86 6934.34 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 34.4839 48643.62 25173.23 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 21.375 54523.17 15603.78 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 4 113.9328 28.2972 83170.94 20656.96 N/A N/A N/A N/A