Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 60 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0472 178.05 34.48 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1371 365.55 100.09 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1329 310.95 97.04 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2097 471.82 153.08 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 16 1.2252 0.4332 894.39 316.21 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 19 0.9849 0.3609 718.96 263.44 467.26 436.13 329.45 286.74
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.0831 209.34 60.63 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.7631 1535.92 557.05 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2272 483.93 165.84 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2279 444.55 166.38 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2818 837.91 205.73 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 16 1.4761 0.538 1077.54 392.76 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 19 1.1963 0.4079 873.33 297.76 567.59 529.74 400.19 348.32
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1699 418.68 124.06 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 0.7912 2666.39 577.61 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 0.9164 1850.43 668.94 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2541 720.67 185.47 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3771 712.21 275.26 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4483 1121.62 327.25 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 17 1.9927 0.6722 1454.7 490.67 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 19 1.6193 0.5028 1182.07 367.07 768.24 717.03 541.66 471.45
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.3125 837.35 228.14 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 0.9857 2479.46 719.52 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4702 1378.41 343.23 895.9 836.18 631.67 549.79
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.3346 939.6 244.29 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 6.39 5775.76 4664.69 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.3824 1194.14 279.16 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.6601 1424.41 481.88 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.5871 1951.87 428.56 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 17 3.0038 0.8329 2192.8 607.99 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 19 2.4651 0.7352 1799.54 536.7 1169.55 1091.59 824.61 717.72
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 2.8352 10665.54 2069.72 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.2373 3737.51 903.22 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.6831 2190.84 498.67 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.4841 3532.98 1083.39 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 16 6.9079 2.335 5042.74 1704.52 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 19 5.6312 1.6971 4110.79 1238.85 2671.67 2493.55 1883.71 1639.53
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 3.175 8659.78 2317.72 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.5157 2388.29 376.48 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.4649 2440.11 339.41 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.0626 2848.82 775.7 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.9013 3903.74 657.92 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 16 4.9885 1.0202 3641.59 744.72 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 19 4.1568 0.9904 3034.49 722.99 1972.17 1840.69 1390.51 1210.26
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 15.9542 21331.09 11646.57 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 1.8036 6253.61 1316.6 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.2766 7010.22 2391.92 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 16 9.9185 4.407 7240.5 3217.11 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 19 8.1688 1.9785 5963.22 1444.28 3875.59 3617.21 2732.56 2378.34
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 2.6405 9569.6 1927.57 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 4.3538 12433.93 3178.29 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 7.9468 26015.5 5801.18 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 10.4816 19617.76 7651.53 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 17.7208 23763.63 12936.16 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 16 19.837 10.1528 14481 7411.55 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 19 16.3376 3.3231 11926.43 2425.84 7751.18 7234.44 5465.12 4756.68
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 7.9779 24867.86 5823.83 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 14 65.9694 21.6243 48157.64 15785.77 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 12 74.6893 18.3296 54523.17 13380.61 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 4 113.9328 29.8437 83170.94 21785.86 N/A N/A N/A N/A