Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 60 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 11 0.245 0.0624 178.86 45.55 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1759 365.55 128.38 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1492 310.95 108.92 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2043 471.82 149.17 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 16 1.2252 0.4507 894.39 329.03 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 19 0.9849 0.3326 718.96 242.79 467.26 436.13 329.45 286.74
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 11 0.2881 0.0808 210.29 58.99 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 8 2.104 0.8127 1535.92 593.28 967.63 903.13 663.52 577.51
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.2454 483.93 179.15 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2354 444.55 171.83 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.264 837.91 192.73 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 16 1.4761 0.5059 1077.54 369.31 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 19 1.1963 0.4206 873.33 307.01 567.59 529.74 400.19 348.32
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 11 0.5761 0.1676 420.58 122.34 N/A N/A N/A N/A
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.1545 2666.39 842.79 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 8 2.5348 0.967 1850.43 705.88 1165.77 1088.06 799.39 695.77
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.3234 720.67 236.07 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.39 712.21 284.72 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4544 1121.62 331.69 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 17 1.9927 0.6246 1454.7 455.99 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 19 1.6193 0.5318 1182.07 388.2 768.24 717.03 541.66 471.45
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 11 1.1523 0.327 841.15 238.72 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 8 3.3965 1.1619 2479.46 848.17 1562.06 1457.91 1071.13 932.28
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 17 1.8852 0.5755 1376.18 420.09 895.9 836.18 631.67 549.79
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 11 1.293 0.3482 943.87 254.22 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 1.7642 5775.76 1287.85 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.541 1194.14 394.96 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.7161 1424.41 522.78 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7385 1951.87 539.08 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 17 3.0038 0.9814 2192.8 716.39 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 19 2.4651 0.8017 1799.54 585.22 1169.55 1091.59 824.61 717.72
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.2592 10665.54 3109.24 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 8 5.1199 1.6631 3737.51 1214.08 2354.63 2197.65 1614.6 1405.3
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 17 2.9963 0.8848 2187.3 645.94 1423.93 1329.01 1003.97 873.82
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.4537 3508.99 1061.19 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 16 6.9079 2.4914 5042.74 1818.69 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 19 5.6312 2.1286 4110.79 1553.85 2671.67 2493.55 1883.71 1639.53
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 8 11.8627 4.8536 8659.78 3543.14 5455.66 5091.94 3741.03 3256.08
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.9723 2388.29 709.78 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.9095 2388.29 663.91 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.2308 2848.82 898.45 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.3156 3903.74 960.38 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 16 4.9885 1.869 3641.59 1364.35 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 19 4.1568 1.5334 3034.49 1119.36 1972.17 1840.69 1390.51 1210.26
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 13.5207 21331.09 9870.13 N/A N/A N/A N/A
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 8 8.5666 3.239 6253.61 2364.47 3939.77 3677.1 2701.56 2351.36
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.2917 7010.22 2402.91 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 16 9.9185 3.9614 7240.5 2891.81 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 19 8.1688 3.0109 5963.22 2197.97 3875.59 3617.21 2732.56 2378.34
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 4.2302 9569.6 3088.08 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 8 17.0328 6.5454 12433.93 4778.17 7833.37 7311.15 5371.46 4675.16
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 13.0626 26015.5 9535.7 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 13 26.9975 8.2266 19708.19 6005.41 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 15.7177 23763.63 11473.91 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 16 19.837 8.7769 14481 6407.15 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 19 16.3376 5.6355 11926.43 4113.91 7751.18 7234.44 5465.12 4756.68
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 8 34.0656 12.3714 24867.86 9031.16 15666.75 14622.3 10742.91 9350.32
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 14 65.9694 20.2432 48157.64 14777.54 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 12 74.6893 18.5318 54523.17 13528.21 N/A N/A 23953.23 20848.19
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 3 113.9328 28.4257 83170.94 20750.74 N/A N/A N/A N/A