Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 54 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

✅ Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1454 365.55 106.14 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.144 310.95 105.11 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.1894 471.82 138.23 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 24 16 1.2252 0.3959 894.39 289 563.47 525.91 386.38 336.3
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 15 0.9799 0.3045 715.34 222.31 465.69 434.66 328.34 285.78
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 3 1.861 0.3786 1358.53 276.35 855.87 798.83 586.88 510.81
p2.xlarge 4 2.7 61 1 NVIDIA K80 12 11 1.2785 0.325 933.27 237.22 656.34 612.43 487.31 424.15
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1946 483.93 142.04 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2192 444.55 160.04 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 87 1.1511 0.2698 840.31 196.95 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 24 16 1.4761 0.4606 1077.54 336.25 678.85 633.6 465.5 405.15
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 15 1.1903 0.3844 868.93 280.6 565.68 527.96 398.84 347.14
p3.2xlarge 8 2.7 61 1 NVIDIA V100 16 12 3.6526 1.0314 2666.39 752.92 1838.38 1716 1073.65 934.53
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 3 2.2421 0.4468 1636.72 326.19 1031.13 962.42 707.06 615.42
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2449 720.67 178.75 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3685 712.21 269.01 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4269 1121.62 311.65 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 24 17 1.9927 0.5977 1454.7 436.29 909.61 848.97 623.74 542.88
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 15 1.6111 0.4762 1176.12 347.62 765.65 714.61 539.84 469.86
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 3 3.0042 0.5061 2193.1 369.43 1381.65 1289.5 947.42 824.61
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 15 1.8801 0.4855 1372.48 354.44 893.49 833.93 629.97 548.31
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4045 1194.14 295.25 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9513 0.6884 1424.41 502.51 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.7542 1951.87 550.57 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 24 17 3.0038 0.8272 2192.8 603.83 1371.14 1279.73 940.21 818.33
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 15 2.4527 0.7151 1790.49 522.05 1165.61 1087.91 821.83 715.3
p3.8xlarge 32 2.7 244 4 NVIDIA V100 64 12 14.6103 4.8479 10665.54 3538.99 7354.32 6864.03 4294.96 3738.13
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 3 4.5286 0.7244 3305.85 528.84 2082.68 1943.83 1428.13 1243
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 15 2.9882 0.7832 2181.42 571.72 1420.11 1325.43 1001.27 871.47
p2.8xlarge 32 2.7 488 8 NVIDIA K80 96 11 10.2276 7.3278 7466.17 5349.31 5251.29 4899.38 3898 3393.22
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 24 4.8068 1.5677 3508.99 1144.42 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 96 16 6.9079 2.4729 5042.74 1805.24 3176.93 2965.13 2178.47 1896.07
g6.12xlarge 48 3.4 192 4 NVIDIA L4 357 15 5.6029 1.4501 4090.1 1058.54 2662.66 2485.14 1877.36 1634
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 715 3 10.4926 1.6628 7659.63 1213.84 4825.56 4503.83 3308.96 2880.03
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.5618 2388.29 410.13 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.4714 2388.29 344.09 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.2696 2848.83 926.84 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 1.284 3903.74 937.33 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 24 16 4.9885 1.361 3641.59 993.52 2294.2 2141.25 1573.17 1369.24
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 15 4.1359 1.0094 3019.22 736.83 1965.52 1834.48 1385.82 1206.18
p3.16xlarge 64 2.7 488 8 NVIDIA V100 128 12 29.2207 10.7321 21331.09 7834.47 14708.65 13728.03 8589.67 7476.25
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 3 7.5772 0.9543 5531.35 696.66 3484.75 3252.42 2389.55 2079.78
p2.16xlarge 64 2.3 732 16 NVIDIA K80 192 11 20.4553 13.4332 14932.35 9806.22 10502.71 9798.77 7796.27 6786.45
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.2925 7010.22 2403.55 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 96 16 9.9185 3.1188 7240.5 2276.73 4561.51 4257.42 3127.9 2722.43
g6.24xlarge 96 3.4 384 4 NVIDIA L4 357 15 8.1277 1.9948 5933.21 1456.2 3862.52 3605.01 2723.34 2370.32
dl1.24xlarge 96 3 768 8 Habana Gaudi HL-205 256 2 13.109 1.405 9569.6 1025.61 6028.85 5626.92 4134.07 3598.17
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 715 3 15.0656 2.4187 10997.88 1765.63 6928.66 6466.75 4751.09 4135.19
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 13.1323 26015.5 9586.58 16106.96 15033.1 9082.42 7905.09
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 12 40.3835 20.4866 29479.96 14955.23 17970.71 16772.65 11421.87 9941.26
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 192 16 19.837 5.9303 14481 4329.09 9123.03 8514.83 6255.79 5444.86
g6.48xlarge 192 3.4 768 8 NVIDIA L4 1430 15 16.2554 3.5562 11866.42 2595.99 7725.04 7210.04 5446.69 4740.64
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 2861 3 30.1312 3.7774 21995.76 2757.5 13857.33 12933.5 9502.17 8270.42
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 13 116.4941 24.2728 85040.67 17719.11 N/A N/A 37813.42 32911.68