Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 69 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

โœ… Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0663 178.05 48.42 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1273 365.55 92.92 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.118 310.95 86.14 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2185 471.82 159.49 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4946 908.29 361.03 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.3586 718.28 261.8 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.098 209.34 71.57 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 12 2.1903 0.928 1598.94 677.41 1007.33 940.17 690.74 601.21
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1889 483.93 137.87 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2135 444.55 155.88 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2917 837.91 212.92 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.516 1094.28 376.69 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.404 872.51 294.88 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1949 418.68 142.25 N/A N/A N/A N/A
g7.2xlarge 8 3.9 32 1 NVIDIA RTX PRO 4500 32 3 2.52 0.5794 1839.6 422.93 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 12 2.6389 1.0405 1926.36 759.58 1213.61 1132.71 832.19 724.31
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 7 4.0701 1.4133 2971.18 1031.74 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2368 720.67 172.9 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3579 712.21 261.23 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4418 1121.62 322.49 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.7155 1475.28 522.28 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.5133 1180.96 374.72 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.48 837.35 350.42 N/A N/A N/A N/A
g7.4xlarge 16 3.9 64 1 NVIDIA RTX PRO 4500 32 3 3.0421 0.5243 2220.72 382.74 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 12 3.5359 1.052 2581.2 767.97 1626.15 1517.73 1115.08 970.53
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 8 4.9036 1.7492 3579.61 1276.94 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4026 1378.41 293.93 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.4899 939.6 357.64 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 5.4096 5775.76 3948.98 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.37 1194.14 270.08 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.5314 1424.41 387.95 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.582 1951.87 424.89 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.8753 2223.83 638.98 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.7465 1797.85 544.95 1168.5 1090.61 823.87 717.07
g7.8xlarge 32 3.9 128 1 NVIDIA RTX PRO 4500 32 3 4.0862 0.56 2982.96 408.84 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 12 5.33 1.2075 3890.87 881.44 2451.25 2287.83 1680.86 1462.97
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 8 6.4613 1.8774 4716.73 1370.5 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.6602 2190.84 481.95 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.6408 3532.98 1197.81 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 3.8453 5121.09 2807.05 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.6382 4106.93 1195.87 2669.26 2491.3 1882.01 1638.05
g7.12xlarge 48 3.9 192 2 NVIDIA RTX PRO 4500 64 3 7.1283 1.1531 5203.67 841.8 N/A N/A N/A N/A
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 12 12.3495 3.2274 9015.12 2355.98 5679.52 5300.88 3894.53 3389.69
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 7 10.028 2.8196 7320.43 2058.29 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.7706 2388.29 562.51 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.4992 2440.11 364.4 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.0679 2848.82 779.55 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.9508 3903.74 694.06 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.4035 3698.17 1024.58 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 1.1627 3031.65 848.74 1970.39 1839.03 1389.26 1209.17
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 12 8.9181 1.5515 6510.21 1132.59 4101.43 3827.99 2812.41 2447.84
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.0829 7010.22 2250.53 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 5.5742 7352.99 4069.17 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 1.941 5957.62 1416.92 3872.1 3613.95 2730.1 2376.19
g7.24xlarge 96 3.9 384 4 NVIDIA RTX PRO 4500 128 3 14.2566 1.9168 10407.35 1399.26 N/A N/A N/A N/A
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 12 17.7317 4.0545 12944.13 2959.78 8154.8 7611.14 5591.87 4866.99
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 14.9004 26015.5 10877.29 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 7 20.056 5.4871 14640.85 4005.6 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 13.1308 19617.76 9585.5 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 15.1238 23763.63 11040.34 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 12.0895 14705.99 8825.35 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 4.3982 11915.25 3210.65 7744.19 7227.92 5460.19 4752.39
g7.48xlarge 192 3.9 768 8 NVIDIA RTX PRO 4500 256 3 28.5133 3.5483 20814.69 2590.26 N/A N/A N/A N/A
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 12 35.4634 9.2633 25888.26 6762.18 16309.6 15222.31 11183.73 9733.99
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 7 40.1119 10.6615 29281.71 7782.88 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 34.2973 48643.62 25037.05 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 29.5112 54523.17 21543.15 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 7 121.5283 34.6025 88715.67 25259.84 N/A N/A N/A N/A
p6-b300.48xlarge 192 2.4 4096 8 NVIDIA B300 2148 4 151.9107 30.8426 110894.79 22515.1 N/A N/A N/A N/A