Amazon EC2 Instances with Accelerators

Amazon Web Services (AWS) offers 69 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.

โœ… Instance Picker with filter on GPU

Instance Type Accelerator Locations Avg. Costs per Hour Average Costs per Month
Name vCPU Base Clock Memory GPU Manufacturer Name Memory # On-Demand Spot On-Demand Spot 1Y RI (No) 1Y RI (All) 3Y RI (No) 3Y RI (All)
g6f.large 2 3.4 8 0 NVIDIA L4 2 13 0.2439 0.0672 178.05 49.07 N/A N/A N/A N/A
g5g.xlarge 4 2.5 8 1 NVIDIA T4g 16 7 0.5008 0.1247 365.55 91.02 238.73 222.82 168.73 146.86
g4ad.xlarge 4 3 16 1 AMD Radeon Pro V520 8 8 0.426 0.1168 310.95 85.27 204.71 191.07 166.12 144.58
g4dn.xlarge 4 2.5 16 1 NVIDIA T4 16 24 0.6463 0.2363 471.82 172.47 309.2 288.59 217.25 189.16
g5.xlarge 4 3.3 16 1 NVIDIA A10G 22 17 1.2442 0.4916 908.29 358.88 572.22 534.08 392.38 341.52
g6.xlarge 4 3.4 16 1 NVIDIA L4 22 20 0.984 0.3837 718.28 280.1 466.84 435.73 329.16 286.49
g6f.xlarge 4 3.4 16 0 NVIDIA L4 2 13 0.2868 0.1167 209.34 85.18 N/A N/A N/A N/A
g6e.xlarge 4 3.4 32 1 NVIDIA L40S 44 12 2.1903 1.0865 1598.94 793.11 1007.33 940.17 690.74 601.21
g5g.2xlarge 8 2.5 16 1 NVIDIA T4g 16 7 0.6629 0.1935 483.93 141.22 316.04 294.99 223.37 194.42
g4ad.2xlarge 8 3 32 1 AMD Radeon Pro V520 8 8 0.609 0.2213 444.55 161.58 292.67 273.14 237.5 206.71
g4dn.2xlarge 8 2.5 32 1 NVIDIA T4 16 89 1.1478 0.2994 837.91 218.55 442.09 412.6 310.66 270.43
g5.2xlarge 8 3.3 32 1 NVIDIA A10G 22 17 1.499 0.582 1094.28 424.85 689.4 643.44 472.73 411.45
g6.2xlarge 8 3.4 32 1 NVIDIA L4 22 20 1.1952 0.4307 872.51 314.42 567.08 529.26 399.83 348
g6f.2xlarge 8 3.4 32 0 NVIDIA L4 5 13 0.5735 0.1978 418.68 144.41 N/A N/A N/A N/A
g7.2xlarge 8 3.9 32 1 NVIDIA RTX PRO 4500 32 3 2.52 0.5624 1839.6 410.52 N/A N/A N/A N/A
g6e.2xlarge 8 3.4 64 1 NVIDIA L40S 44 12 2.6389 1.059 1926.36 773.08 1213.61 1132.71 832.19 724.31
g7e.2xlarge 8 2.4 64 1 NVIDIA RTX PRO Server 6000 96 10 4.4555 1.5675 3252.48 1144.27 N/A N/A N/A N/A
g5g.4xlarge 16 2.5 32 1 NVIDIA T4g 16 7 0.9872 0.2565 720.67 187.27 470.64 439.29 332.66 289.53
g4ad.4xlarge 16 3 64 1 AMD Radeon Pro V520 8 8 0.9756 0.3649 712.21 266.35 468.89 437.63 380.5 331.17
g4dn.4xlarge 16 2.5 64 1 NVIDIA T4 16 35 1.5365 0.4414 1121.62 322.19 707.75 660.61 497.48 432.98
g5.4xlarge 16 3.3 64 1 NVIDIA A10G 22 18 2.0209 0.8476 1475.28 618.71 923.75 862.16 633.43 551.32
g6.4xlarge 16 3.4 64 1 NVIDIA L4 22 20 1.6177 0.5602 1180.96 408.94 767.55 716.38 541.18 471.02
g6f.4xlarge 16 3.4 64 0 NVIDIA L4 11 13 1.1471 0.515 837.35 375.98 N/A N/A N/A N/A
g7.4xlarge 16 3.9 64 1 NVIDIA RTX PRO 4500 32 3 3.0421 0.618 2220.72 451.14 N/A N/A N/A N/A
g6e.4xlarge 16 3.4 128 1 NVIDIA L40S 44 12 3.5359 1.2979 2581.2 947.47 1626.15 1517.73 1115.08 970.53
g7e.4xlarge 16 2.4 128 1 NVIDIA RTX PRO Server 6000 96 11 5.3023 1.7016 3870.7 1242.18 N/A N/A N/A N/A
gr6.4xlarge 16 3.4 128 1 NVIDIA L4 22 18 1.8882 0.4288 1378.41 313.03 897.35 837.53 632.69 550.68
gr6f.4xlarge 16 3.4 128 0 NVIDIA L4 11 13 1.2871 0.4884 939.6 356.54 N/A N/A N/A N/A
p5.4xlarge 16 3.6 256 1 NVIDIA H100 80 10 7.912 6.5198 5775.76 4759.47 N/A N/A 2678.35 2331.15
g5g.8xlarge 32 2.5 64 1 NVIDIA T4g 16 7 1.6358 0.4057 1194.14 296.17 779.88 727.87 551.19 479.75
g4ad.8xlarge 32 3 128 2 AMD Radeon Pro V520 16 8 1.9512 0.5831 1424.41 425.64 937.78 875.27 761 662.36
g4dn.8xlarge 32 2.5 128 1 NVIDIA T4 16 24 2.6738 0.5874 1951.87 428.79 1279.21 1193.92 899.04 782.52
g5.8xlarge 32 3.3 128 1 NVIDIA A10G 22 18 3.0463 0.873 2223.83 637.31 1392.45 1299.61 954.82 831.05
g6.8xlarge 32 3.4 128 1 NVIDIA L4 22 20 2.4628 0.7734 1797.85 564.58 1168.5 1090.61 823.87 717.07
g7.8xlarge 32 3.9 128 1 NVIDIA RTX PRO 4500 32 3 4.0862 0.5707 2982.96 416.65 N/A N/A N/A N/A
g6e.8xlarge 32 3.4 256 1 NVIDIA L40S 44 12 5.33 1.4079 3890.87 1027.79 2451.25 2287.83 1680.86 1462.97
g7e.8xlarge 32 2.4 256 1 NVIDIA RTX PRO Server 6000 96 11 6.9867 2.0163 5100.29 1471.91 N/A N/A N/A N/A
gr6.8xlarge 32 3.4 256 1 NVIDIA L4 22 18 3.0012 0.6886 2190.84 502.7 1426.24 1331.16 1005.6 875.24
g4dn.12xlarge 48 2.5 192 4 NVIDIA T4 64 26 4.8397 1.7352 3532.98 1266.68 2299.72 2146.41 1616.32 1406.81
g5.12xlarge 48 3.3 192 4 NVIDIA A10G 89 17 7.0152 3.5065 5121.09 2559.74 3226.29 3011.2 2212.31 1925.53
g6.12xlarge 48 3.4 192 4 NVIDIA L4 89 20 5.6259 1.6543 4106.93 1207.66 2669.26 2491.3 1882.01 1638.05
g7.12xlarge 48 3.9 192 2 NVIDIA RTX PRO 4500 64 3 7.1283 1.394 5203.67 1017.58 N/A N/A N/A N/A
g6e.12xlarge 48 3.4 384 4 NVIDIA L40S 178 12 12.3495 3.5011 9015.12 2555.8 5679.52 5300.88 3894.53 3389.69
g7e.12xlarge 48 2.4 512 2 NVIDIA RTX PRO Server 6000 192 10 10.9774 3.239 8013.49 2364.44 N/A N/A N/A N/A
g5g.16xlarge 64 2.5 128 2 NVIDIA T4g 32 7 3.2716 0.6502 2388.29 474.68 1559.73 1455.74 1102.4 959.5
g5g.metal 64 2.5 128 2 NVIDIA T4g 32 8 3.3426 0.4546 2440.11 331.86 1559.73 1455.74 1102.4 959.5
g4ad.16xlarge 64 3 256 4 AMD Radeon Pro V520 32 8 3.9025 1.0611 2848.82 774.57 1875.55 1750.52 1522 1324.7
g4dn.16xlarge 64 2.5 256 1 NVIDIA T4 16 24 5.3476 0.9743 3903.74 711.24 2558.43 2387.83 1798.09 1565.04
g5.16xlarge 64 3.3 256 1 NVIDIA A10G 22 17 5.066 1.5246 3698.17 1112.93 2329.84 2174.52 1597.61 1390.51
g6.16xlarge 64 3.4 256 1 NVIDIA L4 22 20 4.1529 1.2459 3031.65 909.51 1970.39 1839.03 1389.26 1209.17
g6e.16xlarge 64 3.4 512 1 NVIDIA L40S 44 12 8.9181 2.102 6510.21 1534.48 4101.43 3827.99 2812.41 2447.84
g4dn.metal 96 2.5 384 8 NVIDIA T4 128 23 9.603 3.105 7010.22 2266.63 4605.57 4298.52 3244.43 2823.79
g5.24xlarge 96 3.3 384 4 NVIDIA A10G 89 17 10.0726 6.1362 7352.99 4479.42 4632.39 4323.57 3176.49 2764.72
g6.24xlarge 96 3.4 384 4 NVIDIA L4 89 20 8.1611 2.0221 5957.62 1476.15 3872.1 3613.95 2730.1 2376.19
g7.24xlarge 96 3.9 384 4 NVIDIA RTX PRO 4500 128 3 14.2566 1.5414 10407.35 1125.26 N/A N/A N/A N/A
g6e.24xlarge 96 3.4 768 4 NVIDIA L40S 178 12 17.7317 4.8116 12944.13 3512.44 8154.8 7611.14 5591.87 4866.99
p3dn.24xlarge 96 2.5 768 8 NVIDIA V100 256 6 35.6377 10.5093 26015.5 7671.83 16106.96 15033.1 9082.42 7905.09
g7e.24xlarge 96 2.4 1024 4 NVIDIA RTX PRO Server 6000 384 10 21.9548 6.245 16026.98 4558.83 N/A N/A N/A N/A
p4d.24xlarge 96 3 1152 8 NVIDIA A100 320 15 26.8736 13.9948 19617.76 10216.2 12372.15 11547.35 8703.51 7575.28
p4de.24xlarge 96 3 1152 8 NVIDIA A100 640 6 32.5529 16.0159 23763.63 11691.58 15141.78 14132.33 10592.37 9219.29
g5.48xlarge 192 3.3 768 8 NVIDIA A10G 178 17 20.1452 11.3885 14705.99 8313.59 9264.77 8647.13 6352.99 5529.45
g6.48xlarge 192 3.4 768 8 NVIDIA L4 178 20 16.3223 5.3352 11915.25 3894.7 7744.19 7227.92 5460.19 4752.39
g7.48xlarge 192 3.9 768 8 NVIDIA RTX PRO 4500 256 3 28.5133 3.8253 20814.69 2792.47 N/A N/A N/A N/A
g6e.48xlarge 192 3.4 1536 8 NVIDIA L40S 357 12 35.4634 12.3363 25888.26 9005.48 16309.6 15222.31 11183.73 9733.99
g7e.48xlarge 192 2.4 2048 8 NVIDIA RTX PRO Server 6000 768 10 43.9095 12.8113 32053.97 9352.25 N/A N/A N/A N/A
p5.48xlarge 192 3.6 2048 8 NVIDIA H100 640 15 66.6351 35.5111 48643.62 25923.1 N/A N/A 21069.23 18338.03
p5en.48xlarge 192 2.4 2048 8 NVIDIA H200 1128 13 74.6893 35.2028 54523.17 25698.06 N/A N/A N/A N/A
p6-b200.48xlarge 192 2.4 2048 8 NVIDIA B200 1432 7 121.5283 42.5337 88715.67 31049.63 N/A N/A N/A N/A
p6-b300.48xlarge 192 2.4 4096 8 NVIDIA B300 2148 4 151.9107 38.628 110894.79 28198.42 N/A N/A N/A N/A