Amazon EC2 Instances with Accelerators
Amazon Web Services (AWS) offers 69 Amazon Elastic Compute Cloud (EC2) instance types with graphics processing units (GPUs). Not every Amazon EC2 instance with GPU is available in every AWS location.
โ Instance Picker with filter on GPU
| Instance Type | Accelerator | Locations | Avg. Costs per Hour | Average Costs per Month | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Name | vCPU | Base Clock | Memory | GPU | Manufacturer | Name | Memory | # | On-Demand | Spot | On-Demand | Spot | 1Y RI (No) | 1Y RI (All) | 3Y RI (No) | 3Y RI (All) |
g6f.large |
2 | 3.4 | 8 | 0 | NVIDIA | L4 | 2 | 13 | 0.2439 | 0.0885 | 178.05 | 64.58 | N/A | N/A | N/A | N/A |
g5g.xlarge |
4 | 2.5 | 8 | 1 | NVIDIA | T4g | 16 | 7 | 0.5008 | 0.1368 | 365.55 | 99.9 | 238.73 | 222.82 | 168.73 | 146.86 |
g4ad.xlarge |
4 | 3 | 16 | 1 | AMD | Radeon Pro V520 | 8 | 8 | 0.426 | 0.1192 | 310.95 | 87.03 | 204.71 | 191.07 | 166.12 | 144.58 |
g4dn.xlarge |
4 | 2.5 | 16 | 1 | NVIDIA | T4 | 16 | 24 | 0.6463 | 0.234 | 471.82 | 170.82 | 309.2 | 288.59 | 217.25 | 189.16 |
g5.xlarge |
4 | 3.3 | 16 | 1 | NVIDIA | A10G | 22 | 19 | 1.2363 | 0.4846 | 902.47 | 353.79 | 572.22 | 534.08 | 392.38 | 341.52 |
g6.xlarge |
4 | 3.4 | 16 | 1 | NVIDIA | L4 | 22 | 20 | 0.984 | 0.3976 | 718.28 | 290.22 | 466.84 | 435.73 | 329.16 | 286.49 |
g6f.xlarge |
4 | 3.4 | 16 | 0 | NVIDIA | L4 | 2 | 13 | 0.2868 | 0.1338 | 209.34 | 97.7 | N/A | N/A | N/A | N/A |
g6e.xlarge |
4 | 3.4 | 32 | 1 | NVIDIA | L40S | 44 | 12 | 2.1903 | 1.0735 | 1598.94 | 783.67 | 1007.33 | 940.17 | 690.74 | 601.21 |
g5g.2xlarge |
8 | 2.5 | 16 | 1 | NVIDIA | T4g | 16 | 7 | 0.6629 | 0.2354 | 483.93 | 171.86 | 316.04 | 294.99 | 223.37 | 194.42 |
g4ad.2xlarge |
8 | 3 | 32 | 1 | AMD | Radeon Pro V520 | 8 | 8 | 0.609 | 0.2097 | 444.55 | 153.08 | 292.67 | 273.14 | 237.5 | 206.71 |
g4dn.2xlarge |
8 | 2.5 | 32 | 1 | NVIDIA | T4 | 16 | 89 | 1.1478 | 0.297 | 837.91 | 216.81 | 442.09 | 412.6 | 310.66 | 270.43 |
g5.2xlarge |
8 | 3.3 | 32 | 1 | NVIDIA | A10G | 22 | 19 | 1.4894 | 0.5535 | 1087.27 | 404.04 | 689.4 | 643.44 | 472.73 | 411.45 |
g6.2xlarge |
8 | 3.4 | 32 | 1 | NVIDIA | L4 | 22 | 20 | 1.1952 | 0.4145 | 872.51 | 302.6 | 567.08 | 529.26 | 399.83 | 348 |
g6f.2xlarge |
8 | 3.4 | 32 | 0 | NVIDIA | L4 | 5 | 13 | 0.5735 | 0.2272 | 418.68 | 165.87 | N/A | N/A | N/A | N/A |
g7.2xlarge |
8 | 3.9 | 32 | 1 | NVIDIA | RTX PRO 4500 | 32 | 4 | 2.5515 | 0.7927 | 1862.59 | 578.65 | N/A | N/A | N/A | N/A |
g6e.2xlarge |
8 | 3.4 | 64 | 1 | NVIDIA | L40S | 44 | 12 | 2.6389 | 1.1204 | 1926.36 | 817.89 | 1213.61 | 1132.71 | 832.19 | 724.31 |
g7e.2xlarge |
8 | 2.4 | 64 | 1 | NVIDIA | RTX PRO Server 6000 | 96 | 10 | 4.4555 | 1.5132 | 3252.48 | 1104.64 | N/A | N/A | N/A | N/A |
g5g.4xlarge |
16 | 2.5 | 32 | 1 | NVIDIA | T4g | 16 | 7 | 0.9872 | 0.3083 | 720.67 | 225.08 | 470.64 | 439.29 | 332.66 | 289.53 |
g4ad.4xlarge |
16 | 3 | 64 | 1 | AMD | Radeon Pro V520 | 8 | 8 | 0.9756 | 0.352 | 712.21 | 256.96 | 468.89 | 437.63 | 380.5 | 331.17 |
g4dn.4xlarge |
16 | 2.5 | 64 | 1 | NVIDIA | T4 | 16 | 35 | 1.5365 | 0.4312 | 1121.62 | 314.79 | 707.75 | 660.61 | 497.48 | 432.98 |
g5.4xlarge |
16 | 3.3 | 64 | 1 | NVIDIA | A10G | 22 | 20 | 2.0075 | 0.7571 | 1465.46 | 552.68 | 923.75 | 862.16 | 633.43 | 551.32 |
g6.4xlarge |
16 | 3.4 | 64 | 1 | NVIDIA | L4 | 22 | 20 | 1.6177 | 0.5611 | 1180.96 | 409.62 | 767.55 | 716.38 | 541.18 | 471.02 |
g6f.4xlarge |
16 | 3.4 | 64 | 0 | NVIDIA | L4 | 11 | 13 | 1.1471 | 0.5104 | 837.35 | 372.59 | N/A | N/A | N/A | N/A |
g7.4xlarge |
16 | 3.9 | 64 | 1 | NVIDIA | RTX PRO 4500 | 32 | 4 | 3.0801 | 0.9302 | 2248.48 | 679.08 | N/A | N/A | N/A | N/A |
g6e.4xlarge |
16 | 3.4 | 128 | 1 | NVIDIA | L40S | 44 | 12 | 3.5359 | 1.3226 | 2581.2 | 965.49 | 1626.15 | 1517.73 | 1115.08 | 970.53 |
g7e.4xlarge |
16 | 2.4 | 128 | 1 | NVIDIA | RTX PRO Server 6000 | 96 | 11 | 5.3023 | 1.7468 | 3870.7 | 1275.16 | N/A | N/A | N/A | N/A |
gr6.4xlarge |
16 | 3.4 | 128 | 1 | NVIDIA | L4 | 22 | 18 | 1.8882 | 0.4879 | 1378.41 | 356.17 | 897.35 | 837.53 | 632.69 | 550.68 |
gr6f.4xlarge |
16 | 3.4 | 128 | 0 | NVIDIA | L4 | 11 | 13 | 1.2871 | 0.5062 | 939.6 | 369.51 | N/A | N/A | N/A | N/A |
p5.4xlarge |
16 | 3.6 | 256 | 1 | NVIDIA | H100 | 80 | 10 | 7.912 | 6.542 | 5775.76 | 4775.63 | N/A | N/A | 2678.35 | 2331.15 |
g5g.8xlarge |
32 | 2.5 | 64 | 1 | NVIDIA | T4g | 16 | 7 | 1.6358 | 0.4425 | 1194.14 | 323.06 | 779.88 | 727.87 | 551.19 | 479.75 |
g4ad.8xlarge |
32 | 3 | 128 | 2 | AMD | Radeon Pro V520 | 16 | 8 | 1.9512 | 0.6112 | 1424.41 | 446.19 | 937.78 | 875.27 | 761 | 662.36 |
g4dn.8xlarge |
32 | 2.5 | 128 | 1 | NVIDIA | T4 | 16 | 24 | 2.6738 | 0.614 | 1951.87 | 448.21 | 1279.21 | 1193.92 | 899.04 | 782.52 |
g5.8xlarge |
32 | 3.3 | 128 | 1 | NVIDIA | A10G | 22 | 20 | 3.026 | 0.9375 | 2209.02 | 684.4 | 1392.45 | 1299.61 | 954.82 | 831.05 |
g6.8xlarge |
32 | 3.4 | 128 | 1 | NVIDIA | L4 | 22 | 20 | 2.4628 | 0.728 | 1797.85 | 531.41 | 1168.5 | 1090.61 | 823.87 | 717.07 |
g7.8xlarge |
32 | 3.9 | 128 | 1 | NVIDIA | RTX PRO 4500 | 32 | 4 | 4.1373 | 1.0304 | 3020.24 | 752.21 | N/A | N/A | N/A | N/A |
g6e.8xlarge |
32 | 3.4 | 256 | 1 | NVIDIA | L40S | 44 | 12 | 5.33 | 1.4951 | 3890.87 | 1091.42 | 2451.25 | 2287.83 | 1680.86 | 1462.97 |
g7e.8xlarge |
32 | 2.4 | 256 | 1 | NVIDIA | RTX PRO Server 6000 | 96 | 11 | 6.9867 | 2.0353 | 5100.29 | 1485.78 | N/A | N/A | N/A | N/A |
gr6.8xlarge |
32 | 3.4 | 256 | 1 | NVIDIA | L4 | 22 | 18 | 3.0012 | 0.721 | 2190.84 | 526.34 | 1426.24 | 1331.16 | 1005.6 | 875.24 |
g4dn.12xlarge |
48 | 2.5 | 192 | 4 | NVIDIA | T4 | 64 | 26 | 4.8397 | 1.679 | 3532.98 | 1225.65 | 2299.72 | 2146.41 | 1616.32 | 1406.81 |
g5.12xlarge |
48 | 3.3 | 192 | 4 | NVIDIA | A10G | 89 | 19 | 6.9702 | 3.0544 | 5088.28 | 2229.72 | 3226.29 | 3011.2 | 2212.31 | 1925.53 |
g6.12xlarge |
48 | 3.4 | 192 | 4 | NVIDIA | L4 | 89 | 20 | 5.6259 | 1.7776 | 4106.93 | 1297.65 | 2669.26 | 2491.3 | 1882.01 | 1638.05 |
g7.12xlarge |
48 | 3.9 | 192 | 2 | NVIDIA | RTX PRO 4500 | 64 | 4 | 7.2174 | 1.7063 | 5268.72 | 1245.58 | N/A | N/A | N/A | N/A |
g6e.12xlarge |
48 | 3.4 | 384 | 4 | NVIDIA | L40S | 178 | 12 | 12.3495 | 4.4539 | 9015.12 | 3251.35 | 5679.52 | 5300.88 | 3894.53 | 3389.69 |
g7e.12xlarge |
48 | 2.4 | 512 | 2 | NVIDIA | RTX PRO Server 6000 | 192 | 10 | 10.9774 | 3.1907 | 8013.49 | 2329.22 | N/A | N/A | N/A | N/A |
g5g.16xlarge |
64 | 2.5 | 128 | 2 | NVIDIA | T4g | 32 | 7 | 3.2716 | 0.6412 | 2388.29 | 468.04 | 1559.73 | 1455.74 | 1102.4 | 959.5 |
g5g.metal |
64 | 2.5 | 128 | 2 | NVIDIA | T4g | 32 | 8 | 3.3426 | 0.5458 | 2440.11 | 398.41 | 1559.73 | 1455.74 | 1102.4 | 959.5 |
g4ad.16xlarge |
64 | 3 | 256 | 4 | AMD | Radeon Pro V520 | 32 | 8 | 3.9025 | 1.0737 | 2848.82 | 783.8 | 1875.55 | 1750.52 | 1522 | 1324.7 |
g4dn.16xlarge |
64 | 2.5 | 256 | 1 | NVIDIA | T4 | 16 | 24 | 5.3476 | 0.9835 | 3903.74 | 717.99 | 2558.43 | 2387.83 | 1798.09 | 1565.04 |
g5.16xlarge |
64 | 3.3 | 256 | 1 | NVIDIA | A10G | 22 | 19 | 5.0335 | 1.5002 | 3674.47 | 1095.11 | 2329.84 | 2174.52 | 1597.61 | 1390.51 |
g6.16xlarge |
64 | 3.4 | 256 | 1 | NVIDIA | L4 | 22 | 20 | 4.1529 | 1.1637 | 3031.65 | 849.49 | 1970.39 | 1839.03 | 1389.26 | 1209.17 |
g6e.16xlarge |
64 | 3.4 | 512 | 1 | NVIDIA | L40S | 44 | 12 | 8.9181 | 2.0262 | 6510.21 | 1479.14 | 4101.43 | 3827.99 | 2812.41 | 2447.84 |
g4dn.metal |
96 | 2.5 | 384 | 8 | NVIDIA | T4 | 128 | 23 | 9.603 | 3.2832 | 7010.22 | 2396.72 | 4605.57 | 4298.52 | 3244.43 | 2823.79 |
g5.24xlarge |
96 | 3.3 | 384 | 4 | NVIDIA | A10G | 89 | 19 | 10.0081 | 6.5139 | 7305.88 | 4755.13 | 4632.39 | 4323.57 | 3176.49 | 2764.72 |
g6.24xlarge |
96 | 3.4 | 384 | 4 | NVIDIA | L4 | 89 | 20 | 8.1611 | 2.6208 | 5957.62 | 1913.19 | 3872.1 | 3613.95 | 2730.1 | 2376.19 |
g7.24xlarge |
96 | 3.9 | 384 | 4 | NVIDIA | RTX PRO 4500 | 128 | 4 | 14.4348 | 3.6012 | 10537.44 | 2628.84 | N/A | N/A | N/A | N/A |
g6e.24xlarge |
96 | 3.4 | 768 | 4 | NVIDIA | L40S | 178 | 12 | 17.7317 | 5.6425 | 12944.13 | 4119.02 | 8154.8 | 7611.14 | 5591.87 | 4866.99 |
p3dn.24xlarge |
96 | 2.5 | 768 | 8 | NVIDIA | V100 | 256 | 6 | 35.6377 | 7.2636 | 26015.5 | 5302.39 | 16106.96 | 15033.1 | 9082.42 | 7905.09 |
g7e.24xlarge |
96 | 2.4 | 1024 | 4 | NVIDIA | RTX PRO Server 6000 | 384 | 10 | 21.9548 | 6.9295 | 16026.98 | 5058.53 | N/A | N/A | N/A | N/A |
p4d.24xlarge |
96 | 3 | 1152 | 8 | NVIDIA | A100 | 320 | 15 | 26.8736 | 15.0387 | 19617.76 | 10978.23 | 12372.15 | 11547.35 | 8703.51 | 7575.28 |
p4de.24xlarge |
96 | 3 | 1152 | 8 | NVIDIA | A100 | 640 | 6 | 32.5529 | 20.3902 | 23763.63 | 14884.81 | 15141.78 | 14132.33 | 10592.37 | 9219.29 |
g5.48xlarge |
192 | 3.3 | 768 | 8 | NVIDIA | A10G | 178 | 19 | 20.0161 | 11.6662 | 14611.76 | 8516.32 | 9264.77 | 8647.13 | 6352.99 | 5529.45 |
g6.48xlarge |
192 | 3.4 | 768 | 8 | NVIDIA | L4 | 178 | 20 | 16.3223 | 5.2419 | 11915.25 | 3826.59 | 7744.19 | 7227.92 | 5460.19 | 4752.39 |
g7.48xlarge |
192 | 3.9 | 768 | 8 | NVIDIA | RTX PRO 4500 | 256 | 4 | 28.8697 | 6.5657 | 21074.88 | 4793 | N/A | N/A | N/A | N/A |
g6e.48xlarge |
192 | 3.4 | 1536 | 8 | NVIDIA | L40S | 357 | 12 | 35.4634 | 16.4222 | 25888.26 | 11988.21 | 16309.6 | 15222.31 | 11183.73 | 9733.99 |
g7e.48xlarge |
192 | 2.4 | 2048 | 8 | NVIDIA | RTX PRO Server 6000 | 768 | 10 | 43.9095 | 13.167 | 32053.97 | 9611.93 | N/A | N/A | N/A | N/A |
p5.48xlarge |
192 | 3.6 | 2048 | 8 | NVIDIA | H100 | 640 | 15 | 66.6351 | 34.1904 | 48643.62 | 24958.98 | N/A | N/A | 21069.23 | 18338.03 |
p5en.48xlarge |
192 | 2.4 | 2048 | 8 | NVIDIA | H200 | 1128 | 13 | 74.6893 | 32.1581 | 54523.17 | 23475.44 | N/A | N/A | N/A | N/A |
p6-b200.48xlarge |
192 | 2.4 | 2048 | 8 | NVIDIA | B200 | 1432 | 7 | 121.5283 | 44.7899 | 88715.67 | 32696.64 | N/A | N/A | N/A | N/A |
p6-b300.48xlarge |
192 | 2.4 | 4096 | 8 | NVIDIA | B300 | 2148 | 4 | 151.9107 | 46.9333 | 110894.79 | 34261.28 | N/A | N/A | N/A | N/A |