According to Stocklytics.com, these power-hungry processors are projected to consume a staggering 13,797 GWh in 2024, exceeding the annual energy consumption of nations like Georgia and Costa Rica. 

These findings bring up concerns about the environmental impact and sustainability of this AI advancement.

Stocklytics Financial analyst Edith Reads commented on the analysis:

AI, which often requires running computations on gigabytes of data, needs enormous computing power compared with ordinary workloads. And, Nvidia’s cutting-edge H100 AI GPUs are leading the way with energy consumption of over 13,000 GWh this year. Each H100 GPU, running at 61% annual utilization, consumes roughly 3,740 kilowatt-hours (kWh) of electricity annually. This is equivalent to the average American household. While this figure might seem alarming, GPU efficiency may improve in the near future, offering a potential path towards more sustainable computing.

Stocklytics Financial analyst Edith Reads

Nvidia, a leading player in AI chip design, is broadening its scope by venturing into custom chip development for cloud computing and AI applications. The firm is now looking to tap into the growing custom chip sector, projected to reach $10 billion this year and double by 2025. The full story and statistics can be found here: Nvidia’s H100 Microchips Projected to Consume Over 13,000 GWH in 2024, Surpassing Energy Consumption of Entire Nations Like Georgia and Costa Rica