Over the past 5 years, the average server rack density increased from 5kW to 8-10kW, prompting temperature rises in the data center. These temperature increases can become a major issue if not handled properly. Maintaining the correct temperature is extremely important because nearly 30% of unplanned data center outages are caused by environment issues. Not monitoring and analyzing your environment can have a negative impact on energy and resource efficiency.

This week, NVIDIA unveiled what they are calling “the world’s most powerful GPU for supercharging AI and HPC workloads,” the H200 Tensor Core GPU. There is much hype around the H200 as it is the first GPU with HBM3e. The larger and faster memory will further enable generative AI, large language models, and advance scientific computing for HPC workloads. Read the NVIDIA press release.