A ‘hard’-ware look at AI

Nvidia has launched four inference platforms optimized for a diverse set of rapidly emerging generative AI. The platforms combine Nvidia’s full stack of inference software with the latest Ada, Hopper, and Grace Hopper processors, including the Nvidia L4 Tensor core GPU and the H100 NVL GPU (pictured third from left), which also just launched. (Source: Nvidia) As usual, Nvidia had a lot of news to discuss at GTC, and company CEO Jensen Huang kept the cadence steady and continuously flowing as he ticked off one announcement after another. This year, there was a heavy focus on AI, particularly AI software, but, with Nvidia