Intel unveils Gaudi 3 accelerator at Vision 2024, aiming to revolutionize enterprise GenAI adoption

Intel Corporation unveiled its latest innovation, the Intel Gaudi 3 accelerator, at the Intel Vision 2024 customer and partner conference. The new accelerator is designed to enhance performance, openness, and choice within enterprise generative AI (GenAI). This launch is a response to the challenges businesses face in scaling AI initiatives, particularly as only 10% of enterprises successfully moved GenAI projects into production last year.

The introduction of the Intel Gaudi 3 AI accelerator marks a significant advancement in the field of artificial intelligence. According to Intel CEO Pat Gelsinger, the rapid pace of innovation in silicon technology is transforming every company into an AI company. Intel’s latest platforms, including the Gaudi, Xeon, and Core Ultra, aim to provide flexible solutions that meet the dynamic needs of customers and partners.

The Gaudi 3 accelerator promises to deliver four times more AI compute for BF16 and a 1.5 times increase in memory bandwidth over its predecessor, making it a formidable competitor against Nvidia’s H100. This enhancement could lead to 50% faster training times on average for models like Llama2 and GPT-3, and improve inference throughput and power-efficiency significantly.

Intel also outlined its strategy for open scalable AI systems, encompassing hardware, software, frameworks, and tools. This approach is designed to support a broad ecosystem of AI players and provide tailored solutions that meet specific enterprise GenAI needs. Collaborations with OEMs such as Dell Technologies, Hewlett Packard Enterprise, Lenovo, and Supermicro are set to begin in the second quarter of 2024, ensuring that these powerful tools are accessible to a wide range of industries.

Several strategic partnerships highlight the widespread adoption and versatility of the Intel Gaudi accelerators. Companies like NAVER, Bosch, IBM, and Bharti Airtel have integrated these accelerators to enhance their AI capabilities across various applications, from cloud solutions to smart manufacturing.

Intel’s initiative to create an open platform for enterprise AI, in collaboration with industry leaders like Google Cloud and SAP, signifies a move towards developing multivendor GenAI systems that emphasize ease of deployment and performance. This open ecosystem approach not only facilitates the adoption of AI technologies but also accelerates the delivery of business results across sectors.

As enterprises increasingly adopt AI technologies, Intel’s comprehensive suite of solutions—from the Intel Gaudi 3 accelerator to the latest Intel Xeon 6 processors—positions the company as a leader in the AI revolution. By providing cutting-edge technology and fostering a robust ecosystem of partnerships, Intel is setting new standards for what businesses can achieve with AI.