Intel has announced Hala Point, a "neuromorphic system" that leverages a brain-like design to run artificial intelligence (AI) applications more efficiently than today's AI systems, the company asserts.
The company says the design vastly reduces energy consumption while also boosting performance compared to typical AI systems. The first Hala Point system, leveraging Intel's Loihi 2 processor, is deployed at Sandia National Laboratories.
Intel claims Loihi-based systems can "perform AI inference and solve optimization problems using 100 times less energy at speeds as much as 50 times faster than conventional CPU and GPU architectures."
It's unclear when such a system will be mass-produced to compete against Nvidia and other AI-focused chip companies. In a vaguely worded statement, Intel said it is working with research partners to progress this technology "from research prototypes to industry-leading commercial products over the coming years."
Related: Intel acquires Silicon Mobility for AI, EV energy efficiency
Intel Gaudi Accelerator Counters Nvidia
In the meantime, Intel is touting the Gaudi 3 accelerator to "bring performance, openness and choice to enterprise generative AI (GenAI)," the company said during its Vision 2024 conference on April 9 in Phoenix.
Intel claims the Gaudi 3 accelerator delivers 50% on average better inference and 40% on average better power efficiency than Nvidia H100 – at a fraction of the cost, the company added.
Although Nvidia is widely considered the AI processor market leader, Intel said only 10% of enterprise customers moved GenAI applications into production in 2023. Read between the lines, and Intel seems to be saying that it's too early to proclaim Nvidia as the AI hardware standard.
Still, Intel needs to prove that it's R&D, production, delivery and partner initiatives are back on track after several years of missteps. The company's revenue was $54.2 billion in 2023, down 14% from 2022. In stark contrast, Nvidia's revenue was $60.9 billion in 2023, up 126% from 2022.
What's Next: Intel is expected to announce Q1 2024 earnings on April 25. Nvidia's Q1 2024 earnings will likely arrive sometime in May. Longer term, watch for the Intel Vision EMEA 2024 conference (May 14-15, London) and the Intel Innovation 2024 conference (September 24-25, San Jose, California).
