Arm is now entering the data center and artificial intelligence (AI) chip arena with the launch of the Arm AGI CPU. It is developed entirely by Arm in collaboration with Meta specifically to run AI agent systems. This confirms rumors of Arm and Meta's collaboration that were reported last year.
Each Arm AGI CPU is equipped with up to 136 Neoverse V3 cores with 6GB/s memory bandwidth per core and latency of less than 100ns. A total of 8,160 cores can be placed in each rack if using air cooling and increasing to over 45,000 cores if using liquid cooling. According to Arm, the chip offers twice the performance per system compared to x8 systems
Meta is the main customer but the chip will also be used by OpenAI, Cloudflare, SAP, SK Telecom, F5, Rebellions, Positron. More than 50 companies also support the platform such as AWS, Google, Microsoft, NVIDIA, Samsung, TSMC, Broadcom, Micron, and Marvell.
In addition to the Arm AGI CPU, Google is also developing its own Arm-based data center chip called Axion with the goal of reducing power consumption by up to 60% compared to X86. Meanwhile, NVIDIA is offering the Arm-based NVIDIA Grace CPU Superchip from 2023.
