Arm agentic AI designs launch as company overtakes x86 in data centers
Arm has announced new Neoverse CSS N4 and AGI CPU designs aimed at supporting agentic AI workloads across cloud, edge, and physical systems. The company also introduced the Arm Total Design for Physical AI program and the Arm AI Portal to provide developers with optimized models and tools for its compute platform.
Key Takeaways
- Neoverse CSS N4 delivers 2x socket-level performance and 25% better performance per watt than the previous N3 generation
- Arm has shipped 500 million Neoverse cores in the last nine months, reaching a total of 1.5 billion since 2018
- The new Mali G2-Ultra NX GPU features dedicated neural accelerators providing 4x higher performance per watt for mobile graphics
- Arm Total Design for Physical AI now includes over 80 partners such as AWS, Siemens, and Lenovo to standardize robotics development
Why It Matters
The transition to agentic AI requires CPUs to handle complex orchestration, database retrieval, and tool calling rather than just model inference. By overtaking x86 in accelerated server revenue, Arm is positioning its architecture as the standard for heterogeneous AI infrastructure that spans from the data center to the physical edge. For the streaming and media ecosystem, this efficiency-first approach reduces the latency and token costs associated with cloud-only AI models. As these designs integrate into mobile and robotic systems, the industry should watch for the first wave of Arm AGI CPU-powered sandboxes from ByteDance's Volcano Engine to gauge real-world performance gains in agentic workloads.
Additional Context
Arm's Neoverse platform has become the default CPU choice for Nvidia's accelerated computing stack, a relationship that now defines the data center processor market. Nvidia's Grace CPU, built on Arm Neoverse cores, ships in every GB200 and GB300 NVL72 rack system, and Arm confirmed it surpassed x86 in accelerated server revenue during fiscal 2026, reaching $53 billion in the segment according to IDC data cited at launch. Google Cloud, Microsoft Azure, and AWS all now offer Arm-based instances for AI training and inference workloads, with AWS Graviton4 and Google Axion representing the hyperscaler custom-silicon wave that Arm's CSS program enables. The Neoverse CSS N4 specifically targets the orchestration and tool-calling layers of agentic AI pipelines, where CPU throughput per watt matters more than raw GPU FLOPS.
The competitive dynamics between Arm-based and x86 server CPUs have intensified as agentic AI workloads proliferate across enterprise deployments. Nokia and AWS announced in June 2026 that Nokia's Autonomous Network Fabric would run on AWS infrastructure from later that year, demonstrating how telco AI platforms are consolidating on cloud providers that increasingly rely on Arm-based compute for cost efficiency. Nokia's autonomous networks portfolio already reports automation rates above 90 percent and service delivery times under four hours, workloads that depend on CPU-intensive orchestration rather than GPU inference alone. Meanwhile, Ericsson launched its AI in RAN commercial software subscription on June 11, claiming up to 20 percent higher downlink throughput across more than 15 live deployments using existing baseband silicon, illustrating the CPU-bound nature of RAN intelligence that Arm's Neoverse roadmap addresses.
Technical benchmarks from early agentic AI deployments show that CPU architecture selection directly affects multi-agent orchestration latency and cost per token. Nokia and Google Cloud demonstrated six specialized AI agents at DTW Ignite 2026 that reduced network problem-solving times by 50 to 80 percent, with the router agent and event triage agent handling continuous reasoning loops that stress CPU throughput and memory bandwidth rather than GPU parallelism. The divergence between Ericsson and Nokia on AI-RAN hardware strategy further highlights the CPU question: , meaning Arm-based CPUs in Ericsson's architecture must handle significantly more baseband processing than in Nokia's GPU-centric design. This architectural split makes Arm's Neoverse CSS N4 performance claims particularly relevant for operators evaluating which vendor's compute model will scale more economically as moves from pilots to production.
Read full article at gamesbeat.com
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source