AMD and HPE leverage EPYC processors for energy-efficient AI inference

The streaming industry’s shift toward AI-driven personalization and real-time metadata processing requires a massive increase in edge compute capacity. While AI and 5G are inherently power-hungry, this collaboration demonstrates that silicon-level gains and workload pooling can decouple traffic growth from energy consumption. For streaming strategists, this efficiency is critical for maintaining the margins of localized ad insertion and low-latency delivery. As networks progress toward 6G, the success of high-bandwidth video services will depend on 'deterministic' performance—ensuring consistent, low-latency streams without exceeding restricted utility budgets. Watch for whether performance-per-watt becomes a standardized KPI in vendor SLAs by 2027.

The emphasis on compute density and performance-per-watt reflects a broader industry trend toward sustainable network scaling as AI adoption accelerates. According to the GSMA’s July 2024 'Mobile Net Zero' report, mobile operators globally reduced operational emissions by 13% between 2019 and 2023, even as data traffic more than quadrupled. This progress is largely attributed to network modernization and the transition to energy-efficient 5G gear. However, the report warns that the power-intensive nature of generative AI training and large-scale inference requires a more aggressive shift toward renewable energy and intelligent power management to meet 2030 science-based targets.

Technological solutions are already entering the market to address these needs. In June 2024, Ericsson launched its 'AI in RAN' software, which uses telco-grade AI models to optimize baseband energy savings by up to 20% during low-traffic periods. Similarly, Nokia announced a 5G expansion deal with Taiwan Mobile in July 2024 that specifically integrates AI-driven energy management algorithms to enable 'traffic-aware' optimization. These software-defined approaches complement the hardware gains cited by AMD, showing a dual-track strategy where silicon efficiency provides the floor, and AI-driven automation provides the ceiling for operational savings.

Energy remains a dominant factor in 6G research and development. Per recent filings and industry briefings from the AI-RAN Alliance, early 6G specifications are being designed with 'AI-native' sensing and native sustainability metrics. As vendors like HPE and AMD move from node-level to rack-scale efficiency, the focus is shifting toward total cost of ownership (TCO) mid-lifecycle. AMD claims its latest EPYC systems can offer up to 67% lower three-year TCO compared to legacy competitive systems, a figure that is increasingly persuasive for telcos balancing capital expenditures with carbon-neutrality pledges.