Rohde & Schwarz and China Mobile Benchmark Generative AI User Experience
Rohde & Schwarz and the China Mobile Research Institute demonstrated a testbed at MWC Shanghai 2026 designed to measure generative AI performance on devices under various 5G network conditions. The system utilizes the CMX500 signaling tester to evaluate key metrics like time to first token and tokens per second, aiming to establish standardized testing frameworks for future 6G-enabled AI applications.
Key Takeaways
- The testbed utilizes the CMX500 5G one-box signaling tester to simulate radio environments ranging from ideal coverage to weak-signal edge conditions.
- Engineers can measure specific performance metrics including Time to First Token (TTFT) and Tokens Per Second (TPS) for cloud-based and server-side models.
- The CMX500 platform supports SA and NSA architectures across frequency ranges FR1 to FR3, facilitating 5G-Advanced and early 6G research.
- Testing variables include network latency, jitter, channel fading models, and radio frequency (RF) impairments to replicate real-world wireless stress.
Why It Matters
This collaboration addresses a critical gap in the technical stack as streaming and connected device ecosystems pivot toward generative AI. By quantifying the performance of cloud-based LLMs under adverse wireless conditions, manufacturers can optimize device design and network operators can refine resource allocation. As standards bodies like 3GPP and GTI develop AI service benchmarks, these metrics will likely become the foundational requirements for 5G-Advanced and 6G infrastructure. Watch for the integration of these standardized TTFT and TPS benchmarks into upcoming silicon validation cycles to ensure consistent AI performance at the network edge.
Additional Context
The push for standardized AI testing arrives as mobile operators redefine their infrastructure for 'mobile computing' rather than just connectivity. At MWC Shanghai 2026, China Mobile Chairman Chen Zhongyue confirmed a strategic pivot toward AI-native network development, pledging to steer 6G R&D through the lens of AI demands. This vision includes an open intelligent ecosystem integrating AI into consumer hardware such as smart glasses and humanoid robots, per China Daily, June 2026. Related infrastructure developments highlight the urgency for these test frameworks. In June 2026, China Telecom's chief technologist, Yue Wang, noted that AI-native 6G will require a fundamental shift toward the joint orchestration of networking and computing resources. Per RCR Wireless, June 2026, existing networks struggle with the non-deterministic nature of AI services, necessitating new layers for infrastructure, operations, and services that prioritize trust and explainability over mere execution speed. Beyond hardware testing, the broader industry is grappling with a surge in AI-assisted code that has increased the volume of software changes. Reports from Applitools in February 2026 suggest that while AI has improved development productivity, it has simultaneously increased complexity for quality assurance teams. By establishing benchmarks like TTFT and TPS, Rohde & Schwarz and China Mobile are attempting to bring signal to the noise of AI integration, providing a repeatable methodology for 6G-enabled applications where response times are projected to drop as low as one millisecond, according to Luth Research, March 2026.
Read full article at electronics360.globalspec.com
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source