Reducing Volumetric Video Latency Paves Way for Live Event Adoption
The article discusses the technical challenges and innovations in reducing processing delays for volumetric video in live events, aiming for sub-100ms latency. Key solutions include real-time compression, hardware acceleration, and edge computing architectures to manage massive data volumes and computational demands. Major tech companies and telecommunications providers are investing in this emerging market, with specific solutions detailed from Sony and Microsoft.
Key Takeaways
- Current volumetric video systems experience 200ms to several seconds of end-to-end latency, with a sub-100ms threshold needed for live interaction.
- Data rates from multi-camera capture (20-50+ cameras) can exceed 10-20 GB/s, posing a significant challenge for real-time processing.
- Sony utilizes multi-camera arrays and proprietary compression, while Microsoft leverages Azure cloud and Mixed Reality Capture Studios to minimize delays.
- Innovations include predicting viewer viewpoints to transmit only visible volumetric cells and compression algorithms categorizing data into 'close,' 'intermediate,' and 'distant' regions.
- Edge computing is crucial, bringing processing closer to data sources and users, using GPUs, FPGAs, and AI processors to handle intensive computational demands.
Why It Matters
The push to reduce volumetric video latency is fundamental for its broader commercial adoption in live event streaming. Achieving sub-100ms delays directly impacts viewer engagement and the feasibility of interactive, immersive experiences, moving volumetric content from niche applications to mainstream broadcasting. The ongoing investments from major tech and telecom players, coupled with advancements in edge computing and real-time compression, point to a future where 3D interactive viewing could become a standard feature of major events. Watch for standardized processing pipelines and widespread hardware-accelerated libraries, which will signal maturing infrastructure and broader market readiness.
Additional Context
The volumetric video market is expanding rapidly, with projections valuing it at $2.2 billion in 2023 and reaching $7.6 billion by 2028, growing at a 28.6% CAGR. This growth is largely driven by demand for immersive experiences in entertainment, gaming, and sports, according to MarketsandMarkets Blog (Sept 2023). Hardware, particularly capture systems and 3D imaging sensors, currently dominates the product segment, reflecting the foundational investment required for volumetric content creation. Recent developments highlight efforts to overcome key technical hurdles. DNE and Gracia, a volumetric capture studio and infrastructure company, released a 4-minute streamable 4D Gaussian Splatting (4DGS) music performance in April 2026, playable directly in web browsers. This demonstrates advancements in streaming high-quality volumetric data without needing dedicated applications. Similarly, Brown University computer scientists introduced PackUV in May 2026, a method to compress massive 3D video data into standard video formats, making it more compatible with existing streaming infrastructure and allowing longer sequences to be processed. This research addresses the challenge of storing and streaming volumetric video, which can otherwise result in terabytes of data for short clips. Sports broadcasting remains a significant driver for volumetric video, with Promwad (2025) reporting that major leagues and broadcasters are investing in volumetric capture systems for interactive fan experiences, allowing viewers to control perspectives and integrate AR/VR elements. The Olympics, for example, are seen as a strong use case for this technology, per TechRadar Pro (2025).
Read full article at eureka.patsnap.com
Get this in your inbox → Subscribe
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source