FFmpeg 9.0 adds LCEVC track muxing and ONNX-powered DNN backend
The FFmpeg project has released version 9.0, codenamed 'Lei,' introducing significant technical updates including LCEVC track muxing, APV Vulkan hardware acceleration, and an ONNX Runtime DNN backend. The update also adds support for ProRes RAW VideoToolbox acceleration and includes a new bitstream filter for Dolby Vision multi-layer HEVC.
Key Takeaways
- Integrated LCEVC track muxing support for MP4 containers, facilitating the delivery of enhancement layers for backward-compatible higher-quality video.
- Introduced an ONNX Runtime DNN backend with GPU execution provider support, enabling native AI-based upscaling and object detection within the video pipeline.
- Added hardware acceleration for the APV professional editing format via Vulkan and for ProRes RAW via Apple's VideoToolbox.
- Implemented a new bitstream filter specifically designed to split Dolby Vision multi-layer HEVC streams for improved metadata handling.
- Removed deprecated components including the standalone CELT decoder, Ogg/Celt parsing, and legacy NVENC options for pre-11.1 SDK versions.
Why It Matters
The introduction of LCEVC track muxing and an ONNX-based DNN backend signals a shift toward making advanced compression and AI-driven processing standard in the streaming toolchain. By moving these features from experimental status into a major release, FFmpeg enables broad adoption of low-bitrate enhancement layers and real-time neural network filters without requiring proprietary middleware. This update specifically targets the fragmentation of HDR and professional workflows by adding dynamic metadata passthrough (SMPTE 2094-50) and cross-platform Vulkan acceleration. Operators should watch for a rise in LCEVC-enabled streaming profiles as muxing support simplifies the deployment of dual-layer bitstreams across existing content delivery networks.
Additional Context
The FFmpeg 9.0 release arrives as the industry accelerates its transition toward GPU-resident video pipelines. Per Phoronix and official project logs, June 2026, the inclusion of the ONNX Runtime backend was heavily supported by AMD, allowing AI models to run natively for tasks like background segmentation and resolution upscaling on both GPUs and NPUs. This move directly addresses the increasing demand for server-side AI processing in live sports and user-generated content workflows, where neural networks are used to improve visual fidelity without excessive bitrate increases.
Technological momentum for MPEG-5 LCEVC has also intensified following the FFmpeg 8.1 minor release in March 2026, which laid the groundwork by adding LCEVC metadata parsing. The progression to full track muxing in version 9.0 mirrors recent commercial deployments; for instance, V-Nova and partner organizations have been advocating for standardized LCEVC integration to reduce energy consumption in data centers by offloading heavy lifting from CPUs to specialized GPU shaders. Recent benchmarks from the Khronos Group in early 2026 indicate that Vulkan-based compute shaders, now used in FFmpeg for formats like APV and ProRes, can significantly reduce initialization delays compared to older OpenGL-based methods.
Furthermore, the framework's continued expansion into specialized hardware reflects the diversifying ecosystem of playback devices. The addition of VideoToolbox acceleration for ProRes RAW provides high-performance paths for Apple-centric creative workflows, while the niche inclusion of a Playdate console encoder highlights FFmpeg’s role as a universal bridge for all hardware tiers. As noted by industry analysts in mid-2026, FFmpeg remains the critical infrastructure for nearly every major streaming service, and these updates effectively dictate the technical roadmap for the next generation of cloud-based transcoding and edge-compute services.
Read full article at 9to5linux.com
Enjoy our coverage?
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source