FFmpeg 9.1 release adds NVIDIA optical flow and Vulkan APV encoding

The integration of NVIDIA optical flow and Vulkan-based APV encoding signals a shift toward offloading complex interpolation and professional mezzanine tasks to the GPU. By supporting royalty-free formats like APV with hardware acceleration, the library reduces the computational overhead for high-fidelity production environments. This development aligns with the broader industry move toward LCEVC and xHE-AAC to optimize delivery efficiency across fragmented device ecosystems. As these tools move into production, watch for how the inclusion of DirectML zero-copy inference impacts the speed of AI-driven video enhancement and real-time metadata processing.

The NVIDIA optical flow FRUC filter's path into FFmpeg was indirect. A CUDA-based FRUC filter was posted to FFmpeg's developer mailing list in January 2023 but never entered the codebase; three years later the same capability arrived via NVIDIA's Vulkan optical flow path, requiring the VK_NV_optical_flow extension on Ampere or newer GPUs. NVIDIA claims its Ada-generation optical flow engine delivers roughly 2.5x the throughput of Ampere with approximately 15% better interpolation quality. No independent benchmarks comparing the new filter against FFmpeg's existing software interpolators have been published. The upstream availability also unblocks downstream players: mpv has had an open feature request for NVIDIA optical flow-based FRUC since 2022, and because mpv sits atop FFmpeg, the mainline merge was the prerequisite. The FRUC merge was not the only NVIDIA-related code that appeared in FFmpeg that weekend. The reversal suggests ongoing friction between FFmpeg's open-source contribution model and NVIDIA's proprietary neural network components, even as the project deepens its Vulkan-based GPU acceleration strategy that began with FFmpeg 9.0.