AI for Video: Generative Tools, Automation & Machine Learning News

Quickplay announced AI-oriented product updates and partner news for NAB 2026, including Social Signals within Quickplay AI Studio, Smart Verticalizer, and a new partnership with Visible Things. The company highlighted deployments such as consolidating 1,300 digital touchpoints for Gray Media while managing 269 live and 123 FAST channels, and completing a 12-month cloud-native transformation of TVNZ+ serving over 2 million daily viewers.

The global AI video generator market is projected to reach $847 million in 2026, growing at an 18.8% CAGR, with a significant increase in enterprise adoption across various industries. This growth is driven by substantial cost reductions and accelerated content creation, impacting traditional video production and marketing strategies. Venture capital also made significant investments into AI video companies like Synthesia, Runway, and HeyGen in the past 18 months.

Samsung Electronics showcased its 2026 AI-powered TV, display, and audio innovations at its European Tech Seminar in Frankfurt, Germany. Key features include Vision AI Companion for intuitive interaction, AI Upscaling Pro, AI Soccer Mode Pro, and AI Sound Controller Pro for optimizing viewing experiences. The company plans to expand AI capabilities across its entire 2026 TV lineup.

The article discusses the crucial metrics for speech-to-text latency in voice agents, focusing on Time-To-First-Speech (TTFS) and accuracy. It highlights how Pipecat's benchmarks are influencing the conversation around these metrics.

Sonilo has launched its AI-powered music generation service as a new Node within ComfyUI, a platform for AI model workflows. This integration allows ComfyUI users to automatically generate custom background music for videos that matches pacing, timing, and emotional tone. The service offers both video-to-music and text-to-music capabilities, aiming to streamline music creation for video creators.

Gracenote research on TV and movie search and discovery reports growing use of AI chatbots for content recommendations, with 66% of respondents saying their usage increased over the past 12–18 months and Gen Alpha at 80%. In the survey, 49% of Gen Alpha chose AI chatbots as the best source for recommendations versus 41% for streaming/cable UIs and guides, while respondents still rated traditional search higher for trustworthiness and accuracy. The report is based on an online survey of 4,003 US AI chatbot users ages 13–79 conducted from 23 January to 4 February 2026.

Fastly and LALIGA announced a joint anti-piracy innovation effort to detect and help remove illegal live streams of LALIGA matches, citing LALIGA estimates that piracy costs its clubs $700–$800 million annually. Fastly says it has built a real-time detection system using AI and proprietary content signals to identify unauthorized streams and enable more precise takedowns without broad regional blocking. The release references industry data (Grant Thornton) indicating 10.8 million unauthorized live-event retransmissions were detected in 2024, with most not suspended and only 2.7% addressed within the first 30 minutes.

INSAIT Institute and Netflix announced VOID, an AI video model designed to remove objects from video while realistically reconstructing the scene’s subsequent dynamics (e.g., how objects would move if a person were removed). The model is built on CogVideoX and uses a “quadmask” method plus simulated training data generated in Blender, and it is released as open source with code, paper, and demos publicly available.

Alibaba confirmed it is behind HappyHorse-1.0, an AI video generation model that debuted anonymously on the Artificial Analysis benchmarking platform and quickly ranked at the top of blind tests for text-to-video and image-to-video. The project is attributed to Alibaba’s ATH AI Innovation Unit and is described as still under development, amid heightened competition in generative video as rivals face setbacks such as OpenAI discontinuing Sora and ByteDance pausing Seedance 2.0 amid copyright disputes involving major studios and streaming platforms.

Synamedia announced a just-in-time AI plugin framework for its Quortex portfolio, positioning it as a way to apply AI only when specific workflow conditions in video/audio streams warrant it for processing, distribution, and delivery. The company says the system triggers AI based on detected meaningful changes or events rather than continuous, always-on processing. The capabilities are framed as applicable across Quortex Link, Quortex PowerVu, Quortex Play, and Quortex Switch.

Amagi is launching NewsPulse, an agentic AI platform designed to automatically convert live broadcast feeds and VoD news libraries into social-ready clips, vertical video, and digital news bulletins. The platform covers the workflow from ingest through real-time story segmentation, intelligent multi-aspect reframing, caption/post generation, and publishing to digital endpoints, with optional human review and policy guardrails. NewsPulse is in limited availability testing with select newsroom partners, with general availability expected in June 2026.

A NAB Show session description outlines how AI is being applied to live sports streaming workflows to improve monetization and viewer experiences. Topics include AI-based detection of natural ad breaks with real-time SCTE-35 marker generation, contextual metadata extraction for highlights and personalized replays, and localization automation (speech-to-text, translation, voice cloning/overdubbing). The session also cites AI-driven super-resolution upscaling from HD to UHD as a way to deliver higher quality while reducing costs.

Harlequin (a HarperCollins division) signed a multi-year agreement with AI shortform-video company Dashverse to co-produce 40 animated, AI-assisted "microdrama" series based on Harlequin Romance titles, starting with an adaptation of Catherine Mann’s "A Fairy-Tail Ending". The series are slated for distribution in English on global microdrama platforms including Dashverse’s DashReels, with monetization via advertising and, on some platforms, subscriptions; Harlequin says authors will receive royalties. Dashverse’s production system, Frameo, is described as a generative video studio combining text prompting with automated editing to produce short films with consistent characters and audio.

Bouygues Telecom’s InnoLab Tech, working with AWS and Devoteam, developed “Ensemble ce soir,” a generative-AI TV service designed to help households choose content from SVOD catalogs by collecting preferences via set-top box prompts and a smartphone chat initiated with a QR code. The system uses Claude 3 (Haiku) through Amazon Bedrock with RAG and publisher catalogs to generate three explained recommendations, with an architecture built around an Android app, web app, API Gateway, and AWS Lambda. The project progressed from a prototype shown at VivaTech (May 2024) to a product, followed by internal testing and a customer test phase in September 2024.

AWS outlines its NAB Show 2026 (Las Vegas, April 18–22) demonstrations and sessions focused on agentic AI for media creation, distribution, and monetization, including workflow automation and archive understanding. A featured capability is AWS Elemental Inference, described as a fully managed service that applies AI in parallel with live encoding to generate 16:9-to-vertical video in 6–10 seconds and integrate with AWS Elemental MediaLive and MediaConvert, with Fox Sports Digital and NBCUniversal cited as users. The agenda also highlights cloud/AI use cases in live sports production and fan engagement with partners and customers including Fox Corporation, NVIDIA, and the PGA TOUR.

Netflix describes a production-oriented multimodal video search architecture designed to index and retrieve moments from large volumes of raw footage by fusing outputs from multiple AI models (e.g., character, scene, dialogue) into a unified, time-aligned representation. The system persists raw annotations in an internal annotation service backed by Apache Cassandra, performs offline temporal bucketing and intersection via Kafka-triggered processing, and indexes enriched per-second records into Elasticsearch to enable low-latency hybrid text+vector search and ranking. The post also outlines query planning, result deduplication/clustering, and future work including natural-language querying, adaptive ranking from user feedback, and workflow-specific personalization.

EE TV has launched two AI-powered conversational discovery features, Smart Search and Mood Matcher, within the EE TV app to help users find content using natural-language prompts and mood-based questions. The tools aggregate results across live TV, on-demand libraries, and streaming apps available through EE TV, with plans to expand access later to EE TV Pro and EE TV Box Edge customers.

AWS outlines approaches for adding live-stream localization and accessibility—captions, multi-language subtitles, and live dubbing—using AWS Media Services and AI-based speech recognition/translation. The post compares four integration points across a typical AWS live pipeline (MediaConnect/MediaLive/MediaPackage plus CloudFront), highlighting trade-offs in latency, language support, and client changes, and recommends integration points 2 (embedded captions) and 3 (late-binding subtitle/audio tracks into HLS manifests). It also references an implementation using partner SyncWords and standards such as CEA-608/708, WebVTT, DVB Subtitle/Teletext, SRT, and HLS.

PA TV Metadata has launched EMMET, a human-in-control, AI-supported metadata enrichment tool aimed at improving content discovery, engagement, and personalisation across broadcast and streaming services. The tool adds scalable descriptive and contextual metadata (e.g., mood, themes, soundtrack details, and filming locations) and is integrated into PA TV Metadata’s Pawa management and distribution system for use on broadcaster and content-owner catalogues.

Imagine Communications has introduced AI-assisted scheduling for its Landmark Rights & Scheduling (R&S) system. This new feature aims to streamline media scheduling workflows, reduce manual effort, and improve consistency for planning decisions.

Runway is launching a $10 million venture fund to invest in early-stage startups building in AI, media, and world simulation, with plans to write checks up to $500,000. The company is also rolling out a Builders program that provides eligible startups with 500,000 API credits and access to Runway Characters, a real-time video agent API built on its general world models, aiming to expand use cases for interactive, real-time “video intelligence.”

RTL Deutschland outlined a strategy to expand “agentic AI” use across post-production, virtual production, and AI-generated commercial breaks for both streaming and linear TV workflows. Planned applications include AI-assisted analysis and structuring of reality-format footage and producing alternative narrative edits of previously broadcast episodes (with legal and editorial review). RTL also described pilots under real production conditions, including the use of virtually enhanced backgrounds in multiple series.

OpenAI shut down its AI video-generation tool, Sora, just six months after its public release, due to high operational costs and low user engagement, according to a WSJ investigation. Sora was reportedly burning through $1 million daily and its user count had declined significantly. The decision also led to the termination of a $1 billion partnership with Disney.

The article reports that OpenAI has discontinued its Sora video generation model, citing high compute costs and intense market competition. It frames the decision as a strategic shift toward prioritizing product viability and monetization over continued investment in a costly, competitive generative video effort.

This article provides an overview of the current state of AI in live streaming, detailing its applications in production, localization, quality measurement, content creation, security, and monetization. It highlights areas where AI is robustly integrated, such as automated camera operation, captioning, and ad optimization, contrasting them with latency-sensitive areas like encoding and delivery where AI's role is more diagnostic.

Wowza describes how the Mississippi Department of Transportation uses Wowza Streaming Engine as an API-driven platform to provision, monitor, and deliver over 1,200 RTSP traffic camera feeds, including automated health checks and stream management via a custom "Camera Manager" system. MDOT generates near-real-time still thumbnails from camera streams using Wowza Transcoder and sends frames to a vision model that answers incident-related prompts (e.g., crash, stalled vehicle, emergency responders), creating a prioritized operator review queue. Wowza also notes it is running a beta program with clients to add AI-powered video intelligence/scene analysis capabilities to existing Wowza-based live video workflows.

OpenAI has shut down the Sora app and website, its AI video generation platform, after launching a standalone app about six months ago and expanding availability to the UK and Europe in February 2025. OpenAI indicated the closure is to refocus on tools for real-world physical tasks (e.g., robotics), and it is unclear whether Sora’s video model will remain accessible via ChatGPT or other integrations. Following the shutdown, Disney ended a proposed deal with OpenAI that would have involved a $1B investment and use of Disney characters in AI-generated videos, amid broader concerns about deepfakes and copyrighted content generation.

IBC announced nine projects selected for its 2026 Accelerator Media Innovation Programme, which will undergo a six-month development phase and culminate in live Proof of Concept demonstrations at IBC2026 (11–14 September). The projects focus on agentic/AI-assisted production workflows, archive discovery and interoperability, immersive live streaming, accessibility measurement, and new approaches to live transmission including DAZN’s “Delta Protocol” and 5G network API-based prioritisation for wireless video feeds.

Grabyo previews NAB 2026 updates to its cloud-native video platform, including AI-assisted reframing to convert 16:9 clips into vertical or square formats and an in-workflow open-captioning tool that can generate, style, and burn captions into live clips. The company also describes an AWS Elemental Inference integration to generate vertical outputs directly from live feeds, and introduces Grabyo Live, a browser-based cloud production environment with switching, multiviewer, ISO recording, role-based controls, and multi-destination output/encoding configuration.

Comcast is running lab and field trials of an Nvidia GPU-powered, low-latency edge compute platform across a subset of its roughly 200 edge locations, with potential for broader commercial deployment depending on trial results. Initial use cases include an AI-driven ad-delivery engine using Decart real-time AI video models to customize ads at the household level, alongside latency-focused applications such as gaming; Charter announced a similar Nvidia edge GPU initiative. The effort is positioned as part of Comcast’s broader network virtualization and DOCSIS 4.0/FDX roadmap, while analysts note developer adoption and overall edge-compute market clarity remain uncertain versus public cloud platforms.

FreeWheel has launched an AI agent infrastructure, including its Model Context Protocol (MCP) server and intelligence tools, designed to embed artificial intelligence directly into premium video transactions. This system aims to automate workflows and optimize performance for buyers and sellers in real time. PMG is an initial partner piloting these capabilities within its marketing operating system, Alli, for global streaming campaigns.

Google has launched Gemini Embedding 2, its first natively multimodal embedding model, now available in Public Preview via the Gemini API and Vertex AI. This model can map text, images, video, audio, and documents (up to 6 pages) into a single embedding space, facilitating multimodal retrieval and classification and enhancing AI applications like Retrieval-Augmented Generation (RAG) and semantic search.

Netflix has agreed to acquire InterPositive, an AI-focused production tools company founded by Ben Affleck in 2022, and will bring Affleck on as a senior adviser alongside the full team. InterPositive builds AI tools aimed at supporting filmmakers and producers, using proprietary datasets and models focused on filmmaking techniques rather than performances; financial terms were not disclosed.

A LinkedIn post citing the Netflix Tech Blog claims Netflix announced an "AI-Powered Recommendations 2.0" system that uses a custom fine-tuned Llama 3.1 405B model to generate personalized trailers and "What to Watch Next" suggestions in real time. The post reports early testing showed a 25% engagement uplift and frames the approach as a shift from traditional recommendation algorithms toward large-language-model-driven personalization.

AWS describes a reference architecture for automating media supply chain tasks—particularly video metadata generation and compliance formatting—using Strands Agents with Amazon Bedrock AgentCore. The workflow combines Amazon Bedrock Data Automation video insights with agent-orchestrated tool calls (for knowledge base retrieval and database lookups) and supports scaling via AgentCore Gateway (MCP-based tool APIs) and AgentCore Runtime for managed deployment. The post uses a sports highlight example to show enriching raw video summaries with contextual metadata for downstream distribution and advertising-related use cases.

Netflix sent a cease-and-desist letter to ByteDance regarding “Seedance 2.0,” seeking to have AI-generated videos using Netflix IP taken down. The letter specifically cites AI-generated content related to Stranger Things, KPop Demon Hunters, and Squid Game.

AWS describes a prototype built with Fox Sports that uses AWS Elemental Inference to detect key moments in live sports streams and automatically generate 9:16 vertical highlight clips for social platforms within roughly 20–30 seconds of occurring on-air. The workflow integrates Elemental MediaLive for live ingest/encode, MediaPackage V2 for segmenting and clip harvesting, and MediaConvert for editing and MP4 export, orchestrated via serverless AWS services and surfaced through a browser-based editorial portal. The system emits metadata events (timestamps, tags, descriptions), extracts corresponding HLS segments into S3, and supports in-browser trimming/merging and batch downloads via pre-signed URLs.

The article discusses a collaboration between OpenAI and Indian streaming service JioHotstar to use ChatGPT for conversational content discovery, allowing users to find shows and sports content through natural language queries. It outlines potential AI-driven features such as hyper-regional recommendations, live sports companion tools, smart trailers, creator discovery, and emotion-based search tailored to India's diverse audience. The post positions this as part of a shift toward intent-driven entertainment and more nuanced personalization in streaming.

The article details an AWS reference architecture for real-time multilingual WebVTT subtitling in live streaming workflows, designed to preserve original stream latency while improving translation accuracy and scalability. It combines Amazon Transcribe, Amazon Bedrock with Amazon Nova models, and AWS Elemental Media Services with CloudFront, DynamoDB, Lambda@Edge, and API Gateway to generate and deliver synchronized subtitles across multiple languages. AWS also provides an open source implementation on GitHub, including IaC templates and deployment guidance for broadcasters and streamers.

The article reports that YouTube is expanding its experimental conversational AI assistant from mobile and web to smart TVs, gaming consoles, and streaming devices, enabling users to query on-screen video content without stopping playback in multiple languages for adults. It places this feature within YouTube’s rising share of US TV viewing time per Nielsen data and contrasts it with AI-powered search and recommendation efforts from Amazon’s Fire TV, Roku, and Netflix, highlighting AI tools like upscaling, comment summarization, and Shorts generation as levers to deepen engagement and revenue in a fragmented streaming market.

The article discusses how broadcasters and media organizations are preparing for the Los Angeles 2028 Olympics by building AI-driven content infrastructures to enable real-time, personalized, multi-platform storytelling. It emphasizes automated metadata enrichment, searchability, and adaptive workflows to handle unpredictable live events while keeping human producers as narrative curators. The piece also frames LA28 content as a long-term, monetisable “living archive” to support future documentaries, fan experiences, and AI training data.

A brief post from BOL Network states that YouTube is using expressive multilingual AI dubbing to enhance streaming. The tweet offers only a headline and link, without additional technical specifications or business context.

Bitmovin promotes an AI Assistant aimed at optimizing streaming workflows by allowing teams to query and interpret streaming observability data using natural language. The tool is described as helping users understand playback and workflow performance, identify issues and optimization opportunities, and reduce investigation time. The post includes a video demonstration and offers a 30-day free trial for interested users.

Runway raised $315 million in new funding at a $5.3 billion valuation, bringing total capital raised to $860 million to scale its AI video and world model technologies. The company’s Gen 4.5 model enables high-definition, longform, multi-shot video with native audio and improved editing, and is being adopted by studios, brands, and enterprises across sectors including media, design, gaming, and robotics. The funding will support expanded compute capacity via CoreWeave, further world model pre-training, and growth in research, engineering, and go-to-market teams.

HOLYWATER TECH, an AI-focused entertainment company operating several vertical streaming platforms, has acquired Jeynix, a studio specializing in AI-assisted hyper-realistic visual effects and performance-preserving video techniques. The deal brings Jeynix’s technical team and proprietary workflows in areas such as facial animation, face replacement, and lip-sync in-house, aiming to deliver higher-quality, cinema-like visuals and faster localization for microdramas and vertical series across HOLYWATER TECH’s platforms. The announcement follows HOLYWATER TECH’s recent $22 million funding round and ongoing content partnerships with FOX Entertainment and Dhar Mann Studios for its My Drama platform.

Amazon MGM Studios is expanding its AI Studio division, hiring "technology-forward" creative executives to lead generative AI-driven live-action projects under a strategy led by Albert Cheng. Cheng positions AI as an enhancement rather than a replacement for human talent and plans to use AI tools to accelerate production timelines, reduce costs, and improve audience retention for Prime Video series, while emphasizing ethical frameworks around data governance and IP. The article also notes broader industry experimentation with AI in scripted production, including Prime Video’s House of David, amid ongoing concerns about job impacts.

The post highlights how OTT streaming platforms are adopting AI-powered dubbing to move beyond traditional subtitles for content localization. It notes that this approach enables faster and more cost-effective localization at scale, which in turn can increase watch time and expand global audience reach.

LiveKit raised $100 million at a $1 billion valuation in a round led by Index Ventures with participation from Altimeter Capital, Hanabi Capital, and Redpoint Ventures. The company, founded in 2021 and originating as an open-source low-latency audio/video project, now operates a managed cloud platform used by OpenAI (for ChatGPT's voice mode), xAI, Salesforce, Tesla, and various emergency and healthcare providers.