AI for Video: Generative Tools, Automation & Machine Learning News

Generative AI video, automated editing, scene detection, AI dubbing, voice cloning, and upscaling are moving from research demos into production pipelines. Get the daily rundown on which AI video capabilities are actually shipping, and which ones are still just announcements.

May 14•Digiday: Marketers add human guardrails to AI ad buying
Marketers are implementing guardrails and increasing human oversight for AI agents used in programmatic ad buying due to concerns over accuracy and transparency. This development comes as the IAB Tech Lab launches a Programmatic Governance Council to address workflow, governance, and auction transparency in the evolving digital ad ecosystem. Companies like Kelly Scott Madison (KSM) Media and Bayer are deploying internal agents with specific rules, such as brand voice adherence and spend caps, while stressing the necessity of human supervision.
May 13•OpenAI: OpenAI adds live voice, translation, and transcription models
OpenAI has introduced three new audio models into its API: GPT-Realtime-2 for real-time voice intelligence, GPT-Realtime-Translate for live translation across 70+ input and 13 output languages, and GPT-Realtime-Whisper for low-latency streaming speech-to-text transcription. These models aim to enable developers to build more natural, intelligent, and responsive voice applications by improving reasoning, context handling, and real-time processing capabilities.
May 13•Comfystudiopro: ComfyStudio Pro bundles local, cloud, and hybrid video workflows
ComfyStudio Pro has launched as an AI video workstation designed to help creators generate, direct, edit, upscale, and finish videos using ComfyUI workflows. It supports local, cloud, and hybrid generation options, integrating various AI models and offering features like Director Mode, Flow AI, and a timeline editor for video production and export.
May 13•GitHub: AtlasCloudAI posts 70 Seedance 2.0 prompts with 70 preview videos
AtlasCloudAI has launched a GitHub repository for 'Awesome Seedance 2.0 Prompts,' offering a curated collection of prompts and preview videos for their multimodal video generation AI, Seedance 2.0. The repository details Seedance 2.0's capabilities in handling text, image, video, and audio inputs for tasks like reference-driven shots, advanced camera language, and video remixing, categorizing 70 prompts across various applications.
May 13•Venturebeat: VentureBeat spotlights AI video analysis and real-time voice tooling
This article is a landing page for VentureBeat's technology coverage, primarily focusing on artificial intelligence, security, and enterprise AI applications. It features headlines related to AI models for video analysis, AI security flaws, AI agent orchestration, and AI infrastructure challenges. Several articles mention AI's application in video-related tasks such as auto-clipping sports highlights and real-time AI voice/video conversation.
May 13•Dreamina: Dreamina targets viral baseball clips with Seedance 2.0
Dreamina has launched an AI-powered video generator designed to create realistic baseball broadcast and fan cam style videos from text prompts. The tool, powered by Seedance 2.0, aims to simulate live sports broadcasting visuals, including camera movements, crowd dynamics, and lighting, without requiring video editing skills.
May 13•GitHub: ZEGOCLOUD details sub-1.5-second AI avatar pipeline
ZEGOCLOUD released a detailed guide on building interactive AI avatars with real-time voice interaction, demonstrating how to orchestrate ASR, LLM, TTS, and digital human rendering with WebRTC for sub-1.5-second latency. The guide provides architecture, code examples, and steps for server-side API authentication and client-side streaming using their Conversational AI platform and Express SDK. This enables developers to deploy lifelike voice-interactive digital humans for applications like customer service and live commerce.
May 13•arXiv.org: TRM cuts sparse storage 33% in ranking model tests
A research paper titled "Farewell to Item IDs: Unlocking the Scaling Potential of Large Ranking Models via Semantic Tokens" introduces a new framework, TRM, that uses semantic tokens instead of traditional item IDs for ranking models in recommendation systems and search engines. TRM reportedly reduces sparse storage by 33% and improves AUC by 0.85%, demonstrating consistent outperformance at scale and leading to A/B test improvements of 0.26% in user active days and 0.75% in change query ratio in personalized search engines.
May 13•A2e: A2e bundles Sora 2 Pro, Veo 3.1, and Kling tools
A2e.ai offers a suite of AI-powered video and image generation tools, including features for animating still images, multi-modal video generation up to 1080P, cinematic video creation with synced audio, and various image editing capabilities. The platform commercializes video models from OpenAI (Sora 2 Pro), Google (Veo 3.1), and other developers like Kling 3.0 and Wan 2.7.
May 13•Modal: Modal shows one-second voice AI with open models
Modal, in collaboration with Pipecat, detailed how they achieved near one-second voice-to-voice latency for AI chatbots using open-weight models (Parakeet-tdt-v3 for STT, Qwen3-4B-Instruct-2507 + vLLM for LLM, KokoroTTS for TTS) hosted on Modal's platform. The article explains the architectural approach, including the use of WebRTC, Modal Tunnels for low-latency communication, and RAG with ChromaDB for knowledge retrieval, demonstrating optimized performance through geographic co-location of services.
May 13•DEV Community: Sub-second voice loops hinge on LLM and TTS latency
An analysis of over 30 stack benchmarks details the challenges and progress in achieving sub-second voice loops for AI agents, identifying that LLM Time to First Token (TTFT) and TTS Time to First Byte (TTFB) are the primary latency contributors. The research highlights various STT, LLM, and TTS combinations, with GPT-4 Nano + Cartesia Sonic-Turbo achieving the lowest first-byte latency of 0.73-0.75 seconds, noting that English still outperforms Spanish in speed and advocating for modular pipeline designs. The article predicts continued model shrinkage and emergence of joint LLM-TTS training for further latency reduction.
May 13•Topazlabs: Topaz brings AI upscaling directly into Adobe Premiere
Topaz Labs has released a new extension for Adobe Premiere Pro, enabling users to apply AI-powered video and image enhancement models directly within their editing timeline. This includes features like upscaling, denoising, slow-motion, and frame interpolation, with processing handled via Topaz's cloud rendering services.
May 13•abhs.in: Google I/O 2026 lines up Gemini 3.2 Flash and Gemma 4
Google I/O 2026 will feature announcements for Gemini 3.2 Flash and Gemma 4 open-weights, alongside updates to Android 17 and Android XR glasses. These developments involve AI models and a new operating system with extended reality capabilities.
May 13•Livemint: Google folds Gemini Intelligence into Android’s core
Google plans to integrate Gemini Intelligence into Android, turning it into an agentic AI system for task automation. These AI-driven features were announced at the Android Show 2026.
May 13•MSN: Meloni deepfake shows how viral AI images spread
Italian Prime Minister Giorgia Meloni publicly addressed an AI-generated deepfake image of herself that went viral on social media. The article frames this event as a critical example of how viral deepfakes are shaping the future of generative AI.
May 13•Adobe: Adobe GenStudio puts generative AI inside marketing workflows
Adobe has launched GenStudio, a new offering integrating generative AI into enterprise marketing workflows for marketers and agencies. This platform aims to unify and accelerate the content supply chain by leveraging AI capabilities.
May 12•The Current: Agentic media still depends on human strategy first
The article discusses the emergence of agentic media planning and buying as the next evolution of AI. It emphasizes that the crucial work in this field begins with human strategic intelligence before automation. The core idea is that AI agents are tools for executing human-defined strategies, not replacing the strategic thinking itself.
May 12•The Current: Agentic media hype is running ahead of automation
The article discusses the emergence of agentic media planning and buying as the next evolution of AI in early 2026. It emphasizes that the real work for agentic media, involving strategic thinking and content contextualization, begins prior to automation.
May 12•Broadcom: Broadcom says AI workloads need more private infrastructure
The article from Broadcom discusses the increasing demands of AI workloads on private infrastructure, specifically highlighting the need for enhanced compute, security, governance, and cost control. It positions private AI infrastructure as a solution for securely and scalably supporting enterprise AI applications.
May 12•Business Wire: Nebius adds Clarifai team, inference IP to Token Factory
Nebius has integrated Clarifai's core team and licensed its inference IP to enhance the Nebius Token Factory, focusing on system-level inference optimization and production AI. This move aims to strengthen Nebius's managed inference platform and global capacity for AI applications.
May 12•heise online: Red Hat AI 3.4 adds model service and agent controls
Red Hat's latest AI platform, AI 3.4, introduces Model-as-a-Service capabilities and enhanced agent management. The update also includes tighter integration with Nvidia technologies.
May 12•AIcerts: Google Gemini 3.1 rumors put multimodal verification under pressure
An article from AICerts discusses the challenges of verifying multimodal AI, specifically in the context of rumored Google Gemini 3.1 releases and Ultra versions. It reviews aspects such as specifications, costs, safety, and enterprise guidance related to the practical adoption of multimodal AI.
May 12•CryptoBriefing: Anthropic puts Claude agents, search on AWS for 100,000 users
Anthropic has launched its Claude Platform with general availability on Amazon Web Services, offering AI agents, web search, and code execution. This expansion provides enhanced access to these AI capabilities for over 100,000 existing Claude users.
May 12•Harvard Business Review: AI shopping agents ignore classic e-commerce persuasion tactics
New research indicates that traditional marketing tactics are ineffective on AI shopping agents, which are becoming a significant portion of online shoppers.
May 12•Google Developers Blog: Google ADK targets long-running enterprise AI agents
Google is promoting its Agent Development Kit (ADK) for building long-running AI agents capable of managing complex enterprise workflows. The ADK facilitates the development of production-grade AI agents that can pause, resume, and maintain context.
May 12•Lets Data Science: Surf AI says orchestration matters more than new model releases
Surf AI founder Yair Grindlinger published an opinion piece arguing that the primary challenge for AI deployments is orchestration, rather than the development of new AI models, highlighting the need for efficient management of AI systems.
May 12•SiliconANGLE: Nebius buys Clarifai orchestration tech, adds engineering team
Nebius Group N.V., an AI infrastructure company, has recruited the core engineering team from Clarifai, an AI orchestration software firm, as well as acquiring its compute orchestration technology. This move aims to enhance Nebius's AI inference capabilities. The acquisition specifically targets a team specializing in efficient utilization of AI computing resources.
May 12•reuters: Cannes Keeps Generative AI Out of Competition Categories
Ahead of the Cannes film festival opening, actress Demi Moore commented on the increasing presence of AI in filmmaking, describing the fight against it as a "losing battle." The festival itself prohibits generative AI in competitive categories, yet AI's role in the film industry remains a prominent discussion.
May 12•letsdatascience.com: Sportsnet pulls Nick Suzuki clip after AI family images
Canadian broadcaster Sportsnet removed a Mother's Day interview segment featuring Canadiens center Nick Suzuki after it was reported that AI-generated family images were used in the clip. This incident highlights issues related to content authenticity and ethical considerations in media production using artificial intelligence.
May 12•Tech Xplore: Economics-inspired AI moderation aims to price out bad actors
This article discusses the application of economic principles, specifically game theory and mechanism design, to improve AI content moderation systems. Researchers are exploring how system design can incentivize users to report problematic content accurately and disincentivize bad actors from posting it. The approach aims to create a more efficient and effective moderation environment by understanding the strategic interactions between platforms, users, and content creators.
May 12•openpr.com: Sports analytics market is headed for sharp expansion
This article forecasts significant expansion in the sports analytics market, driven by technological advancements. It suggests that technology continues to transform how sports are managed, played, and enjoyed.
May 12•Trend Hunter: Taja launches AI tool to clip long videos for social platforms
Taja has launched an AI video clipping tool designed to convert long-form recordings into multiple short-form videos optimized for social media platforms. The system automatically formats the content for various social platforms.
May 12•SVG Europe: Stats Perform adds AI highlight tool for rights holders and broadcasters
Stats Perform has launched Opta Pulse, an AI-assisted video creation and distribution solution for sports highlights. The tool is designed for leagues, rights holders, and broadcasters to streamline the creation and distribution of video content.
May 12•nerdbot.com: AI video editing has sped creator workflows over three years
The article discusses how AI video editing is changing content creation, noting advancements in the creator economy over the last three years.
May 12•TechEDT: Samsung puts Vision AI Companion on every 2026 TV model
Samsung is expanding its Vision AI Companion feature across its entire 2026 TV lineup, encompassing new Micro RGB, OLED, Neo QLED, and audio models. This integration represents a broader application of AI capabilities within consumer streaming platforms.
May 12•The Hollywood Reporter India: India's film industry is adopting AI faster than Hollywood
The Indian film industry is adopting AI technologies in production workflows at a faster pace than Hollywood, utilizing AI for applications such as creating alternate endings, de-aging actors, and fully AI-generated content. This rapid integration highlights a growing trend within the country's entertainment sector.
May 12•Art Threat: Demi Moore says Hollywood should stop fighting AI
At the 79th Cannes Film Festival, actress Demi Moore stated that the film industry should not attempt to combat AI, suggesting an acceptance of the technology.
May 12•MediaPost: TikTok folds ByteDance AI video model into Symphony
TikTok has initiated the integration of ByteDance's next-generation artificial intelligence (AI) video model into its Symphony suite. This development is aimed at offering AI-powered video capabilities for brands and creators using the platform.
May 12•Digit.in: Google tests Gemini Omni for chat-based video editing
Google is reportedly developing a new AI video generation tool called Gemini Omni, which would enable users to create and edit realistic videos via chat. This potential tool is anticipated to be revealed at Google I/O 2026.
May 12•biz-chosun: Nota’s NVA video control tool wins global Edge AI award
Nota, an AI model lightweighting and optimization company, announced that its "NVA" video control solution received a global Edge AI award. The solution focuses on on-device video control.
May 12•Technode Global: Vidu Claw turns one brief into a finished ad campaign
ShengShu Technology launched Vidu Claw, an AI CMO designed to generate complete ad campaigns from a single brief. The system utilizes Vidu Q3 in its Video Plan feature, streamlining ad creation without per-tool pricing or complex workflows.
May 12•IMDb: Former Prime Video executive backs UK launch of CineMe
AI-backed CineMe, a new platform designed to enhance visual development workflows for filmmakers, has launched in the UK. The platform was co-founded by a former Prime Video executive and an award-nominated filmmaker.
May 12•Poynter: AI video cleanup can create new errors, Poynter warns
Poynter reported on the spread of AI-enhanced video clips from the White House Correspondents’ dinner that introduced inaccuracies and confusion online, stemming from efforts to improve low-quality footage. The use of AI in this context led to the creation of misleading content, highlighting potential issues with such enhancement technologies.
May 12•SiliconANGLE: Red Hat AI 3.4 targets shared inference infrastructure
Red Hat AI 3.4 is introducing extensions to support shared, governed inference infrastructure, driven by industrial demand to move off expensive frontier models. This initiative is aimed at building a horizontal cloud for end-to-end automation, particularly focusing on AI applications.
May 12•SiliconANGLE: IBM pushes governed AI as enterprise demands tighter controls
IBM's strategy is currently driven by governed enterprise AI, which focuses on providing auditability and cost controls for enterprise AI applications like generative AI and automation. This approach addresses the increasing enterprise demand for responsible AI implementation as the technology moves into a more demanding phase.
May 12•NewswireToday: Nokia adds agentic AI to fixed home and broadband networks
Nokia has launched new agentic AI capabilities for its fixed network product lines, aiming to improve productivity and operational intelligence for home and broadband networks. This initiative specifically targets enhancing automation and efficiency within these network infrastructures.
May 12•Google: Google brings Gemini auto-browse to Chrome on Android
Google is introducing Gemini AI, including an auto-browse feature, to Chrome for Android. This integration aims to deliver an agentic experience within the mobile browser.
May 12•Business Wire: Perceptron AI’s video model targets frontier-lab performance at lower cost
Perceptron AI has launched a new physical AI model designed for video understanding and embodied reasoning, claiming performance comparable to "Frontier Labs" solutions at a lower cost. The model is purpose-built for analyzing video content and understanding physical interactions within it.
May 12•TrendHunter: Spotify expands AI DJ to four more languages
Spotify has expanded its interactive AI DJ feature to include French, German, Italian, and Brazilian Portuguese languages. This multilingual enhancement is being rolled out to users.
May 12•MSN: Google starts selling TPUs directly to customers
Google will directly sell its Tensor Processing Units (TPUs) to customers, a move that could challenge NVIDIA's dominance in AI compute. This direct sales approach aims to make Google's custom AI chips more accessible to companies.

Newest

AI for Video: Generative Tools, Automation & Machine Learning News