Lightweight CAST Adapter Nearly Doubles Video Retrieval Accuracy on Frozen Backbones

CAST shows that context-aware state transitions can be modeled as a lightweight query-side adapter without re-indexing video galleries or fine-tuning backbone encoders — a practical advantage for platforms managing large content libraries. The CVR benchmark's hard negatives expose a failure mode that standard retrieval metrics like MSR-VTT miss: clips that are semantically relevant but violate procedural causality or identity continuity. The Veo reranking result, though preliminary with 300 prompts, suggests the same transition signal could guide black-box generation pipelines toward more coherent multi-step narratives. Watch whether the CVR benchmark format — state and identity negatives applied to procedural datasets — gets adopted in broader video retrieval evaluations beyond cooking and task instruction domains.

CAST was accepted as a poster at ICML 2026, scheduled for July 9, 2026 in Seoul, per the ICML virtual site. The project page confirms author affiliations with Google, UC Santa Cruz, and MIT, with lead author Yanqing Liu having completed the work as a research intern at Google. The ICML poster abstract notably broadens the generation-guidance claim to mention both Sora and Veo as target black-box models, whereas the paper itself only evaluates Veo.

The CVR benchmark arrives amid a wave of new video retrieval evaluation frameworks targeting gaps that legacy benchmarks like MSR-VTT and DiDeMo leave unaddressed. LoVR, introduced on arXiv in May 2025, provides a long-video retrieval benchmark with 467 videos averaging 26 minutes and over 40,000 fine-grained clips, revealing that even strong multimodal embedding models like GME-Qwen2-VL suffer substantial accuracy drops on long-form content versus short clips. MUVR, also from 2025, evaluates untrimmed video retrieval using 53,000 Bilibili videos with multi-modal queries and finds that EVA-CLIP achieves only 58% mAP, with current MLLMs proving unreliable for reranking tasks. FLARE, posted in 2026, introduces a full-modality audiovisual retrieval benchmark showing that audio-language alignment remains a persistent bottleneck — the best contrastive audio model achieves under 1% Recall@1 on clip-level text-to-clip retrieval.

On the generation side, temporal consistency in long-form video output remains an active frontier. LoL (Longer than Longer), presented at CVPR 2026, identifies and addresses a failure mode called "sink-collapse" in autoregressive video generation, where RoPE periodicity causes frames to revert abruptly to initial context frames; the method enables streaming generation up to 12 hours with minimal quality degradation. MilliVid, posted on arXiv in 2026, proposes hierarchical latent tokenization to preserve long-range scene geometry while spending less compute on low-saliency detail. A survey published in ACM Computing Surveys in February 2026 (Yin et al.) catalogs spatiotemporal consistency mechanisms across diffusion-based video generation, noting that even state-of-the-art models struggle to maintain character identity and scene layout beyond 16 seconds without specialized architectural components.