Video Editing Meets Diffusion Models: A Comprehensive Survey

Read full text
Authors: Licheng Jiao, Yi Zuo, Lingling Li, Xu Liu, Fang Liu, Wenping Ma, Shuyuan Yang
Cited by: 0

Abstract

The rapid advancement of diffusion models has revolutionized video editing, yet existing surveys overlook how foundational model architectures fundamentally shape editing paradigms. This survey provides comprehensive analysis through a novel foundational-model-centric perspective, revealing a striking pattern: 100\% of T2I-based methods prioritize temporal consistency to compensate for absent motion priors, while 100\% of T2V-based methods focus on conditional injection precision leveraging native temporal understanding, with hybrid approaches showing 68\% emphasis on conditioning. We organize our analysis around three pillars. First, we trace the technical evolution of multimodal conditional injection, progressing from text-only conditioning through hybrid multi-modal integration to unified frameworks, alongside temporal consistency mechanisms evolving from sparse attention extensions through explicit feature correspondence to comprehensive learned modeling. Second, we examine how architectural choices fundamentally shape research priorities and method design. Third, we taxonomize approaches across multimodal conditions, editing tasks, and training paradigms. We collect datasets, evaluation metrics, and benchmarks, then identify ten critical open challenges. This survey illuminates the deep connection between foundational architectures and research directions, providing a roadmap for advancing video editing capabilities.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Multimodal Machine Learning Applications Digital Media Forensic Detection

Publication details

Publication date
17 February 2026
Language
EN
Document type
Preprint