AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation

Read full text
Authors: Dahyeon Kye, Chang-Hyun Roh, Sukhun Ko, Chanho Eom, Jihyong Oh
Cited by: 6
References: 288

Abstract

Video Frame Interpolation (VFI) is a core low-level vision task that synthesizes intermediate frames between existing ones while ensuring spatial and temporal coherence. Over the past decades, VFI methodologies have evolved from classical motion compensation-based approach to a wide spectrum of deep learning-based approaches, including kernel-, flow- , hybrid-, phase-, GAN-, Transformer-, Mamba-, and most recently, diffusion-based models. We introduce AceVFI, a comprehensive and up-to-date review of the VFI field, covering over 250 representative papers. We systematically categorize VFI methods based on their core design principles and architectural characteristics. Further, we classify them into two major learning paradigms: Center-Time Frame Interpolation (CTFI) and Arbitrary-Time Frame Interpolation (ATFI). We analyze key challenges in VFI, including large motion, occlusion, lighting variation, and non-linear motion. In addition, we review standard datasets, loss functions, evaluation metrics. We also explore VFI applications in other domains and highlight future research directions. This survey aims to serve as a valuable reference for researchers and practitioners seeking a thorough understanding of the modern VFI landscape. We maintain an up-to-date project page: https://github.com/CMLab-Korea/Awesome-Video-Frame-Interpolation.

Fields of Study & Subjects

Advanced Image Processing Techniques Image Processing Techniques and Applications Image Enhancement Techniques

Publication details

Journal / source
IEEE Transactions on Circuits and Systems for Video Technology
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
36
Issue
7
Pages
9477–9501
Publication date
9 March 2026
Language
EN