M3DDM+: An improved video outpainting by a modified masking strategy

Read full text
Authors: Murakawa, Takuya, Takumi Fukuzawa, Ning Ding, Toru Tamaki
Cited by: 0

Abstract

M3DDM provides a computationally efficient framework for video outpainting via latent diffusion modeling. However, it exhibits significant quality degradation -- manifested as spatial blur and temporal inconsistency -- under challenging scenarios characterized by limited camera motion or large outpainting regions, where inter-frame information is limited. We identify the cause as a training-inference mismatch in the masking strategy: M3DDM's training applies random mask directions and widths across frames, whereas inference requires consistent directional outpainting throughout the video. To address this, we propose M3DDM+, which applies uniform mask direction and width across all frames during training, followed by fine-tuning of the pretrained M3DDM model. Experiments demonstrate that M3DDM+ substantially improves visual fidelity and temporal coherence in information-limited scenarios while maintaining computational efficiency. The code is available at https://github.com/tamaki-lab/M3DDM-Plus.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Advanced Image Processing Techniques Digital Media Forensic Detection

Publication details

Journal / source
arXiv (Cornell University)
Publication date
16 January 2026
Document type
Preprint