MOVi: Training-Free Text-Conditioned Multi-Object Video Generation

View at publisher
Authors: Aimon Rahman, Jiang Liu, Ze Wang, Ximeng Sun, Jialian Wu, Xiaodong Yu, Yusheng Su, Vishal M. Patel, Zicheng Liu, Emad Barsoum
Cited by: 1
References: 6

Abstract

Recent diffusion-based text-to-video (T2V) models show strong progress but still struggle with multi-object generation, often rendering objects as static backgrounds or blending their features. We propose a training-free method that combines diffusion models with large language models (LLMs), where the LLM acts as a "director" to guide object trajectories via noise re-initialization for controllable motion. We further adjust the attention mechanism to capture object-specific features and avoid cross-object interference. Experiments show our approach boosts multi-object accuracy and motion dynamics by 42%, while preserving fidelity and smoothness.

Fields of Study & Subjects

Multimodal Machine Learning Applications Generative Adversarial Networks and Image Synthesis Human Motion and Animation

Publication details

Journal / source
ICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Publisher
IEEE
Pages
1036–1040
Publication date
21 April 2026