FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning

Read full text
Authors: Weijie Lyu, Ming–Hsuan Yang, Zhixin Shu
Cited by: 0
References: 13

Abstract

We introduce FaceCam, a system that generates video under customizable camera trajectories for monocular human portrait video input. Recent camera control approaches based on large video-generation models have shown promising progress but often exhibit geometric distortions and visual artifacts on portrait videos due to scale-ambiguous camera representations or 3D reconstruction errors. To overcome these limitations, we propose a face-tailored scale-aware representation for camera transformations that provides deterministic conditioning without relying on 3D priors. We train a video generation model on both multi-view studio captures and in-the-wild monocular videos, and introduce two camera-control data generation strategies: synthetic camera motion and multi-shot stitching, to exploit stationary training cameras while generalizing to dynamic, continuous camera trajectories at inference time. Experiments on Ava-256 dataset and diverse in-the-wild videos demonstrate that FaceCam achieves superior performance in camera controllability, visual quality, identity and motion preservation.

Fields of Study & Subjects

Generative Adversarial Networks and Image Synthesis Advanced Vision and Imaging Advanced Image Processing Techniques

Publication details

Journal / source
arXiv (Cornell University)
Publication date
5 March 2026
Language
EN
Document type
Preprint