Latent Prediction-Based Generative Semantic Communication for Video Transmission in Wireless Networks

Read full text
Authors: Maheshi Lokumarambage, Thushan Sivalingam, Feng Dong, Nandana Rajatheva, Anil Fernando
Cited by: 1
References: 50

Abstract

The increasing dominance of video traffic in intelligent sensing and control applications introduces a major challenge to the capacity limits of modern wireless networks. Classical information theory defines fixed physical boundaries on channel capacity, beyond which further improvement requires rethinking what information is transmitted. Semantic communication (SemCom) bridges this by only sending the semantics of the intended message. This paper presents a SemCom framework that leverages latent-space procedural video prediction with world-model-guided temporal dynamics. Instead of transmitting pixel data, the transmitter encodes high-level semantic representations of context frames and sends them through the physical channel. A temporal transformer predicts future latent states at the receiver. The framework jointly optimizes perceptual, adversarial, and temporal objectives to preserve both visual quality and trajectory consistency under channel impairments. Experiments conducted on video sequences of the BAIR robot pushing dataset demonstrate that the proposed method achieves lower normalized endpoint and velocity errors compared to learned baseline real-time intermediate flow estimation (RIFE) + better portable graphics (BPG) with reduced bit-rate compared to traditional codecs. The results indicate that incorporating temporal dynamics as semantics into the communication process enables efficient and anticipatory video transmission suitable for applications such as tele-robotic, underwater, and autonomous systems.

Fields of Study & Subjects

Wireless Signal Modulation Classification Advanced Data and IoT Technologies Video Coding and Compression Technologies

Publication details

Journal / source
IEEE Open Journal of the Communications Society
Publisher
Institute of Electrical and Electronics Engineers (IEEE)
Volume
7
Pages
3974–3986
Publication date
1 January 2026
Language
EN