Deep-Saliency Foveated Ray Tracing For Real-time VR Rendering

View at publisher Summarise with VIRAT
Authors: Yang Gao, W. D. Li, Shiyu Liang, Weizichuan Feng, Qing Xia, Shuai Li, Aimin Hao
Cited by: 0
References: 56

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

Immersive VR applications demand high resolutions and refresh rates, posing significant challenges for real-time rendering. Foveated rendering mitigates this cost by exploiting properties of the Human Visual System (HVS), but conventional approaches often rely on oversimplified heuristic models that neglect high-level attentional cues, resulting in artifacts in peripheral regions. To this end, we present a neural saliency-driven foveated ray tracing framework that overcomes these limitations. Our method introduces a motion-aware foveation model to capture temporal dynamics and employs a lightweight convolutional neural network to predict saliency maps that reflect complex attentional patterns derived from eye-gaze data. The combination of these guides adaptive path tracing and filtering, enabling perceptually optimized rendering with minimal artifacts. Experimental results show that our approach improves perceptual quality over prior methods while sustaining real-time performance.

Fields of Study & Subjects

Computer Graphics and Visualization Techniques Visual Attention and Saliency Detection Visual perception and processing mechanisms

Publication details

Journal / source
IEEE Transactions on Visualization and Computer Graphics
Volume
32
Issue
5
Pages
3475–3485
Publication date
30 March 2026
Language
EN