Learning to Refine Gesture-Derived Voxel-to-Loop for Generative 3D Modeling in VR

Read full text Summarise with VIRAT
Authors: Kallen Lonbom, Di Qi
Cited by: 0
References: 39

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

We present a generative modeling pipeline for refining and denoising coarse 3D shapes created through freehand interaction in virtual reality (VR). While recent loop-based generative models focus on shape synthesis from clean inputs, our work addresses the challenge of reconstructing coherent geometry from noisy, coarse volumetric data. To this end, we introduce a hybrid voxel-to-loop representation that captures the topology of rough voxel shapes and converts them into sequential cross-sectional loops for generative refinement. We develop two transformer architectures and evaluate their efficacy primarily on synthetically perturbed datasets with additional examples from VR. Our results demonstrate that this representation is topologically robust to the irregularities of raw input, establishing a technical foundation for future AI-assisted immersive 3D modeling systems.

Fields of Study & Subjects

3D Shape Modeling and Analysis Computer Graphics and Visualization Techniques Generative Adversarial Networks and Image Synthesis

Publication details

Journal / source
IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)
Pages
173–178
Publication date
26 January 2026
Language
EN