LocalGaussStyle: A Method for Localized Style Transfer on 3D Gaussian Splatting

The recent development of 3D generative AI encompassing generation and editing technologies has been increasingly investigated to advance immersive applications. To enrich visual aesthetics, 3D stylization techniques focus on transferring artistic effects from reference style images to 3D scenes. However, existing 3D stylization techniques primarily focus on global style transfer, which can result in unwanted modifications to background regions and a lack of localized control. To address these limitations, we propose LocalGaussStyle, a novel approach for localized style transfer on scenes represented by 3D Gaussian splatting. The proposed pipeline consists of two phases: object localization and localized stylization. First, 2D instance segmentation masks are projected into a 3D scene to precisely localize target objects. Next, a boundary-aware optimization is designed to perform style transfer and mitigate style leakage caused by the spatial overlap of Gaussians. In addition, geometry-decoupled adaptive densification (GDAD) is employed to enhance the geometric resolution of Gaussians within the target object, thereby improving the representation capacity. The LocalGaussStyle facilitates high-fidelity style transfer that preserves the geometry and appearance of the non-target regions. In terms of style fidelity and background preservation, the effectiveness and efficiency of the proposed method are demonstrated through extensive experiments conducted on various scenes and reference style images.