3DResT: A Strong Baseline for Semi-Supervised 3D Referring Expression Segmentation

Read full text
Authors: Wenxin Chen, Mengxue Qu, Weitai Kang, Yan Yan, Yao Zhao, Yunchao Wei
Cited by: 0
References: 54

Abstract

3D Referring Expression Segmentation (3D-RES) typically requires extensive instance-level annotations for fully supervised learning, a process that is both time-consuming and costly. Semi-supervised learning (SSL) can address this by using a small amount of labeled data and a large amount of unlabeled data, improving performance while reducing the annotation costs. SSL adopts a teacher-student learning paradigm, where the teacher produces pseudo-labels to guide the student, often using high-confidence threshold filtering to improve pseudo-label quality. However, in the context of 3D-RES, where each label corresponds to a single mask and labeled data is scarce, existing SSL methods treat high-quality pseudo-labels merely as auxiliary supervision, which hinders their ability to fully boost the model's learning potential. The reliance on high-confidence thresholds for filtering often results in potentially valuable pseudo-labels being discarded, restricting the model's ability to leverage the abundant unlabeled data. Therefore, we identify two critical challenges in semi-supervised 3D-RES, namely, inefficient utilization of highquality pseudo-labels and wastage of useful information from lowquality pseudo-labels. In this paper, we introduce the first semisupervised learning framework for 3D-RES, presenting a robust baseline method named 3DResT. To address these challenges, we propose two novel designs called Teacher-Student Consistency- Based Sampling (TSCS) and Quality-Driven Dynamic Weighting (QDW). TSCS aids in the selection of high-quality pseudo-labels, integrating them into the labeled dataset to strengthen the labeled supervision signals. QDW preserves low-quality pseudo-labels by dynamically assigning them lower weights, allowing for the effective extraction of useful information rather than discarding them. Extensive experiments conducted on the widely used benchmark demonstrate the effectiveness of our method. Notably, with only 1 points compared to the fully supervised method. Code will be available at:https://github.com/Wind010321/3DResT

Fields of Study & Subjects

3D Shape Modeling and Analysis Advanced Neural Network Applications Multimodal Machine Learning Applications

Publication details

Journal / source
IEEE Transactions on Multimedia
Volume
28
Pages
5262–5272
Publication date
1 January 2026
Language
EN