Debiased Orthogonal Boundary-Driven Efficient Noise Mitigation

Read full text
Authors: Hao Li, Junfeng Gu, J. J. Song, An Zhang, Lianli Gao
Cited by: 0

Abstract

Mitigating the detrimental effects of noisy labels on the training process has become increasingly critical, as obtaining entirely clean or human-annotated samples for large-scale pretraining tasks is often impractical.Nonetheless, existing noise mitigation methods often encounter limitations in practical applications due to their task-specific design, model dependency, and significant computational overhead.In this work, we exploit the properties of high-dimensional orthogonality to identify a robust and effective boundary in cone space for separating clean and noisy samples.Building on this, we propose One-Step Antinoise (OSA), a model-agnostic noisy label mitigation paradigm that employs an estimator model and a scoring function to assess the noise level of input pairs through just one-step inference.We empirically validate the superiority of OSA, demonstrating its enhanced training robustness, improved task transferability, streamlined deployment, and reduced computational overhead across diverse benchmarks, models, and tasks.Our code is released at https://github.com/leolee99/OSA. Clarify data Warm upRectify data

Fields of Study & Subjects

Machine Learning and Data Classification

Publication details

Pages
3643–3662
Publication date
1 January 2026
Language
EN