Beyond Balance–Addressing class imbalance in fine-tuning deep learners

Read full text Summarise with VIRAT
Authors: Moritz Mock, Thomas Borsani, Giuseppe Di Fatta, Barbara Russo
Cited by: 0
References: 22

Summary

No summary yet. VIRAT can read this paper and write a plain-language summary of its aim, methods, key findings and limitations.

Summarise with VIRAT Free to try with your Science Catalogs account.

Abstract

• Extends the prior NLBSE tool competition work with an additional model family (SetFit). • Transforms the prototype into a reusable tool ( Beyond Balance ), providing easy-to-use access to the implemented loss-weighting strategies. • Compares the performance impact of loss-weighting across various strategies and model families. • Evaluates the generalizability of loss-weighting across two benchmark datasets from the NLBSE’24 and NLBSE’25 tool competitions. Datasets often contain heavily underrepresented classes. Class imbalance biases models toward frequent classes, reducing performance on rare but important categories; in-process strategies such as loss-weighting remain under-explored for software engineering artefacts. We investigate loss-weighting functions for code comment classification and package our methods into Beyond Balance , a reusable implementation offering multiple weighting strategies for Transformer- and Sentence-Transformer–based models. Loss weighting consistently improves F1 performance across datasets, demonstrating an effective and easily adoptable imbalance-handling technique through Beyond Balance .

Fields of Study & Subjects

Software Engineering Research Imbalanced Data Classification Techniques Topic Modeling

Publication details

Journal / source
Science of Computer Programming
Volume
253
Pages
103474–103474
Publication date
21 March 2026
Language
EN