StabiFreeze: Early Stopping for Training Binary Neural Networks via Internal Dynamics Stabilization

View at publisher
Authors: Jisu Kim, Tae‐Hwan Kim
Cited by: 0
References: 13

Abstract

Binary neural networks (BNNs) offer significant efficiency in memory and computation during inference, making them promising for on-device applications. However, training BNNs remains computationally intensive, which limits their primary use to inference rather than ondevice training. This paper proposes StabiFreeze, a layerwise freezing framework that detects stabilization in convolution and batch normalization layers using a stabilitybased criterion. On CIFAR-100, StabiFreeze achieves up to $67.63 \%$ reduction in total training computation, completing training with $56.75 \%$ fewer epochs, while incurring accuracy degradation of only $0.30 \%$ and $0.54 \%$ for BinaryNet and XNOR-Net, respectively. Evaluation results on Raspberry Pi 4 and Jetson Nano show that StabiFreeze reduces training time by $80.46 \%$ and $62.56 \%$, with a $0.20 \%$ decrease and $0.07 \%$ increase in accuracy, respectively. These results demonstrate that StabiFreeze enables efficient and practical BNN training in resource-constrained edge environments.

Fields of Study & Subjects

Advanced Neural Network Applications Stochastic Gradient Optimization Techniques Neural Networks and Applications

Publication details

Journal / source
Asia and South Pacific Design Automation Conference (ASP-DAC)
Pages
1006–1012
Publication date
19 January 2026
Language
EN