Top-Theta Attention: Sparsifying Transformers by Compensated Thresholding

Lecture notes in computer science 2026 Open access

Read full text

Authors: Konstantin Berestizshevsky, Renzo Andri, Lukas Cavigelli

DOI: 10.1007/978-3-032-38398-3_54

Cited by: 0

Fields of Study & Subjects

Neural Networks and Applications Stochastic Gradient Optimization Techniques Advanced Neural Network Applications