Vulnerability analysis of transformer-based optical character recognition to adversarial attacks
Abstract
We present a novel framework to assess the resilience of state-of-the-art transformer-based optical character recognition (TrOCR) models. In this way, we develop new untargeted and targeted attack algorithms. On a benchmark handwriting dataset, we show that adversarial perturbations to the input reveal dramatic vulnerabilities without being noticeable to the eye. This article is part of the theme issue 'Safe, secure and robust AI for safety-critical systems'.
Fields of Study & Subjects
Adversarial Robustness in Machine Learning
Publication details
- Journal / source
- Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences
- Volume
- 384
- Issue
- 2324
- Publication date
- 16 July 2026
- Language
- EN