Universal Approximation of Operators with Transformers and Neural Integral Operators
Abstract
We study the universal approximation properties of transformers and neural integral operators for operators in Banach spaces. In particular, we show that the transformer architecture is a universal approximator of integral operators between Hölder spaces. Moreover, we show that a generalized version of neural integral operators, based on the Gavurin integral, treats them as universal approximators of arbitrary operators between Banach spaces. Lastly, we show that a modified version of the transformer, which uses Leray–Schauder mappings, is a universal approximator of operators between arbitrary Banach spaces.
Fields of Study & Subjects
Approximation Theory and Sequence Spaces
Neural Networks and Applications
Publication details
- Journal / source
- Axioms
- Volume
- 15
- Issue
- 9
- Pages
- 676–676
- Publication date
- 11 September 2026
- Language
- EN