A self-supervised transformer for RF cavity signal denoising

A frequent occurrence within industrial particle accelerator systems is electromagnetic noise accumulating within RF Cavity Sensor readings, attributed to their electromagnetically dirtier operating environments and production, with less of an emphasis on their performance optimization. This phenomenon prevents signals from accurately relaying information to beam operators and specialists. Additionally, noisy signals inhibit the ability for feedback loops to meet their regulation requirements, making machine control much more difficult. Previous work has shown machine learning-based techniques as promising solutions for denoising that maintains signal quality and features. In this paper, we design, implement, and benchmark a self-supervised transformer-based machine learning algorithm that denoises In-Phase and Quadrature (I/Q) RF Cavity Signals without a need for referencing a clean ground-truth.