Integrating High Performance In-Memory Data Streaming and In-Situ Visualization in Hybrid MPI+OpenMP PIC MC Simulations Towards Exascale

Read full text
Authors: Jeremy J. Williams, S. Costea, Daniel Medeiros, Jordy Trilaksono, Pratibha Hegde, D. Tskhakaya, L. Kos, A. Podolník, Jakub Hromádka, Kevin Huck, Allen D. Malony, F. Jenko
+2 more Erwin Laure, Stefano Markidis
Cited by: 2
References: 19

Abstract

Efficient simulation of complex plasma dynamics is crucial for advancing fusion energy research. Particle-in-Cell (PIC) Monte Carlo (MC) simulations provide insights into plasma behavior, including turbulence and confinement, which are essential for optimizing fusion reactor performance. Transitioning to exascale simulations introduces significant challenges, with traditional file input/output (I/O) inefficiencies remaining a key bottleneck. This work advances BIT1, an electrostatic PIC MC code, by improving the particle mover with OpenMP task-based parallelism, integrating the openPMD streaming API, and enabling in-memory data streaming with the ADIOS2 Sustainable Staging Transport (SST) engine to enhance I/O performance, computational efficiency, and system storage utilization. We employ profiling tools such as gprof, perf, IPM and Darshan, which provide insights into computation, communication, and I/O operations. We implement time-dependent data checkpointing with the openPMD API enabling seamless data movement and in-situ visualization for real-time analysis without interrupting the simulation. We demonstrate improvements in simulation runtime, data accessibility and real-time insights by comparing traditional file I/O with the ADIOS2 BP4 and SST backends. The proposed hybrid BIT1 openPMD SST enhancement introduces a new paradigm for real-time scientific discovery in plasma simulations, enabling faster insights and more efficient use of exascale computing resources.

Fields of Study & Subjects

Magnetic confinement fusion research Space Technology and Applications Advanced Data Storage Technologies

Publication details

Journal / source
The International Journal of High Performance Computing Applications
Publisher
SAGE Publications
Volume
40
Issue
5
Pages
656–671
Publication date
23 January 2026
Language
EN