Tensor-Core-Optimized Strategies for BLR × Tall-Skinny Matrix Multiplication in BEM

Read full text
Authors: Akihiro Ida, Kazuya Goto, Rio Yokota, Tasuku Hiraishi, Toshihiro Hanawa, Takeshi Iwashita, Masatoshi Kawai, Satoshi Ohshima, Tetsuya Hoshino
Cited by: 1
References: 30

Abstract

Recent AI-oriented accelerators, such as Tensor Cores embedded on NVIDIA GPUs, provide substantially higher throughput for matrix operations than conventional HPC units. This paper presents strategies to exploit Tensor Cores for accelerating a key kernel in the boundary element method (BEM): the multiplication of a Block Low-Rank (BLR) matrix, which approximates a dense matrix through blockwise low-rank representations, by a tall–skinny dense matrix. While a dense matrix derived from conventional BEM requires O(N2) memory, BLR reduces this to O(N1.5) by compressing far-field interactions, but its irregular block sizes and varying ranks hinder efficient Tensor Core utilization. To address this challenge, we introduce Full-Depth Tree with Equal Division (FDE) to generate uniform block shapes compatible with batched GEMM operations, and Sliced Rank Alignment (SRA) to minimize zero-padding overhead along the rank dimension while satisfying Tensor Core alignment constraints. Numerical experiments on NVIDIA A100 GPUs demonstrate that the proposed FDE+SRA approach achieves up to three times faster performance than a straightforward BLR implementation and more than twice as fast as dense matrix multiplication, while significantly reducing memory usage. For large-scale problems and multiple righthand sides, the method reaches nearly 75% of the Tensor Core’s peak performance, demonstrating the effectiveness of AI-oriented hardware for BLR-based computations.

Fields of Study & Subjects

Tensor decomposition and applications Parallel Computing and Optimization Techniques Matrix Theory and Algorithms

Publication details

Journal / source
Proceedings of the Supercomputing Asia and International Conference on High Performance Computing in Asia Pacific Region
Publisher
ACM
Pages
153–164
Publication date
9 January 2026