Double-Precision Matrix Multiplication Emulation via Ozaki-II Scheme with FP8 Quantization

Read full text
Authors: Yuki Uchino, Katsuhisa Ozaki, Toshiyuki Imamura
Cited by: 1

Abstract

In this paper, we propose a method for emulating double-precision general matrix--matrix multiplication (DGEMM), a fundamental and performance-critical kernel in many high-performance computing applications. Ozaki-I and Ozaki-II are established DGEMM emulation schemes via low-precision matrix multiply-accumulate (MMA) units. For the Ozaki-I scheme, INT8-, FP8-, and FP16-based implementations have been proposed, all of which can be realized based on the same underlying algorithmic structure. In contrast, although INT8-based implementations of the Ozaki-II scheme have been reported, the original algorithm cannot be directly adapted to exploit FP8 MMA units. In several recent architectures, such as NVIDIA Blackwell Ultra and NVIDIA Rubin, INT8 performance has been reduced, making reliance on INT8 alone insufficient. Therefore, we introduce a novel technique to demonstrate DGEMM emulation based on the Ozaki-II scheme that operates on FP8 MMA units. Compared to the FP8-based Ozaki-I scheme, our method significantly reduces the computational cost and enables efficient FP64 emulation.

Fields of Study & Subjects

Numerical Methods and Algorithms Parallel Computing and Optimization Techniques Advanced Data Storage Technologies

Publication details

Journal / source
arXiv (Cornell University)
Publication date
11 March 2026
Document type
Preprint