31.7 LUT-SSM: A 99.3TFLOPS/W LUT-Based State-Space Model Accelerator Using Energy-Efficient Element-Wise Layer Fusion and LUT-Friendly Weight-Only Quantization

View at publisher
Authors: S. J. Ben Yoo, Dongyun Kam, Gunho Park, Soonhyun Kwon, D. H. Lee, Youngjoo Lee
Cited by: 0
References: 6

Abstract

State-space models (SSMs) and weight-only quantization alleviate huge external memory access with a minimal accuracy degradation. To support both efficiently, we propose LUTSSM, a LUT-based SSM accelerator with a many-to-many LUT-ACC and an element-wise (EW) layer fusion. LUT-SSM efficiently supports INT-FP GEMM and sequential EW operations in the SSM blocks. Fabricated in 28nm FD-SOI, LUT-SSM achieves 99.3TFLOPS/W peak efficiency and 96.1TFLOPS/W on Mamba 1.4B, improving energy efficiency by$1.28 \times$over recent designs.

Fields of Study & Subjects

Low-power high-performance VLSI design Advanced Neural Network Applications Advanced Memory and Neural Computing

Publication details

Journal / source
Digest of technical papers/Digest of technical papers - IEEE International Solid-State Circuits Conference
Pages
544–546
Publication date
15 February 2026
Language
EN