Low-Latency Audio Front-End Region-of-Interest Beamforming for Smart Glasses

View at publisher
Authors: Ariel Frank, Israel Cohen
Cited by: 1
References: 30

Abstract

In wearable audio capture, region-of-interest (ROI) beamforming improves robustness to direction-of-arrival uncertainty while aligning acquisition with the wearer’s field of view. Least-distortion maximum-gain (LDMG) ROI beamformers have been proposed in both the time domain and the short-time Fourier transform (STFT) domain, but their trade-offs for smart-glasses front ends remain unclear. We develop a unified formulation that subsumes both implementations, makes their approximations explicit, and enables a fair, streaming-aware comparison. Using real multichannel recordings from a smart-glasses platform, we quantify algorithmic latency and real-time complexity and benchmark speech enhancement and spatial selectivity. Across all tested conditions, the time-domain implementation delivers higher performance with 2× lower algorithmic latency, at the cost of increased computation. These results indicate that, when low latency is critical and modest additional on-device computing power is available, time-domain ROI beamforming is the preferred choice for smart-glasses front ends.

Fields of Study & Subjects

Speech and Audio Processing Hearing Loss and Rehabilitation Music Technology and Sound Studies

Publication details

Journal / source
ICASSP 2026 - 2026 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)
Publisher
IEEE
Pages
14727–14731
Publication date
21 April 2026