Relating the Neural Representations of Vocalized, Mimed, and Imagined Speech

Read full text
Authors: Maryam Maghsoudi, Rupesh Chillale, Shihab Shamma
Cited by: 0

Abstract

We investigated the relationship among neural representations of vocalized, mimed, and imagined speech recorded using publicly available stereotactic EEG recordings.Most prior studies have focused on decoding speech responses within each condition separately.Here, instead, we explore how responses across conditions relate by training linear spectrogram reconstruction models for each condition and evaluate their generalization across conditions.We demonstrate that linear decoders trained on one condition generally transfer successfully to others, implying shared speech representations.This commonality was assessed with stimulus-level discriminability by performing a rank-based analysis demonstrating preservation of stimulusspecific structure in both within-and across-conditions.Finally, we compared linear reconstructions to those from a nonlinear neural network.While both exhibited cross-condition transfer, linear models achieve superior stimulus-level discriminability.

Fields of Study & Subjects

Neurobiology of Language and Bilingualism Speech Recognition and Synthesis Speech and Audio Processing

Publication details

Journal / source
Interspeech (USB)
Pages
4785–4789
Publication date
27 September 2026
Language
EN