Rethinking Discrete Speech Representation Tokens for Accent Generation

Read full text
Authors: Jinzuomu Zhong, Yi Wang, Korin Richmond, Peter Bell
Cited by: 0

Abstract

Discrete Speech Representation Tokens (DSRTs) have become a foundational component in speech generation. While prior work has extensively studied phonetic and speaker information in DSRTs, how accent information is encoded in DSRTs remains largely unexplored. In this paper, we present the first systematic investigation of accent information in DSRTs. We propose a unified evaluation framework that measures both accessibility of accent information via a novel Accent ABX task and recoverability via cross-accent Voice Conversion (VC) resynthesis. Using this framework, we analyse DSRTs derived from several widely used speech representations. Our results reveal that: (1) choice of layers has the most significant impact on retaining accent information, (2) accent information is substantially reduced by ASR supervision; (3) naive codebook size reduction cannot effectively disentangle accent from phonetic and speaker information.

Fields of Study & Subjects

Speech Recognition and Synthesis Speech and Audio Processing Phonetics and Phonology Research

Publication details

Journal / source
arXiv (Cornell University)
Publication date
27 January 2026
Document type
Preprint