An Interactive MFCC-Driven Hierarchical Clustering Framework for Automatic Speaker Diarization with Visual Analytics

Read full text
Authors: Sayyada Sara Banu, Ratnadeep R. Deshmukh
Cited by: 0

Abstract

Automatic Speaker Diarization (ASD) is the task of determining "who spoke when" in multi-speaker audio recordings without prior speaker labels.This paper presents a transparent, tunable, and GUI-driven diarization framework that integrates MFCC + Δ + Δ² embeddings, adaptive percentile-based Voice Activity Detection (VAD), and Agglomerative Hierarchical Clustering (AHC) with configurable distance metrics and linkage strategies.The system provides complete control over preprocessing, segmentation, clustering, and post-processing, while offering rich visual analytics including waveform-aligned speaker timelines, spectrograms, MFCC heatmaps, PCA-based embedding scatter plots, Silhouette-driven cluster diagnostics, and conversational metrics.Experimental evaluation shows that the proposed MFCC + AHC pipeline achieves stable speaker grouping with clear cluster separation and reduced fragmentation after post-processing, achieving a diarization error rate between 5.8% and 8.1% on test recordings.The tool supports RTTM/CSV/JSON export and is suitable for research, education, conversational analysis, and domain-specific diarization studies requiring interpretability and flexibility.

Fields of Study & Subjects

Speech Recognition and Synthesis Speech and Audio Processing Music and Audio Processing

Publication details

Journal / source
International Journal of Computer Applications
Volume
187
Issue
77
Pages
28–34
Publication date
31 January 2026