An Interactive MFCC-Driven Hierarchical Clustering Framework for Automatic Speaker Diarization with Visual Analytics
Abstract
Automatic Speaker Diarization (ASD) is the task of determining "who spoke when" in multi-speaker audio recordings without prior speaker labels.This paper presents a transparent, tunable, and GUI-driven diarization framework that integrates MFCC + Δ + Δ² embeddings, adaptive percentile-based Voice Activity Detection (VAD), and Agglomerative Hierarchical Clustering (AHC) with configurable distance metrics and linkage strategies.The system provides complete control over preprocessing, segmentation, clustering, and post-processing, while offering rich visual analytics including waveform-aligned speaker timelines, spectrograms, MFCC heatmaps, PCA-based embedding scatter plots, Silhouette-driven cluster diagnostics, and conversational metrics.Experimental evaluation shows that the proposed MFCC + AHC pipeline achieves stable speaker grouping with clear cluster separation and reduced fragmentation after post-processing, achieving a diarization error rate between 5.8% and 8.1% on test recordings.The tool supports RTTM/CSV/JSON export and is suitable for research, education, conversational analysis, and domain-specific diarization studies requiring interpretability and flexibility.
Fields of Study & Subjects
Speech Recognition and Synthesis
Speech and Audio Processing
Music and Audio Processing
Publication details
- Journal / source
- International Journal of Computer Applications
- Volume
- 187
- Issue
- 77
- Pages
- 28–34
- Publication date
- 31 January 2026