MedSpeak: A Knowledge Graph-Aided ASR Error Correction Framework for Spoken Medical QA

Read full text
Authors: Yutong Song, Shiva Shrestha, Chenhan Lyu, Elahe Khatibi, Pengfei Zhang, Honghui Xu, Nikil Dutt, Amir M. Rahmani
Cited by: 0

Abstract

Spoken question-answering (SQA) systems relying on automatic speech recognition (ASR) often struggle with accurately recognizing medical terminology. To this end, we propose MedSpeak, a novel knowledge graph-aided ASR error correction framework that refines noisy transcripts and improves downstream answer prediction by leveraging both semantic relationships and phonetic information encoded in a medical knowledge graph, together with the reasoning power of LLMs. Comprehensive experimental results on benchmarks demonstrate that MedSpeak significantly improves the accuracy of medical term recognition and overall medical SQA performance, establishing MedSpeak as a state-of-the-art solution for medical SQA. The code is available at https://github.com/RainieLLM/MedSpeak.

Fields of Study & Subjects

Speech Recognition and Synthesis Natural Language Processing Techniques Topic Modeling

Publication details

Journal / source
arXiv (Cornell University)
Publication date
1 February 2026
Document type
Preprint