Accessible Real-Time Chart Interpretation for the Visually Impaired: Bridging the Gap in Data Accessibility

Read full text
Authors: Joo-Hyun Park, SungHeon Jeong, Yoojeong Song
Cited by: 0

Abstract

This study addresses the growing need for real-time chart captioning systems that improve accessibility for visually impaired individuals in remote communication environments. As online education and virtual meetings increasingly rely on visual data such as charts and infographics, visually impaired users face challenges in accessing critical information. We propose an AI-driven system designed to interpret and generate real-time captions for various types of charts. The model integrates object detection, caption generation, and temporal tracking to provide accurate and responsive descriptions aligned with live presentations. Unlike traditional methods that rely on post-event captions or manual assistance, our system offers real-time support, enhancing users’ ability to participate in online discussions and decision-making processes. The generated captions are context-aware and optimized for auditory delivery, ensuring clarity and relevance. We evaluate the system using publicly available datasets and real-world lecture videos to validate its performance in terms of accuracy, latency, and user satisfaction. Our findings show that the model significantly improves accessibility without compromising performance. This research contributes to inclusive digital environments by bridging the gap in data comprehension for visually impaired users during remote communication.

Fields of Study & Subjects

Digital Accessibility for Disabilities Subtitles and Audiovisual Media Multimodal Machine Learning Applications

Publication details

Journal / source
Journal of Korea Multimedia Society
Volume
29
Issue
1
Pages
34–44
Publication date
31 January 2026
Language
EN