AI-Based Multisensory Aid for the Blind and Deaf

Individuals who are blind and deaf face major challenges in performing daily activities such as navigation, communication, reading printed text, and identifying surround- ing objects. Most existing assistive technologies are designed to support only a single sensory impairment and rely heavily on audio-based feedback, which is ineffective for users with hearing loss. This paper presents an AI-based multisensory assistive system developed to support individuals with dual sensory impairments. The proposed system integrates computer vision and machine learning techniques including object detection, currency detection, sign language recognition, and Optical Character Recognition (OCR). Visual inputs captured through a camera are processed using deep learning models, and the extracted information is conveyed to the user through tactile feedback using vibration alerts and Braille-based output. The system aims to improve independence, safety, and accessibility in everyday activities.