Develop A Real-Time Closed Captioning Solution with Simplified Captions in Multiple Indian Languages for Accessibility and Inclusivity of Deaf and Hard-Of-Hearing Individuals

DOI

https://www.doi.org/10.59256/indjcst.20260501C003

Conference

International Conference on Cyber and AI Security

Organised By

Madanapalle Institute of Technology & Science (MITS)

Conference Date

9 & 10 March 2026

Pages

14-22

Article Type

Research Article

Check for updates

The Deaf and hard-of-hearing communities are facing great challenges in accessing spoken language information within real-time environments such as online education services, conferences, meetings, or any form of digital media. The use of closed captioning has offered these communities a way of accessing audio information in textual form. The existing approaches that offer similar services have, however, proved to be inadequate, such as the limited support of Indian regional languages, the usage of complex language, lengthy sentences, and difficulty in reading them within real-time environments. The proposed idea is a real-time closed captioning system that provides simple sentences within these environments, and its outputs are translated into various Indian languages such as Hindi, Tamil, Telugu, Malayalam, Kannada, Gujarati, and others. The proposed system uses automatic speech recognition, natural language processing-based text simplification, and machine translation technologies. The proposed solution seeks to enhance accessibility, inclusiveness, and the overall level of participation among Deaf and hard-of-hearing communities within diverse language environments. The proposed solution has wide applicability within classrooms, conferences, and digital media.