Home / Current Issue / Paper 1716490
Assistive Communication Framework
Subject area: Science,Engineering and Technology · Area of research: Artificial Intelligence and Data Science
DOI: https://doi.org/10.64388/IREV9I10-1716490
Abstract
Assistive communication technologies have significantly improved the quality of life for individuals with speech and motor impairments. However, existing systems often rely on unimodal inputs such as text or voice, limiting their usability in real-world scenarios. This paper proposes a deep learning-based multimodal assistive communication framework that integrates visual, auditory, and textual inputs to enable robust and adaptive communication. The framework leverages convolutional neural networks (CNNs), recurrent neural networks (RNNs), and transformer-based architectures for feature extraction and fusionExperimental results demonstrate improved accuracy, responsiveness, and usability compared to traditional systems.The proposed system aims to provide an inclusive, scalable, and real- time communication solution. and few lines Furthermore, an attention-based multimodal fusion strategy is employed to effectively combine heterogeneous features and improve contextual understanding. The system is designed to operate reliably under noisy and dynamic conditions by handling incomplete or ambiguous inputs from different modalities. User-centric design considerations are incorporated to ensure accessibility, ease of use, and real-time responsiveness Experimental results demonstrate improved accuracy, responsiveness, and usability compared to traditional unimodal systems. The proposed framework shows strong potential for deployment in real-world assistive applications, providing an inclusive, scalable, and intelligent communication solution.
Keywords
Assistive Communication, Multimodal Learning, Deep Learning, CNN, RNN, Transformer, Human-Computer Interaction
How to cite this paper
@article{1716490,
author = {M Nithya, V Priya, S Rajeswari, S Harini},
title = {Assistive Communication Framework},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {9},
number = {10},
pages = {2031-2035},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1716490.pdf},
abstract = {Assistive communication technologies have significantly improved the quality of life for individuals with speech and motor impairments. However, existing systems often rely on unimodal inputs such as text or voice, limiting their usability in real-world scenarios. This paper proposes a deep learning-based multimodal assistive communication framework that integrates visual, auditory, and textual inputs to enable robust and adaptive communication. The framework leverages convolutional neural networks (CNNs), recurrent neural networks (RNNs), and transformer-based architectures for feature extraction and fusionExperimental results demonstrate improved accuracy, responsiveness, and usability compared to traditional systems.The proposed system aims to provide an inclusive, scalable, and real- time communication solution. and few lines Furthermore, an attention-based multimodal fusion strategy is employed to effectively combine heterogeneous features and improve contextual understanding. The system is designed to operate reliably under noisy and dynamic conditions by handling incomplete or ambiguous inputs from different modalities. User-centric design considerations are incorporated to ensure accessibility, ease of use, and real-time responsiveness Experimental results demonstrate improved accuracy, responsiveness, and usability compared to traditional unimodal systems. The proposed framework shows strong potential for deployment in real-world assistive applications, providing an inclusive, scalable, and intelligent communication solution.},
keywords = {Assistive Communication, Multimodal Learning, Deep Learning, CNN, RNN, Transformer, Human-Computer Interaction},
month = {April},
doi = {https://doi.org/10.64388/IREV9I10-1716490}
}