Eye Controlled Mouse Cursor for Physically Disabled Individual using CNN

• Author(s): M. Rajamani; M Balamurugan; R Surya
• Paper ID: 1717896
• Page: 2322-2328
• Published Date: 18-05-2026
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 9 Issue 11 May-2026

Abstract

This paper presents an eye-controlled mouse cursor system designed to assist physically disabled individuals in interacting with computers using natural facial gestures. The proposed system utilizes a standard webcam to capture real-time video input and employs Convolutional Neural Networks (CNNs) for accurate detection and classification of facial gestures. Eye movements are tracked to control cursor position, while specific gestures—including deliberate single eye blink, mouth opening, and both eyes closed—are mapped to left-click, right-click, and click-and-drag actions respectively. The system integrates multiple modules: face detection using pre-trained models, eye and mouth region extraction through facial landmarks, CNN-based state classification for eyes and mouth, and gaze tracking for cursor movement. Temporal filters and confirmation mechanisms are incorporated to distinguish intentional gestures from involuntary actions such as natural blinking or speaking, thereby minimizing false triggers. The system operates in real- time under varying lighting conditions and head orientations without requiring specialized hardware or physical attachments. Experimental results demonstrate high accuracy in gesture recognition and smooth cursor control, offering an affordable, non-invasive, and intuitive assistive technology solution. This work contributes to enhancing digital accessibility and independence for individuals with motor impairments, promoting greater inclusion in education, employment, and daily computer-based activities.

Keywords

Eye-Controlled Mouse, Assistive Technology, Convolutional Neural Networks, Facial Gesture Recognition, Human-Computer Interaction, Computer Vision, Physically Disabled Individuals

Citations

IRE Journals:
M. Rajamani, M Balamurugan, R Surya "Eye Controlled Mouse Cursor for Physically Disabled Individual using CNN" Iconic Research And Engineering Journals Volume 9 Issue 11 2026 Page 2322-2328 https://doi.org/10.64388/IREV9I11-1717896

IEEE:
M. Rajamani, M Balamurugan, R Surya "Eye Controlled Mouse Cursor for Physically Disabled Individual using CNN" Iconic Research And Engineering Journals, 9(11) https://doi.org/10.64388/IREV9I11-1717896