RoadWatchAI: Intelligent Pothole Detection with Android Camera

• Author(s): Rajesh Kanna S; Yogesh P
• Paper ID: 1717869
• Page: 2205-2213
• Published Date: 18-05-2026
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 9 Issue 11 May-2026

Abstract

This paper presents a novel multimodal deep learning framework for pothole detection that addresses the critical limitations of traditional approaches, which typically rely on single-modal data sources and suffer from high false positive rates and poor performance across varying road conditions. The proposed system integrates visual data from cameras, vibration data from accelerometers, and spatial information from GPS sensors through feature-level fusion using Multiple Scale Convolutional Neural Networks (MSCNN), enabling robust detection of both small and large potholes across diverse environmental conditions. To further enhance accuracy and interpretability, the framework employs an ensemble learning strategy incorporating a deep neural decision forest that extracts abstract features while maintaining interpretable decision boundaries, with hyperparameters optimized through a hybrid Genetic Algorithm and Gradient-Based Refinement approach. Experimental results demonstrate that this multimodal fusion approach significantly improves detection reliability compared to unimodal systems, effectively capturing pothole variations in size, road surface characteristics, and sensor noise conditions. The system's ability to cohesively integrate multiple sensor modalities through MSCNN feature extraction, combined with ensemble learning and advanced optimization techniques, provides a comprehensive solution for real-time road condition monitoring that can positively impact road maintenance operations and traffic safety management.

Keywords

Multimodal Deep Learning, Feature-Level Fusion, Multiple Scale Convolutional Neural Networks, Ensemble Learning, Real-Time Pothole Detection, Road Condition Monitoring

Citations

IRE Journals:
Rajesh Kanna S, Yogesh P "RoadWatchAI: Intelligent Pothole Detection with Android Camera" Iconic Research And Engineering Journals Volume 9 Issue 11 2026 Page 2205-2213 https://doi.org/10.64388/IREV9I11-1717869

IEEE:
Rajesh Kanna S, Yogesh P "RoadWatchAI: Intelligent Pothole Detection with Android Camera" Iconic Research And Engineering Journals, 9(11) https://doi.org/10.64388/IREV9I11-1717869