Smart-Claim: AI-Based Vehicle Damage Detection and Estimation Using YOLO and Large Language Models

References

[1] J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, “You Only Look Once: Unified Real-Time Object Detection,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.

[2] J. Redmon and A. Farhadi, “YOLOv3: An Incremental Improvement,” arXiv preprint arXiv:1804.02767, 2018.

[3] S. Ren, K. He, R. Girshick, and J. Sun, “Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017.

[4] W. Liu et al., “SSD: Single Shot MultiBox Detector,” European Conference on Computer Vision (ECCV), 2016.

[5] Krizhevsky, I. Sutskever, and G. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” Advances in Neural Information Processing Systems, 2012.

[6] K. He, X. Zhang, S. Ren, and J. Sun, “Deep Residual Learning for Image Recognition,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016.

[7] D. Kingma and J. Ba, “Adam: A Method for Stochastic Optimization,” International Conference on Learning Representations (ICLR), 2015.

[8] T. Chen and C. Guestrin, “XGBoost: A Scalable Tree Boosting System,” ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016.

[9] Goodfellow, Y. Bengio, and A. Courville, “Deep Learning,” MIT Press, 2016.

[10] Vaswani et al., “Attention Is All You Need,” Advances in Neural Information Processing Systems, 2017.

[11] NVIDIA Corporation, “Nemotron Large Language Model Documentation,” NVIDIA AI Research, 2024.

[12] Google AI Research, “Gemini: A Family of Highly Capable Multimodal Models,” Google Research Publications, 2024.

[13] R. Szeliski, “Computer Vision: Algorithms and Applications,” Springer, 2010.

[14] M. Abadi et al., “TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems,” Google Research, 2015.

[15] Rosebrock, “Deep Learning for Computer Vision with Python,” PyImageSearch Publications, 2019.

[16] Z. Chen, T. Ellis, and S. A. Velastin, “Vehicle Damage Detection Using Deep Learning Techniques,” IEEE International Conference on Image Processing (ICIP), 2019.

[17] T.-Y. Lin et al., “Microsoft COCO: Common Objects in Context,” Proceedings of the European Conference on Computer Vision (ECCV), 2014.

[18] Long, E. Shelhamer, and T. Darrell, “Fully Convolutional Networks for Semantic Segmentation,” Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015.

[19] Simonyan and A. Zisserman, “Very Deep Convolutional Networks for Large-Scale Image Recognition,” International Conference on Learning Representations (ICLR), 2015.

[20] Dosovitskiy et al., “An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale,” International Conference on Learning Representations (ICLR), 2021.

@article{1715302,
      author = {Asan Nainar M , Jeevanandan B K},
      title = {Smart-Claim: AI-Based Vehicle Damage Detection and Estimation Using YOLO and Large Language Models},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {9},
      number = {9},
      pages = {1675-1679},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1715302.pdf},
      abstract = {Vehicle damage inspection is an essential step in insurance claim processing and vehicle repair management. Traditional inspection procedures rely on manual verification by surveyors, which often results in delays, human errors, and inconsistencies in repair estimation. To address these challenges, this research proposes Smart-Claim, an artificial intelligence-based system designed to automate vehicle damage detection and provide repair estimation insights using computer vision and large language models. The system utilizes the YOLO object detection model to identify damaged regions in vehicle images uploaded by users. The detected damage information is analyzed using NVIDIA Nemotron-3 API powered by the Llama 3.1 90B large language model to generate intelligent estimation insights. The application is implemented using React for the frontend, Python Flask for the backend, and MySQL for database management. Experimental results demonstrate that the proposed system significantly reduces inspection time and enhances efficiency in insurance claim evaluation.},
      keywords = {Artificial Intelligence, Computer Vision, Vehicle Damage Detection, YOLO, Insurance Claim Automation, Deep Learning.},
      month = {March},
      doi = {https://doi.org/10.64388/IREV9I9-1715302}
  }