Current Volume 9
Abstract
With the rapid advancement of AI-powered communication tools, voice phishing — commonly known as vishing — has emerged as one of the most deceptive forms of cybercrime. Attackers impersonate trusted entities over phone calls to manipulate victims into disclosing sensitive data such as banking credentials, OTPs, and personal identification details. Conventional defenses like caller ID screening and spam number databases are no longer adequate, as they fail to analyze the actual content and emotional tone of a conversation. This paper presents a multimodal AI system that addresses this gap by examining both the acoustic properties and linguistic content of a phone call. Audio input is first transcribed using Whisper ASR, after which TF-IDF-based Naive Bayes classification is applied on the transcript for textlevel phishing detection. Simultaneously, MFCC features extracted from the raw audio are fed into a Random Forest classifier to detect emotional cues such as urgency and stress. A fusion decision engine consolidates both outputs to produce a final verdict — Vishing or Safe — along with a confidence score. The system is deployed as a Streamlit web application. Experimental results show spam detection accuracy of 98.7%, emotion detection accuracy of 69.8%, and an overall system accuracy in the range of 90–95%.
Keywords
Voice Phishing, Vishing Detection, Whisper ASR, Natural Language Processing, TFIDF, Naive Bayes, MFCC, Random Forest, Emotion Detection, Multimodal Fusion, Cybersecurity, Fraud Detection.
Citations
IRE Journals:
Koncha Harshitha, Konduru Yaswanth Raju, Harshith G H, K V V Yashwanth, Nermitha S "Voice Phishing (vishing) Detection System" Iconic Research And Engineering Journals Volume 9 Issue 10 2026 Page 3251-3256 https://doi.org/10.64388/IREV9I10-1716820
IEEE:
Koncha Harshitha, Konduru Yaswanth Raju, Harshith G H, K V V Yashwanth, Nermitha S
"Voice Phishing (vishing) Detection System" Iconic Research And Engineering Journals, 9(10) https://doi.org/10.64388/IREV9I10-1716820
About IRE Journals
IRE Journals is an open access online journals established with an aim to publish high quality of research work in various diciplines. We have more than 6 years in publications. Over 2500+ papers already published.
Important Links
For Authors
Volume 8:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 7:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 6:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 5:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 4:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12Volume 3:
Issue 1, Issue 2, Issue 3, Issue 4, Issue 5, Issue 6, Issue 7, Issue 8, Issue 9, Issue 10, Issue 11, Issue 12