Automating Customer Support: A Study on the Efficacy of Machine Learning-Driven Chatbots and Virtual Assistants

References

[1] Adam, M., Wessel, M., & Benlian, A. (2020). AI-based chatbots in customer service and their effects on user compliance. Electronic Markets, 30(3), 427-445.

[2] Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2018). Evaluating and Informing the Design of Chatbots. Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18), 895-906.

[3] Radziwill, N. M., & Benton, M. C. (2017). Evaluating Quality of Chatbots and Intelligent Conversational Agents. arXiv preprint arXiv:1704.04579.

[4] McLean, G., & Wilson, A. (2016). Evolving the online customer experience... is there a role for online customer support? Computers in Human Behavior, 60, 602-610.

[5] Sharma, M., & Thakur, G. S. M. (2019). A Review and Comparative Analysis of Various Machine Learning Approaches for Customer Support and Services. International Journal of Advanced Science and Technology, 28(16), 475-485.

[6] Adam, M., Wessel, M., & Benlian, A. (2020). AI-based chatbots in customer service and their effects on user compliance. Electronic Markets, 30(3), 427-445.

[7] Chung, M., Ko, E., Joung, H., & Kim, S. J. (2021). Chatbot e-service and customer satisfaction regarding luxury brands. Journal of Business Research, 123, 85-96.

[8] Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2018). Evaluating and Informing the Design of Chatbots. Proceedings of the 2018 Designing Interactive Systems Conference (DIS '18), 895-906.

[9] Radziwill, N. M., & Benton, M. C. (2017). Evaluating Quality of Chatbots and Intelligent Conversational Agents. Journal of Quality Management, 22(2), 56-67.

[10] McLean, G., & Wilson, A. (2016). Evolving the online customer experience... is there a role for online customer support? Computers in Human Behavior, 60, 602-610.

[11] Sharma, M., & Thakur, G. S. M. (2019). A Review and Comparative Analysis of Various Machine Learning Approaches for Customer Support and Services. International Journal of Advanced Science and Technology, 28(16), 475-485.

[12] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805.

[13] Field, A. (2013). Discovering Statistics Using IBM SPSS Statistics. Sage.

[14] Hochreiter, S., & Schmidhuber, J. (1997). Long Short-Term Memory. Neural Computation, 9(8), 1735-1780.

[15] Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2020). Evaluating and Informing the Design of Chatbots. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1-12.

[16] Kohavi, R. (1995). A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. International Joint Conference on Artificial Intelligence (IJCAI), 1137-1145.

[17] Liu, B. (2012). Sentiment Analysis and Opinion Mining. Morgan & Claypool Publishers.

[18] Luo, T., Tong, S., Fang, Z., & Qu, Z. (2019). Machines vs. Humans: The Impact of AI Chatbot Disclosure on Customer Purchases. Marketing Science, 38(6), 937-947.

[19] Montgomery, D. C., Peck, E. A., & Vining, G. G. (2012). Introduction to Linear Regression Analysis. John Wiley & Sons.

[20] Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language Models are Unsupervised Multitask Learners. OpenAI Blog.

[21] Shum, H. Y., He, X. D., & Li, D. (2018). From Eliza to XiaoIce: Challenges and Opportunities with Social Chatbots. Frontiers of Information Technology & Electronic Engineering, 19(1), 10-26.

[22] Sutton, R. S., & Barto, A. G. (2018). Reinforcement Learning: An Introduction. MIT Press.

[23] Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv preprint arXiv:1810.04805.

[24] Hochreiter, S., & Schmidhuber, J. (1997). Long Short-Term Memory. Neural Computation, 9(8), 1735-1780.

[25] Jain, M., Kumar, P., Kota, R., & Patel, S. N. (2020). Evaluating and Informing the Design of Chatbots. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1-12.

[26] Kohavi, R. (1995). A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection. International Joint Conference on Artificial Intelligence (IJCAI), 1137-1145.

[27] Liu, B. (2012). Sentiment Analysis and Opinion Mining. Morgan & Claypool Publishers.

[28] Luo, T., Tong, S., Fang, Z., & Qu, Z. (2019). Machines vs. Humans: The Impact of AI Chatbot Disclosure on Customer Purchases. Marketing Science, 38(6), 937-947.

[29] Montgomery, D. C., Peck, E. A., & Vining, G. G. (2012). Introduction to Linear Regression Analysis. John Wiley & Sons.

[30] Radford, A., Wu, J., Child, R., Luan, D., Amodei, D., & Sutskever, I. (2019). Language Models are Unsupervised Multitask Learners. OpenAI Blog.

[31] Shum, H. Y., He, X. D., & Li, D. (2018). From Eliza to XiaoIce: Challenges and Opportunities with Social Chatbots. Frontiers of Information Technology & Electronic Engineering, 19(1), 10-26.

[32] Sutton, R. S., & Barto, A. G. (2018). Reinforcement Learning: An Introduction. MIT Press.

[33] Ana. (2024, May 2). The Impact of Machine Learning on Modern Customer Service. Simply Contact. https://simplycontact.com/the-impact-of-machine-learning-on-modern-customer-service/

[34] Rahman, M. A. (2012). Influence of simple shear and void clustering on void coalescence. https://unbscholar.lib.unb.ca/handle/1882/13321

[35] Rahman, M. A., Butcher, C., & Chen, Z. (2012). Void evolution and coalescence in porous ductile materials in simple shear. International Journal of Fracture, 177(2), 129–139. https://doi.org/10.1007/s10704-012-9759-2

[36] Deb, R., Mondal, P., & Ardeshirilajimi, A. (2020). Bridge Decks: Mitigation of Cracking and Increased Durability—Materials Solution (Phase III). https://doi.org/10.36501/0197-9191/20-023

[37] Pillai, A. S. (2021, May 11). Utilizing Deep Learning in Medical Image Analysis for Enhanced Diagnostic Accuracy and Patient Care: Challenges, Opportunities, and Ethical Implications. https://thelifescience.org/index.php/jdlgda/article/view/13

@article{1704860,
      author = {Vamsi Katragadda},
      title = {Automating Customer Support: A Study on the Efficacy of Machine Learning-Driven Chatbots and Virtual Assistants},
      journal = {Iconic Research And Engineering Journals},
      year = {2023},
      volume = {7},
      number = {1},
      pages = {600-610},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/17048601.pdf},
      abstract = {This study investigates the efficacy of machine learning-driven chatbots and virtual assistants in automating customer support. With the growing need for businesses to provide quick, efficient, and scalable customer service, the adoption of advanced technologies like machine learning (ML) has become imperative. This research explores how these technologies are being leveraged to enhance customer support operations, comparing their performance against traditional support methods.
The primary objectives of this study are to evaluate the performance of ML-driven chatbots and virtual assistants in customer support roles, compare the efficacy of these advanced technologies with traditional customer support methods, assess customer satisfaction and response efficiency when interacting with ML-driven systems, and identify the benefits and limitations of using machine learning in customer support.
This study employs a mixed-methods research design, combining both qualitative and quantitative approaches to gather comprehensive data. The methodology includes data collection through surveys and interviews with customers and support staff to gather qualitative data on user experiences and satisfaction levels. Historical data from customer support interactions were also analyzed. Various ML models, including Natural Language Processing (NLP) and deep learning algorithms, were implemented to power chatbots and virtual assistants. These models were trained on extensive datasets of customer queries and responses. The performance of the ML-driven chatbots and virtual assistants was assessed using metrics such as response time, accuracy, and user satisfaction scores. Statistical and analytical techniques, including regression analysis and hypothesis testing, were used to interpret the collected data.
The study's major findings reveal that ML-driven chatbots and virtual assistants significantly reduce response times and increase the accuracy of solutions provided to customers compared to traditional methods. Overall customer satisfaction levels were higher when interacting with ML-driven systems, particularly in terms of speed and convenience. Businesses experienced enhanced operational efficiency and scalability by integrating ML technologies into their customer support processes. Despite the benefits, certain limitations were identified, such as the need for continuous training of ML models and handling complex queries that required human intervention.
The study concludes that machine learning-driven chatbots and virtual assistants offer substantial advantages over traditional customer support methods. They provide quicker, more accurate responses, leading to higher customer satisfaction and improved operational efficiency. However, the integration of these technologies also presents challenges, such as the need for ongoing model updates and the inability to handle highly complex or nuanced customer inquiries. Future research should focus on addressing these limitations and exploring the potential for further advancements in ML-driven customer support technologies.},
      keywords = {Customer support automation, Machine learning, Chat-bots, Efficacy, Virtual assistants},
      month = {July},
  }