Retrieval-Augmented Generation (RAG)-Based Chatbot System

• Author(s): Himank Garg; Anish Kumar; Himanshu Kumar; Ishrat Ali; Anuj Chandila
• Paper ID: 1712249
• Page: 1572-1575
• Published Date: 24-11-2025
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 9 Issue 5 November-2025

Abstract

The fast development of Large Language Models (LLMs) has highly improved abilities in natural language processing, but deploying LLMs in high-stakes contexts continues to be problematic because of inaccuracy and hallucinations. In this paper, we describe a Retrieval-Augmented Generation (RAG) based chatbot system that avoids these issues from existing models and ensures all responses are grounded and based on valid knowledge sources. The RAG system builds an architecture that scans specific documents in a domain, derives semantic embeddings that include vectors, and stores their vectors in a FAISS vector database, combining retrieval while ensuring speed and memory efficiency. When a question is passed to the RAG bot, the bot retrieves relevant context passages and contexts to condition a generative language model to yield an accurate answer that is also cited. Our implementation involves a modular pipeline and allows all knowledge to be fresh, without having to retrain the language model. We provide experimental results showing significant improvements in factual accuracy compared to baseline LLMs and improved reductions in hallucination. Conclusion: the system is constructed in a domain-free manner allowing further employment in healthcare, legal, or enterprise settings, where it is important to provide cited and verifiable information. The development of this chatbot-status represents an important milestone toward creating trustworthy Artificial Intelligence (AI) systems that exhibit generative fluency and factual reliability.

Keywords

Retrieval-Augmented Generation, Large Language Models, Semantic Search, FAISS, Chatbot Systems, Hallucination Mitigation, Knowledge Grounding.

Citations

IRE Journals:
Himank Garg, Anish Kumar, Himanshu Kumar, Ishrat Ali, Anuj Chandila "Retrieval-Augmented Generation (RAG)-Based Chatbot System" Iconic Research And Engineering Journals Volume 9 Issue 5 2025 Page 1572-1575 https://doi.org/10.64388/IREV9I5-1712249

IEEE:
Himank Garg, Anish Kumar, Himanshu Kumar, Ishrat Ali, Anuj Chandila "Retrieval-Augmented Generation (RAG)-Based Chatbot System" Iconic Research And Engineering Journals, 9(5) https://doi.org/10.64388/IREV9I5-1712249