Enhancing Retrieval-Augmented Generation for Question Answering using Hybrid Retrieval and Re-ranking Techniques

• Author(s): Nemalipuri Bala Thirumalesh; Nakkanaboina Bhavya Sri; Kedasu Hema Sri
• Paper ID: 1717257
• Page: 1-5
• Published Date: 30-04-2026
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 9 Issue 11 May-2026

Abstract

Large Language Models (LLMs) have significantly improved question-answering systems but often suffer from hallucination and reliance on static knowledge. Retrieval-Augmented Generation (RAG) addresses these limitations by incorporating external knowledge; however, its performance largely depends on the quality of retrieved context. This paper proposes an enhanced RAG-based question answering system that integrates hybrid retrieval and re-ranking techniques to improve answer accuracy. The system combines dense and sparse retrieval methods using Reciprocal Rank Fusion (RRF) to improve document relevance, followed by a cross-encoder-based re-ranking module for refined context selection. A vector database is used for efficient semantic search, and a large language model generates context-aware responses. The proposed approach is evaluated on the TriviaQA dataset using Exact Match (EM), F1 Score, BERTScore, and Knowledge Gap Detection (KGD). Experimental results show that the system achieves an Exact Match score of 85%, outperforming baseline RAG approaches such as QA-RAG. The results demonstrate that hybrid retrieval and re-ranking significantly enhance the accuracy and reliability of RAG-based question answering systems.

Keywords

Retrieval-Augmented Generation (RAG), Question Answering, Large Language Models (LLMs), Natural Language Processing (NLP)

Citations

IRE Journals:
Nemalipuri Bala Thirumalesh, Nakkanaboina Bhavya Sri, Kedasu Hema Sri "Enhancing Retrieval-Augmented Generation for Question Answering using Hybrid Retrieval and Re-ranking Techniques" Iconic Research And Engineering Journals Volume 9 Issue 11 2026 Page 1-5 https://doi.org/10.64388/IREV9I11-1717257

IEEE:
Nemalipuri Bala Thirumalesh, Nakkanaboina Bhavya Sri, Kedasu Hema Sri "Enhancing Retrieval-Augmented Generation for Question Answering using Hybrid Retrieval and Re-ranking Techniques" Iconic Research And Engineering Journals, 9(11) https://doi.org/10.64388/IREV9I11-1717257