Home / Current Issue / Paper 1724206
A Review Paper On An Integrated Multi-Agent Decision Support System for Medical Image Analysis, Clinical Diagnosis, Drug Interaction Assessment, and Risk Evaluation
Subject area: Science,Engineering and Technology · Area of research: Artificial Intelligence
DOI: 10.64388/IREV10I4-1724206
Abstract
Healthcare decision making often requires multiple doctors to consider different types of information like patient symptoms, their medication history, medical images, lab reports, and relevant medical literature. All this information is frequently fragmented across multiple sources. A multi-agent decision support system can help to integrate all these sources and organize them. This paper presents the design and development of a Multi-Agent Healthcare Decision Support System (DSS) designed to integrate medical image analysis, clinical diagnosis, drug-interaction assessment, evidence retrieval, and risk evaluation through a modular architecture. The proposed system consists of 6 different specialized agents namely vision agent, diagnosis agent, drug-interaction agent, literature/RAG agent, emergency risk agent and Coordinator/Orchestrator. A single agent is not able to do all tasks. Image analysis, medication assessment, evidence retrieval, and risk evaluation have different computational requirements and need different validation procedures for each agent. The system’s effectiveness must be established through systematically designing, developing and testing the individual agent and integrating the whole workflow. The proposed system aims to support clinical decision making, not to replace professionals.
Keywords
multi-agent system; clinical decision support system; medical image analysis; drug interaction; retrieval-augmented generation; risk assessment
References
[1] Ouanes K, Farhah N. Effectiveness of artificial intelligence (AI) in clinical decision support systems and care delivery. Journal of Medical Systems. 2024;48(1):74. https://doi.org/10.1007/s10916-024-02098-4
[2] Susanto AP, Lyell D, Widyantoro B, Berkovsky S, Magrabi F. Effects of machine learning-based clinical decision support systems on decision-making, care delivery, and patient outcomes: a scoping review. Journal of the American Medical Informatics Association. 2023;30(12):2050–63. https://doi.org/10.1093/jamia/ocad180
[3] Kim Y, et al. MDAgents: an adaptive collaboration of LLMs for medical decision-making. In: Advances in Neural Information Processing Systems. Vol. 37. 2024. p. 79410–52.
[4] Chen J, Lin H, Han X, Sun L. Benchmarking large language models in retrieval-augmented generation. In: Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(16):17754–62. https://doi.org/10.1609/aaai.v38i16.29728
[5] Lee J, Yoon W, Kim S, Kim D, Kim S, So CH, et al. BioBERT: a pre-trained biomedical language representation model for biomedical text mining. Bioinformatics. 2020;36(4):1234–40. https://doi.org/10.1093/bioinformatics/btz682
[6] World Health Organization. Medication without harm: WHO Global Patient Safety Challenge [Internet]. Available from: https://www.who.int/initiatives/medication-without-harm
[7] U.S. Food and Drug Administration. Drug product labeling API. openFDA [Internet]. Available from: https://open.fda.gov/apis/drug/label/
[8] Çallı E, Sogancioglu E, van Leeuwen KG, Murphy K, van Ginneken B. Deep learning for chest X-ray analysis: a survey. Medical Image Analysis. 2021;72:102125. https://doi.org/10.1016/j.media.2021.102125
[9] Öğdü CU, Gürbüz S, Karaköse M, Hanoğlu E. Medical implications of LLM based clinical decision support systems in healthcare. In: Proceedings of the 29th International Conference on Information Technology (IT). 2025. p. 1–4.
[10] Ayers JW, et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Internal Medicine. 2023;183(6):589–96.
[11] Peek N, Capurro D, Rozova V, van der Veer SN. Bridging the gap: challenges and strategies for the implementation of artificial intelligence-based clinical decision support systems in clinical practice. Yearbook of Medical Informatics. 2024;33(1):103–14. https://doi.org/10.1055/s-0044-1800729
[12] Maity S, Saikia MJ. Large language models in healthcare and medical applications: a review. Bioengineering. 2025;12(6):631. https://doi.org/10.3390/bioengineering12060631
[13] Meng X, Yan X, Zhang K, Liu D, Cui X, Yang Y, et al. The application of large language models in medicine: a scoping review. iScience. 2024;27(5):109713. https://doi.org/10.1016/j.isci.2024.109713
[14] Ong JCL, et al. Development and testing of a novel large language model-based clinical decision support systems for medication safety in 12 clinical specialties. arXiv:2402.01741 [Preprint]. 2024. Available from: https://arxiv.org/abs/2402.01741
[15] Achiam J, et al. GPT-4 technical report. arXiv:2303.08774 [Preprint]. 2023. Available from: https://arxiv.org/abs/2303.08774
[16] Ji Z, et al. LLM internal states reveal hallucination risk faced with a query. arXiv:2407.03282 [Preprint]. 2024. Available from: https://arxiv.org/abs/2407.03282
[17] Levra AG, et al. A large language model-based clinical decision support system for syncope recognition in the emergency department: a framework for clinical workflow integration. European Journal of Internal Medicine. 2025;131:113–20.
[18] Siddiky MNA, et al. Optimizing AI language models: a study of ChatGPT-4 vs. ChatGPT-4o. Preprints. 2025. https://doi.org/10.20944/preprints202502.0066.v1
[19] Sheikh AA, Chong EKP. Artificial intelligence-driven optimization for 3-D integrated circuit manufacturing: a system of systems framework. IEEE Transactions on Components, Packaging and Manufacturing Technology. 2025;15(7):1538–52.
[20] Nair M, Svedberg P, Larsson I, Nygren JM. A comprehensive overview of barriers and strategies for AI implementation in healthcare: mixed-method design. PLOS ONE. 2024;19(8):e0305949.
How to cite this paper
@article{1724206,
author = {Vaishnavi Tushar Jagade, Saniya Salim Bijali, Diya Ramesh Dawle, Anushka Kiran Bhosale, Priti Vanmali},
title = {A Review Paper On An Integrated Multi-Agent Decision Support System for Medical Image Analysis, Clinical Diagnosis, Drug Interaction Assessment, and Risk Evaluation},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {10},
number = {4},
pages = {3284-3296},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1724206.pdf},
abstract = {Healthcare decision making often requires multiple doctors to consider different types of information like patient symptoms, their medication history, medical images, lab reports, and relevant medical literature. All this information is frequently fragmented across multiple sources. A multi-agent decision support system can help to integrate all these sources and organize them. This paper presents the design and development of a Multi-Agent Healthcare Decision Support System (DSS) designed to integrate medical image analysis, clinical diagnosis, drug-interaction assessment, evidence retrieval, and risk evaluation through a modular architecture.
The proposed system consists of 6 different specialized agents namely vision agent, diagnosis agent, drug-interaction agent, literature/RAG agent, emergency risk agent and Coordinator/Orchestrator. A single agent is not able to do all tasks. Image analysis, medication assessment, evidence retrieval, and risk evaluation have different computational requirements and need different validation procedures for each agent.
The system’s effectiveness must be established through systematically designing, developing and testing the individual agent and integrating the whole workflow. The proposed system aims to support clinical decision making, not to replace professionals.},
keywords = {multi-agent system; clinical decision support system; medical image analysis; drug interaction; retrieval-augmented generation; risk assessment},
month = {October},
doi = {https://doi.org/10.64388/IREV10I4-1724206}
}