Home / Current Issue / Paper 1724400
AI-Based Hybrid Deep Learning Framework for Accurate Brain Tumor Classification from MRI Images Using CNN and Vision Transformer
Subject area: Science,Engineering and Technology · Area of research: Deep Learning
DOI: 10.64388/IREV10I4-1724400
Abstract
Brain tumors remain among the most life-threatening neurological disorders, and their outcome depends heavily on how early and how accurately they are diagnosed. Magnetic Resonance Imaging (MRI) is the modality of choice for tumor evaluation, yet manual reading of MRI scans is slow and subject to inter-observer disagreement. This paper proposes NeuroFusionNet, a lightweight hybrid deep learning framework that fuses a MobileNetV2-based Convolutional Neural Network (CNN) branch with a Vision Transformer (ViT) branch through a Squeeze-and-Excitation (SE) gated fusion mechanism, allowing the model to combine fine-grained local texture cues with long-range global context in a single forward pass. The framework further incorporates a U-Net-based segmentation head to delineate tumor boundaries, a five-method Explainable AI (XAI) suite for transparent decision support, and a Large Language Model (LLM) module that converts model outputs into structured, human-readable clinical reports. Evaluated on the BRISC 2025 benchmark, which contains expert-annotated MRI scans spanning glioma, meningioma, pituitary tumor, and healthy classes, the proposed model achieves 96.2% test accuracy while using only 7.8 million parameters, indicating that competitive diagnostic accuracy can be obtained without the computational burden typical of large-scale transformer or ensemble models. The results suggest that NeuroFusionNet is a practical candidate for deployment in resource-constrained clinical settings that still require interpretable, end-to-end decision support.
Keywords
Brain Tumor; Deep Learning; MRI; CNN; Vision Transformer; Hybrid Model; Feature Fusion; Segmentation; Explainable AI; Knowledge Distillation; Medical Imaging
References
[1] Ostrom QT, et al. CBTRUS statistical report: Primary brain and other central nervous system tumors diagnosed in the United States. Neuro-Oncology. Central Brain Tumor Registry of the United States [annual report].
[2] Louis DN, et al. The WHO classification of tumors of the central nervous system. Acta Neuropathologica / WHO Classification of Tumours series.
[3] Stupp R, et al. Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. New England Journal of Medicine.
[4] Shahin A. Fine-tuned ResNet-34 model for MRI brain tumor classification. Scientific Reports. 2025;15(3):1–10.
[5] Asif RN, et al. Ensemble deep learning framework for robust brain tumor classification in MRI. Scientific Reports. 2025;15(2):1–9.
[6] Sankari C, et al. Hierarchical multiscale vision transformer model for accurate detection and classification of brain tumors in MRI-based imaging. Scientific Reports. 2025;15:1–12.
[7] Ghasemi R, Hosseini A, Zare S. Hybrid CNN–MLP architecture for multimodal brain tumor classification. Scientific Reports. 2025;15(4):1–10.
[8] Lakshmi K, Rajesh R, Nagarajan P. Explainable artificial intelligence with U-Net-based segmentation and Bayesian machine learning for classification of brain tumors using MRI images. Scientific Reports. 2025;15.
[9] Rajendran S, et al. Automated brain tumor segmentation using 3D CNN–U-Net hybrid architecture. Scientific Reports. 2023;14:10582–10594.
[10] Pereira S, et al. Brain tumor segmentation using convolutional neural networks in MRI images. IEEE Trans. Med. Imaging. 2016;35(5):1240–1251.
[11] Benfatto S, et al. Integrating epigenetics and explainable deep learning in tumor analysis. Nature Communications. 2025;16(3).
[12] Hinton G, Vinyals O, Dean J. Distilling the knowledge in a neural network. arXiv:1503.02531 [Preprint]. 2015.
[13] Feng Y, Chen J, Zhang H. Lightweight brain tumor classification via knowledge distillation. Biomedical Signal Processing and Control. 2023;85:104967.
[14] Dosovitskiy A, et al. An image is worth 16x16 words: Transformers for image recognition at scale. In: Proc. ICLR. 2021.
[15] Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC. MobileNetV2: Inverted residuals and linear bottlenecks. In: Proc. IEEE CVPR. 2018.
[16] Hu J, Shen L, Sun G. Squeeze-and-excitation networks. In: Proc. IEEE CVPR. 2018.
[17] Ronneberger O, Fischer P, Brox T. U-Net: Convolutional networks for biomedical image segmentation. In: Proc. MICCAI. 2015.
[18] Selvaraju RR, et al. Grad-CAM: Visual explanations from deep networks via gradient-based localization. In: Proc. IEEE ICCV. 2017.
[19] Fateh A, et al. BRISC: Annotated dataset for brain tumor segmentation and classification. arXiv:2506.14318 [Preprint]. 2025.
How to cite this paper
@article{1724400,
author = {Sachin U. Kadam, Dr. Brijendra Gupta},
title = {AI-Based Hybrid Deep Learning Framework for Accurate Brain Tumor Classification from MRI Images Using CNN and Vision Transformer},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {10},
number = {4},
pages = {4288-4295},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1724400.pdf},
abstract = {Brain tumors remain among the most life-threatening neurological disorders, and their outcome depends heavily on how early and how accurately they are diagnosed. Magnetic Resonance Imaging (MRI) is the modality of choice for tumor evaluation, yet manual reading of MRI scans is slow and subject to inter-observer disagreement. This paper proposes NeuroFusionNet, a lightweight hybrid deep learning framework that fuses a MobileNetV2-based Convolutional Neural Network (CNN) branch with a Vision Transformer (ViT) branch through a Squeeze-and-Excitation (SE) gated fusion mechanism, allowing the model to combine fine-grained local texture cues with long-range global context in a single forward pass. The framework further incorporates a U-Net-based segmentation head to delineate tumor boundaries, a five-method Explainable AI (XAI) suite for transparent decision support, and a Large Language Model (LLM) module that converts model outputs into structured, human-readable clinical reports. Evaluated on the BRISC 2025 benchmark, which contains expert-annotated MRI scans spanning glioma, meningioma, pituitary tumor, and healthy classes, the proposed model achieves 96.2% test accuracy while using only 7.8 million parameters, indicating that competitive diagnostic accuracy can be obtained without the computational burden typical of large-scale transformer or ensemble models. The results suggest that NeuroFusionNet is a practical candidate for deployment in resource-constrained clinical settings that still require interpretable, end-to-end decision support.},
keywords = {Brain Tumor; Deep Learning; MRI; CNN; Vision Transformer; Hybrid Model; Feature Fusion; Segmentation; Explainable AI; Knowledge Distillation; Medical Imaging},
month = {October},
doi = {https://doi.org/10.64388/IREV10I4-1724400}
}