Beyond Leaf Images: A Personalized Multimodal Temporal AI Framework for Pre-Symptomatic Plant Health Monitoring and Disease-Risk Early Warning

References

[1] Kamilaris A, Prenafeta-Boldú FX. Deep learning in agriculture: A survey. Comput Electron Agric. 2018;147:70–90. https://doi.org/10.1016/j.compag.2018.02.016

[2] Mohanty SP, Hughes DP, Salathé M. Using deep learning for image-based plant disease detection. Front Plant Sci. 2016;7:1419. https://doi.org/10.3389/fpls.2016.01419

[3] Ferentinos KP. Deep learning models for plant disease detection and diagnosis. Comput Electron Agric. 2018;145:311–318. https://doi.org/10.1016/j.compag.2018.01.009

[4] Upadhyay A, Chandel NS, Singh KP, et al. Deep learning and computer vision in plant disease detection: A comprehensive review of techniques, models, and trends in precision agriculture. Artif Intell Rev. 2025;58:92. https://doi.org/10.1007/s10462-024-11100-x

[5] Shafay M, Hassan T, Owais M, Hussain I, Khawaja SG, Seneviratne L, et al. Recent advances in plant disease detection: Challenges and opportunities. Plant Methods. 2025;21(1):140. https://doi.org/10.1186/s13007-025-01450-0

[6] George R, Thuseethan S, Ragel RG, et al. Past, present and future of deep plant leaf disease recognition: A survey. Comput Electron Agric. 2025;234:110128. https://doi.org/10.1016/j.compag.2025.110128

[7] Mahlein AK. Plant disease detection by imaging sensors – Parallels and specific demands for precision agriculture and plant phenotyping. Plant Dis. 2016;100(2):241–251. https://doi.org/10.1094/PDIS-03-15-0340-FE

[8] Wang W, Ghatrehsamani S. Early detection of plant pathogens in the asymptomatic phase: A scoping review of hyperspectral imaging combined with machine learning. Smart Agric Technol. 2026;14:102123. https://doi.org/10.1016/j.atech.2026.102123

[9] Barbedo JGA. Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Comput Electron Agric. 2018;153:46–53. https://doi.org/10.1016/j.compag.2018.08.013

[10] Hughes DP, Salathé M. An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv:1511.08060 [Preprint]. 2015.

[11] Selvaraju RR, Cogswell M, Das A, Vedantam R, Parikh D, Batra D. Grad-CAM: Visual explanations from deep networks via gradient-based localization. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV); 2017. p. 618–626. https://doi.org/10.1109/ICCV.2017.74

[12] Gawande A, Sherekar S. Grape dataset: A dataset for disease prediction and classification for machine learning applications through environmental parameters. Data Brief. 2024;54:110546. https://doi.org/10.1016/j.dib.2024.110546

[13] Fromm J, Lautner S. Electrical signals and their physiological significance in plants. Plant Cell Environ. 2007;30(3):249–257. https://doi.org/10.1111/j.1365-3040.2006.01614.x

[14] Zhou J, Fan P, Zhou S, Pan Y, Ping J. Machine learning-assisted implantable plant electrophysiology microneedle sensor for plant stress monitoring. Biosens Bioelectron. 2025;271:117062. https://doi.org/10.1016/j.bios.2024.117062

[15] Yeom MS, Lee Y, Oh H, Lee E, Oh MM. Applying machine learning for the classification of environmental conditions using plant electrical signals. Hortic Environ Biotechnol. 2025;66(6):1481–1490. https://doi.org/10.1007/s13580-025-00742-7

[16] Jones HG. Application of thermal imaging and infrared sensing in plant physiology and ecophysiology. Adv Bot Res. 2004;41:107–163. https://doi.org/10.1016/S0065-2296(04)41003-9

[17] Oerke EC, Steiner U, Dehne HW, Lindenthal M. Thermal imaging of cucumber leaves affected by downy mildew and environmental conditions. J Exp Bot. 2006;57(9):2121–2132. https://doi.org/10.1093/jxb/erj170

[18] Chaerle L, Van Der Straeten D. Imaging techniques and the early detection of plant stress. Trends Plant Sci. 2000;5(11):495–501. https://doi.org/10.1016/S1360-1385(00)01781-7

[19] Cui S, Ling P, Zhu H, Keener HM. Plant pest detection using an artificial nose system: A review. Sensors. 2018;18(2):378. https://doi.org/10.3390/s18020378

[20] Melesse TY. Digital twin-based applications in crop monitoring. Heliyon. 2025;11(2):e42137. https://doi.org/10.1016/j.heliyon.2025.e42137

[21] Ojo MO, Wang Y, Bua C, Sher M, Zahid A. A crop digital twin system for predictive growth monitoring and adaptive light control in controlled environment agriculture. Internet Things. 2026;37:101935. https://doi.org/10.1016/j.iot.2026.101935

[22] Karothia R, Chattopadhyay MK. Developing a digital twin framework and smart sensors gateway for monitoring soil and environmental conditions to detect anomalies and to predict crop health. Digital Twin. 2026:2644045. https://doi.org/10.1080/27525783.2026.2644045

[23] Liu FT, Ting KM, Zhou ZH. Isolation forest. In: Proceedings of the 8th IEEE International Conference on Data Mining (ICDM); 2008. p. 413–422. https://doi.org/10.1109/ICDM.2008.17

[24] Schölkopf B, Platt JC, Shawe-Taylor J, Smola AJ, Williamson RC. Estimating the support of a high-dimensional distribution. Neural Comput. 2001;13(7):1443–1471. https://doi.org/10.1162/089976601750264965

[25] Breiman L. Random forests. Mach Learn. 2001;45(1):5–32. https://doi.org/10.1023/A:1010933404324

[26] Chen T, Guestrin C. XGBoost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining; 2016. p. 785–794. https://doi.org/10.1145/2939672.2939785

[27] Hochreiter S, Schmidhuber J. Long short-term memory. Neural Comput. 1997;9(8):1735–1780. https://doi.org/10.1162/neco.1997.9.8.1735

[28] Cho K, van Merriënboer B, Gulcehre C, et al. Learning phrase representations using RNN encoder-decoder for statistical machine translation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP); 2014. p. 1724–1734. https://doi.org/10.3115/v1/D14-1179

[29] Bai S, Kolter JZ, Koltun V. An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv:1803.01271 [Preprint]. 2018.

[30] Vaswani A, Shazeer N, Parmar N, et al. Attention is all you need. Adv Neural Inf Process Syst. 2017;30:5998–6008.

[31] Baltrušaitis T, Ahuja C, Morency LP. Multimodal machine learning: A survey and taxonomy. IEEE Trans Pattern Anal Mach Intell. 2019;41(2):423–443. https://doi.org/10.1109/TPAMI.2018.2798607

[32] Lakshminarayanan B, Pritzel A, Blundell C. Simple and scalable predictive uncertainty estimation using deep ensembles. Adv Neural Inf Process Syst. 2017;30:6402–6413.

[33] Gal Y, Ghahramani Z. Dropout as a Bayesian approximation: Representing model uncertainty in deep learning. In: Proceedings of the 33rd International Conference on Machine Learning (ICML); 2016. p. 1050–1059.

[34] Guo C, Pleiss G, Sun Y, Weinberger KQ. On calibration of modern neural networks. In: Proceedings of the 34th International Conference on Machine Learning (ICML); 2017. p. 1321–1330.

[35] Efron B, Tibshirani RJ. An introduction to the bootstrap. New York: Chapman & Hall; 1993. https://doi.org/10.1007/978-1-4899-4541-9

[36] Lundberg SM, Lee SI. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst. 2017;30:4765–4774.

@article{1724002,
      author = {Rupali Prakash Kolamkar, Rupali Prakash Kolamkar,  Kshitij Shantaram Doundkar, Neha Waychol, Sunil P Mahajan },
      title = {Beyond Leaf Images: A Personalized Multimodal Temporal AI Framework for Pre-Symptomatic Plant Health Monitoring and Disease-Risk Early Warning},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {10},
      number = {4},
      pages = {2631-2649},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1724002.pdf},
      abstract = {Artificial intelligence has advanced plant disease recognition, mainly through image-based deep learning. Its weakness is timing: a camera records a visible symptom, a model matches it to a known class, and a label is returned. This confirms disease but says little about the earlier period, when a plant is already changing yet shows no clear lesion. This paper proposes PlantPulse, a personalized multimodal temporal framework for that pre-symptomatic window. It draws on environmental, soil, optional electrophysiological or impedance, thermal and volatile organic compound signals, together with periodic RGB images. Rather than judging every plant against a population model, PlantPulse learns a reference pattern for each plant during a healthy period, scores new observations against it, and uses a temporal anomaly layer to detect departures. A risk layer then uses environmental and physiological context to separate normal variation, plausible abiotic stress, possible disease risk and cases in which the evidence is insufficient, while an uncertainty layer allows the system to abstain rather than mislabel unusual signals as disease. The paper defines a common data representation, candidate statistical and deep learning models, three multimodal fusion strategies and an evaluation protocol built around warning lead time, false alarm burden, calibration, missing modalities, cross-environment testing and leakage control. PlantPulse is presented as a research design rather than a validated system; its value must be established through longitudinal trials with independent ground truth. The aim is continuous monitoring in which images remain important but are no longer the only evidence.},
      keywords = {early warning; explainable artificial intelligence; multimodal sensor fusion; personalized monitoring; plant disease; precision agriculture; temporal anomaly detection; uncertainty quantification},
      month = {October},
  }