Home / Current Issue / Paper 1725002
Anomaly Detection for Internet of Things Time Series Data Using Generative Adversarial Networks with Attention Mechanism in Smart Agriculture
Subject area: Science,Engineering and Technology · Area of research: Machine Learning
DOI: 10.64388/ire1725002
Abstract
In recent time, smart agriculture which is the integration of modern agriculture and Internet of Things (IoT) technology has received widespread attention and developmental process. In order to actualize scientific cultivation and precise control, the agricultural environment is monitored in real time by deploying various relevant sensors. Large amount of multidimensional time series data is generated. However, smart agricultural IoT architectures often suffer from data loss and misrepresentation. Moreover, some intelligent decision-making approach for agricultural management also requires detailed data analysis. To address the aforementioned problems, this paper developed a new anomaly detection model based on generative adversarial networks (GAN), to process the multidimensional time series data generated. GAN is a deep learning model trained to learn the distribution patterns of normal data and capture the temporal dependence of time series and the potential correlations between features through learning. To address the issue of generator inversion, an encoder–decoder structure incorporating the attention mechanism is designed to improve the performance of the model in learning normal data. In addition, a new reconstruction error calculation method that measures the error in terms of point-wise difference and curve similarity to improve the detection effect were presented. Finally, considering three smart agriculture-related datasets, experimental results showed that the developed model accurately achieved anomaly detection. The experimental precision, recall, and F1 score exceeded the reference models with 0.9351, 0.9625, and 0.9482, respectively.
Keywords
Sensor, IoT, WSN, PCA, GAN
References
[1] Abdallah M, Lee WJ, Raghunathan N, Sutherland JW, Bagchi S (2021). Anomaly detection through transfer learning in agriculture and manufacturing IoT systems. arXiv. [Preprint]. https://doi.org/10.48550/arXiv.2102.
[2] Adhikari R, Agrawal RK (2013). An introductory study on time series modeling and forecasting. arXiv. [Preprint]. https://doi.org/10.48550/arXiv.1302.
[3] Adkisson M, Kimmell JC, Gupta M, et al. (2021). Autoencoder-based anomaly detection in smart farming ecosystem, In 2021 IEEE International Conference on Big Data; December 15, 2021.
[4] Aggarwal CC (2017). An Introduction to Outlier Analysis.Cham: Springer.
[5] Akçay S, Atapour-Abarghouei A, Breckon TP (2019). Skip-ganomaly: skip connected and adversarially trained encoder-decoder anomaly detection. in 2019 International Joint Conference on Neural Networks; July 14, 2019.
[6] Bashar MA, Nayak R (2020). TAnoGAN: time series anomaly detection with generative adversarial networks. in 2020 IEEE Symposium Series on Computational Intelligence; December 1, 2020.
[7] Berndt DJ, Clifford J (1994). Using dynamic time warping to find patterns in time series. KDD Workshop10, 359–370.
[8] Blake C, Merz CJ (1999). Data from: The third international knowledge discovery and data mining tools competition. UCI repository of machine learning databases. Available at
[9] Cao X, Yao Y, Li L, Zhang W, An Z, Zhang Z, et al. (2021). iGrow: A smart agriculture solution to autonomous greenhouse control. arXiv. [Preprint]. https://doi.org/10.48550/arXiv.2107.05464
[10] Chalapathy R, Chawla S (2019). Deep learning for anomaly detection: a survey. arXiv. [Preprint].
[11] Cook AA, Mısırlı G, Fan Z (2019). Anomaly detection for IoT time-series data: A survey. IEEE Internet Things J. 7, 6481–6494. https://doi.org/10.1109/JIOT.2019.2958185
[12] Farooq MS, Riaz S, Abid A, Abid K, Naeem MA (2019). A survey on the role of IoT in agriculture for the implementation of smart farming. IEEE Access. 7, 156237–156271. https://doi.org/10.1109/ACCESS.2019.2949703
[13] Garg S, Pundir P, Jindal H, Saini H, Garg S (2021). Towards a multimodal system for precision agriculture using IoT and machine learning. in 2021 12th international conference on computing communication and networking technologies (ICCCNT); July 6, 2021.
[14] Geiger A, Liu D, Alnegheimish S, et al. (2020). TadGAN: time series anomaly detection using generative adversarial networks. in 2020 IEEE International Conference on Big Data; December 10, 2020.
[15] Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, et al. (2014). Generative Adversarial Nets. Advances in Neural Information Processing Systems.Red Hook: NY Curran.
[16] Hasan M, Islam MM, Zarif MII, Hashem MMA (2019). Attack and anomaly detection in IoT sensors in IoT sites using machine learning approaches. Internet Things. 7:100059. https://doi.org/10.1016/j.iot.2019.100059
[17] Hashimoto M, Ide Y, Aritsugi M (2021). Anomaly detection for sensor data of semiconductor manufacturing equipment using a GAN. Procedia Comp. Sci. 192, 873–882. https://doi.org/10.1016/j.procs.2021.08.090
[18] Hawkins DM (1980). Identification of Outliers. Vol. 1.London: Chapman and Hall.
[19] Jiang ZK (2020). A Deep Learning Framework for IoT Time-Series Data Analysis and Applications. Master’s Thesis. Changsha (Hunan): Hunan University.
[20] Khalil RA, Saeed N, Masood M, Fard YM, Alouini MS, Al-Naffouri TY (2021). Deep learning in the industrial internet of things: potentials, challenges, and emerging applications. IEEE Internet Things J. 8, 11016–11040. https://doi.org/10.1109/JIOT.2021.3051414
[21] Kwon D, Kim H, Kim J, Suh SC, Kim I, Kim KJ (2019). A survey of deep learning-based network anomaly detection. Clust. Comput. 22, 949–961. https://doi.org/10.1007/s10586-017-1117-8
[22] Li D, Chen D, Goh J, Ng SK (2018). Anomaly detection with generative adversarial networks for multivariate time series.arXiv. [Preprint]. https://doi.org/10.48550/arXiv.1809.04758
[23] Li D, Chen D, Jin B, Shi L, Goh J (2019). MAD-GAN: multivariate anomaly detection for time series data with generative adversarial networks, in International Conference on Artificial Neural Networks; September 17, 2019.
[24] Li Y, Swersky K, Zemel R (2015). Generative moment matching networks. in International Conference on Machine Learning. 1718–1727. PMLR.
[25] Li W, Wang D, Li M, Gao Y, Wu J, Yang X (2021). Field detection of tiny pests from sticky trap images using deep learning in agricultural greenhouse. Comput. Electron. Agric. 183:106048. https://doi.org/10.1016/j.compag.2021.106048
[26] Liu J, Wang X (2020). Tomato diseases and pests detection based on improved Yolo V3 convolutional neural network. Front. Plant Sci. 11:898. https://doi.org/10.3389/fpls.2020.00898
[27] Malhotra P, Ramakrishnan A, Anand G, et al. (2016). LSTM-based encoder-decoder for multi-sensor anomaly detection. arXiv. [Preprint]. https://doi.org/10.48550/arXiv.1607.00148
[28] Moso JC, Cormier S, DeRunz C, Fouchal H, Wandeto JM, et al. (2021). Anomaly detection on data streams for smart agriculture. Agriculture11:1083. https://doi.org/10.3390/agriculture11111083
[29] Nassif AB, Talib MA, Nasir Q, Dakalbab FM (2021). Machine learning for anomaly detection: a systematic review. IEEE Access. 9, 78658–78700. https://doi.org/10.1109/ACCESS.2021.3083060
[30] Pang G, Shen C, Cao L, Hengel AVD (2021). Deep learning for anomaly detection: A review. ACM Comp. Surveys54, 1–38. https://doi.org/10.1145/3439950
[31] Park H, Park D, Kim S (2021). Anomaly detection of operating equipment in livestock farms using deep learning techniques. Electronics10:1958. https://doi.org/10.3390/electronics10161958
[32] Pundir M, Sandhu JK (2021). A systematic review of quality of service in wireless sensor networks using machine learning: recent trend and future vision. J. Netw. Comput. Appl. 188:103084. https://doi.org/10.1016/j.jnca.2021.103084
[33] Rafii F, Kechadi T (2019). Collection of historical weather data: issues with missing values, in Proceedings of the 4th International Conference on Smart City Applications; October 2, 2019.
[34] Salimans T, Goodfellow I, Zaremba W, Cheung V, Radford A, Chen X (2016). Improved techniques for training gans. arXiv. [Preprint]. https://doi.org/10.48550/arXiv.1606.03498
[35] Schlegl T, Seeböck P, Waldstein SM, Schmidt-Erfurth U, Langs G (2017). Unsupervised anomaly detection with generative adversarial networks to guide marker discovery. in International Conference on Information Processing in Medical Imaging; June 25, 2017.
[36] Taranveer (2019). Data from: The readings with a time span of 1 minute of house appliances in kW from a smart meter and weather conditions of that particular region. Kaggle. Available at: https://www.kaggle.com/taranvee/smart-home-dataset-with-weather-information (Accessed January 10, 2022).
[37] USDA-ARS (2016). Data from: The USDA-ARS conservation and production laboratory (CPRL), soil and water management research unit (SWMRU) research weather station. Data.Gov. Available at: https://catalog.data.gov/dataset/data-from-quality-controlled-research-weather-data-usda-ars-bushland-texas (Accessed January 12, 2022).
[38] Vilenski E, Bak P, Rosenblatt JD (2019). Multivariate anomaly detection for ensuring data quality of dendrometer sensor networks. Comput. Electron. Agric. 162, 412–421. https://doi.org/10.1016/j.compag.2019.04.018
[39] Vyas A, Bandyopadhyay S (2020). Semi-supervised soil moisture prediction through graph neural networks. arXiv. [Preprint]. https://doi.org/10.48550/arXiv.2012.03506
[40] Xu Y, Biswal S, Deshpande SR, et al. (2018). Raim: recurrent attentive and intensive model of multimodal patient monitoring data. in Proceedings of the 24th ACM SIGKDD international conference on Knowledge Discovery a
How to cite this paper
@article{1725002,
author = {Igwe, Agu Felix, Ifeoma Benardine Asianuba},
title = {Anomaly Detection for Internet of Things Time Series Data Using Generative Adversarial Networks with Attention Mechanism in Smart Agriculture},
journal = {Iconic Research And Engineering Journals},
year = {2026},
volume = {10},
number = {5},
pages = {2416-2425},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1725002.pdf},
abstract = {In recent time, smart agriculture which is the integration of modern agriculture and Internet of Things (IoT) technology has received widespread attention and developmental process. In order to actualize scientific cultivation and precise control, the agricultural environment is monitored in real time by deploying various relevant sensors. Large amount of multidimensional time series data is generated. However, smart agricultural IoT architectures often suffer from data loss and misrepresentation. Moreover, some intelligent decision-making approach for agricultural management also requires detailed data analysis. To address the aforementioned problems, this paper developed a new anomaly detection model based on generative adversarial networks (GAN), to process the multidimensional time series data generated. GAN is a deep learning model trained to learn the distribution patterns of normal data and capture the temporal dependence of time series and the potential correlations between features through learning. To address the issue of generator inversion, an encoder–decoder structure incorporating the attention mechanism is designed to improve the performance of the model in learning normal data. In addition, a new reconstruction error calculation method that measures the error in terms of point-wise difference and curve similarity to improve the detection effect were presented. Finally, considering three smart agriculture-related datasets, experimental results showed that the developed model accurately achieved anomaly detection. The experimental precision, recall, and F1 score exceeded the reference models with 0.9351, 0.9625, and 0.9482, respectively.},
keywords = {Sensor, IoT, WSN, PCA, GAN},
month = {November},
doi = {https://doi.org/10.64388/ire1725002}
}