Event Detection in Groundwater Sensor Networks using Artificial Intelligence
DOI:
https://doi.org/10.14738/tecs.113.14741Keywords:
Deep learning, Event Detection, Graph Attention Neural Networks, Prediction Intervals, Uncertainty consideration.Abstract
In this paper, a method for detecting spatial and temporal anomalous events in groundwater sensor networks (high-dimensional time series data), such as system faults and attacks will be developed. Unlike recently developed deep learning frameworks for anomaly detection which do not consider the dependences between the variables and apply the existing relationships to predict the expected behavior of the sensors, the method in this paper extracts the relationships between the sensors spatially and temporally and learn to detect and simultaneously explain deviations from these relationships. This challenge is solved by using graph attention neural networks and structured learning. Attention neural networks can give useful interpretability in context of the anomalies detected and allows to identify their causes. To improve robustness the method considers aleatoric and parametric uncertainties by using ensemble specific value prediction and prediction intervals without assuming any data distribution. Furthermore, the model was connected to a fully connected classifier to classify typical groundwater network anomalies. The method was applied to a study area and it could be shown that the method could capture in 92% of the cases the complex correlations between the high dimensional variables, and enabled analysts to identify the causes of the anomalies.
References
Seth Rose, Austin Long (1988), Monitoring Dissolved Oxygen in Ground Water: Some Basic Considerations, Groundwater Monitoring & Remediation Volume 8, Issue 1
Erfani SM, Rajasegarar S, Karunasekera S, Leckie C. High-dimensional and large-scale anomaly detection using a linear one-class svm with deep learning. Pattern Recogn. 2016;58:121–34.
Aggarwal CC, Philip SY. An effective and efficient algorithm for high-dimensional outlier detection. VLDB J. 2005;14(2):211–21.
Aggarwal, C. C. 2015. Outlier analysis. In Data mining, 237–263. Springer.
Li, D.; Chen, D.; Jin, B.; Shi, L.; Goh, J.; and Ng, S.-K. 2019. MAD-GAN: Multivariate anomaly detection for time series data with generative adversarial networks. In International Conference on Artificial Neural Networks, 703–716. Springer.
Sabuhi, Mikael & Zhou, Ming & Bezemer, Cor-Paul & Musilek, Petr. (2021). Applications of Generative Adversarial Networks in Anomaly Detection: A Systematic Literature Review. IEEE Access. PP. 1-1. 10.1109/ACCESS.2021.3131949.
Rafiee, Laya and Fevens, Thomas (2020),Unsupervised anomaly detection with a GAN augmented autoencoder, International Conference on Artificial Neural Networks, 479--490}, 2020. Springer
Zhou, Xiaokang & Hu, Yiyong & Liang, Wei & Ma, Jianhua & Jin, Qun. (2020). Variational LSTM Enhanced Anomaly Detection for Industrial Big Data. IEEE Transactions on Industrial Informatics. PP. 1-1. 10.1109/TII.2020.3022432.
Z. Tian, C. Luo, J. Qiu, X. Du and M. Guizani, “A Distributed Deep Learning System for Web Attack Detection on Edge Devices,” in IEEE Transactions on Industrial Informatics, vol. 16, no. 3, pp. 1963-1971, March 2020
Mobtahej, Pooyan & Zhang, Xulong & Hamidi, Maryam & Zhang, Jing. (2022). An LSTM-Autoencoder Architecture for Anomaly Detection Applied on Compressors Audio Data. Computational and Mathematical Methods. 2022. 1-22. 10.1155/2022/3622426.
Deng, Ailin & Hooi, Bryan. (2021). Graph Neural Network-Based Anomaly Detection in Multivariate Time Series. Proceedings of the AAAI Conference on Artificial Intelligence. 35. 4027-4035. 10.1609/aaai.v35i5.16523.
Tian, Z., Zhuo, M., Liu, L. et al. Anomaly detection using spatial and temporal information in multivariate time series. Sci Rep 13, 4400 (2023). https://doi.org/10.1038/s41598-023-31193-8
Zou, Xu & Zheng, Qinkai & Dong, Yuxiao & Guan, Xinyu & Kharlamov, Evgeny & Lu, Jialiang & Tang, Jie. (2021). TDGIA:Effective Injection Attacks on Graph Neural Networks.
Bachiller, Pilar & Rodriguez-Criado, Daniel & Jorvekar, Ronit & Bustos, Pablo & Faria, Diego & Manso, Luis. (2022). A graph neural network to model disruption in human-aware robot navigation. Multimedia Tools and Applications. 81. 10.1007/s11042-021-11113-6.
Ray, S., Lakdawala, S., Goswami, M., & Gao, C. (2021). Learning Graph Neural Networks for Multivariate Time Series Anomaly Detection. ArXiv, abs/2111.08082.Aykas, Dogan & Mehrkanoon, Siamak. (2021). Multistream Graph Attention Networks for Wind Speed Forecasting.
Simhayev, Eli, Gilad Katz, and Lior Rokach.(2020) "PIVEN: A Deep Neural Network for Prediction Intervals with Specific Value Prediction." arXiv preprint arXiv:2006.05139 (2020).
P. Veličković, G. Cucurull, A. Casanova, A. Romero, P. Liò, andY. Bengio, “Graph attention networks,” 2017.
Yukai Ding, Yuelong Zhu, Jun Feng, et al. Interpretable spatio-temporal attention LSTM model for flood forecasting. Neurocomputing 2020(403): 348-359.
Kong, X., Xing, W., Wei, X., Bao, P., Zhang, J., & Lu, W. (2020). STGAT: Spatial-Temporal Graph Attention Networks for Traffic Flow Forecasting.IEEE Access,8, 134363-134372.
Tim Pearce, Mohamed Zaki, Alexandra Brintrup, and Andy Neely (2018). High-quality prediction intervals for deep learning: A distribution-free, ensembled approach. arXiv preprint arXiv:1802.07167, 2018.
Rahmati O et al 2019 Predicting uncertainty of machine learning models for modelling nitrate pollution of groundwater using quantile regression and UNEEC methods Sci. Total Environ. 688 855–66
Dogulu, N., Lopez, P. L., Solomatine, D. P., Weerts, A. H., and Shrestha, D. L.: Estimation of predictive hydrologic uncertainty using the quantile regression and UNEEC methods and their comparison on contrasting catchments, Hydrol Earth Syst Sc, 19, 3181-3201, 10.5194/hess-19-3181-2015, 2015.
Dekking, Frederik Michel; Kraaikamp, Cornelis; Lopuhaä, Hendrik Paul; Meester, Ludolf Erwin (2005). A Modern Introduction to Probability and Statistics. Springer Texts in Statistics. London: Springer London. doi:10.1007/1-84628-168-7. ISBN 978-1-85233-896-1.
Hundman, K.; Constantinou, V.; Laporte, C.; Colwell, I.; and Soderstrom, T. 2018b. Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding. In Proceedings of the 24th ACM SIGKDD international conference on knowledge discovery & data mining, 387–395.
Park, D.; Hoshi, Y.; and Kemp, C. C. 2018. A multimodal anomaly detector for robot-assisted feeding using an lstmbased variational autoencoder. IEEE Robotics and Automation Letters 3(3): 1544–1551.
Roweis, Sam; Hinton, Geoffrey (January 2002). Stochastic neighbor embedding (PDF). Neural Information Processing Systems.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Divas Karimanzira, Linda Ritzau

This work is licensed under a Creative Commons Attribution 4.0 International License.