Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3560905.3568438acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

Intelligent Continuous Monitoring to Handle Data Distributional Changes for IoT Systems

Published: 24 January 2023 Publication History

Abstract

Intelligent continuous monitoring of an IoT system to identify the operational changes, encompassing both normal and abnormal scenarios, with drift in sensing device is a challenging problem. It demands capability of learning continuously with multiple interventions or shifts, without forgetting past events information. However, forgetting the past learned knowledge, known as catastrophic forgetting, impacts significantly on the performance of continuous monitoring. In this work, we propose a generative neural network based model to handle various operational changes. Here, one objective is to learn continually by capturing past data distributional knowledge, while adapting new data signatures. Other objective, is to handle changes in data distribution like, to identify drifts, as well as, variations in diverse operational conditions of the system. We have experimented using vibration sensor based public real-world bearing data and performed extensive analysis incorporating synthetic drifts. Proposed method outperforms existing benchmark performances with clear separation of drift in learned representation.

References

[1]
Soma Bandyopadhyay, Arijit Ukil, Chetanya Puri, Rituraj Singh, Tulika Bose, and Arpan Pal. 2016. SensIPro: Smart sensor analytics for Internet of things. In 2016 IEEE Symposium on Computers and Communication (ISCC). IEEE, 415--421.
[2]
E Oran Brigham. 1988. The fast Fourier transform and its applications. Prentice-Hall, Inc.
[3]
Case Western Reserve University Bearing Data Center. 2018. https://csegroups.case.edu/bearingdatacenter/home. (2018).
[4]
Jiangpeng He and Fengqing Zhu. 2022. Out-Of-Distribution Detection In Un-supervised Continual Learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3850--3855.
[5]
Irina Higgins, Loic Matthey, Arka Pal, Christopher Burgess, Xavier Glorot, Matthew Botvinick, Shakir Mohamed, and Alexander Lerchner. 2016. beta-vae: Learning basic visual concepts with a constrained variational framework. (2016).
[6]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735--1780.
[7]
Tongtong Jin, Chuliang Yan, Chuanhai Chen, Zhaojun Yang, Hailong Tian, and Jinyan Guo. 2021. New domain adaptation method in shallow and deep layers of the CNN for bearing fault diagnosis under different working conditions. The International Journal of Advanced Manufacturing Technology (2021), 1--12.
[8]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[9]
Diederik P Kingma and Max Welling. 2013. Auto-encoding variational bayes. arXiv preprint arXiv:1312.6114 (2013).
[10]
James Kirkpatrick, Razvan Pascanu, Neil Rabinowitz, Joel Veness, Guillaume Desjardins, Andrei A Rusu, Kieran Milan, John Quan, Tiago Ramalho, Agnieszka Grabska-Barwinska, et al. 2017. Overcoming catastrophic forgetting in neural networks. Proceedings of the national academy of sciences 114, 13 (2017), 3521--3526.
[11]
Timothée Lesort, Massimo Caccia, and Irina Rish. 2021. Understanding Continual Learning Settings with Data Distribution Drift Analysis. arXiv preprint arXiv:2104.01678 (2021).
[12]
Zhizhong Li and Derek Hoiem. 2017. Learning without forgetting. IEEE transactions on pattern analysis and machine intelligence 40, 12 (2017), 2935--2947.
[13]
David Lopez-Paz and Marc'Aurelio Ranzato. 2017. Gradient episodic memory for continual learning. Advances in neural information processing systems 30 (2017), 6467--6476.
[14]
Chao Pan, Ruifu Zhang, Hao Luo, and Hua Shen. 2016. Baseline correction of vibration acceleration signals with inconsistent initial velocity and displacement. Advances in Mechanical Engineering 8, 10 (2016), 1687814016675534.
[15]
Maan Singh Rathore and SP Harsha. 2022. Rolling Bearing Prognostic Analysis for Domain Adaptation Under Different Operating Conditions. Engineering Failure Analysis (2022), 106414.
[16]
Sylvestre-Alvise Rebuffi, Alexander Kolesnikov, Georg Sperl, and Christoph H Lampert. 2017. icarl: Incremental classifier and representation learning. In Proceedings of the IEEE conference on Computer Vision and Pattern Recognition. 2001--2010.
[17]
Saeid Safavi, Mohammad Amin Safavi, Hossein Hamid, and Saber Fallah. 2021. Multi-Sensor Fault Detection, Identification, Isolation and Health Forecasting for Autonomous Vehicles. Sensors 21, 7 (2021), 2547.
[18]
Abhishek B Sharma, Leana Golubchik, and Ramesh Govindan. 2010. Sensor faults: Detection methods and prevalence in real-world datasets. ACM Transactions on Sensor Networks (TOSN) 6, 3 (2010), 1--39.
[19]
Jingjing Wen, Houpu Yao, Ze Ji, Bin Wu, and Min Xia. 2020. On fault diagnosis for high-g accelerometers via data-driven models. IEEE Sensors Journal 21, 2 (2020), 1359--1368.
[20]
Juan Ye, Pakawat Nakwijit, Martin Schiemer, Saurav Jha, and Franco Zambonelli. 2021. Continual Activity Recognition with Generative Adversarial Networks. ACM Transactions on Internet of Things 2, 2 (2021), 1--25.
[21]
Friedemann Zenke, Ben Poole, and Surya Ganguli. 2017. Continual learning through synaptic intelligence. In International Conference on Machine Learning. PMLR, 3987--3995.

Cited By

View all
  • (2023)EdgeFD: An Edge-Friendly Drift-Aware Fault Diagnosis System for Industrial IoT2023 IEEE 23rd International Conference on Communication Technology (ICCT)10.1109/ICCT59356.2023.10419797(390-396)Online publication date: 20-Oct-2023

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SenSys '22: Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems
November 2022
1280 pages
ISBN:9781450398862
DOI:10.1145/3560905
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 January 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. continual learning
  2. machine vibration
  3. sensor drift

Qualifiers

  • Research-article

Conference

Acceptance Rates

SenSys '22 Paper Acceptance Rate 52 of 187 submissions, 28%;
Overall Acceptance Rate 174 of 867 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)14
  • Downloads (Last 6 weeks)0
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)EdgeFD: An Edge-Friendly Drift-Aware Fault Diagnosis System for Industrial IoT2023 IEEE 23rd International Conference on Communication Technology (ICCT)10.1109/ICCT59356.2023.10419797(390-396)Online publication date: 20-Oct-2023

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media