research-article

DNTC: : An unsupervised Deep Networks for Temperature Compensation in non-stationary data

Authors:

Yuanhai ShaoAuthors Info & Claims

Volume 127, Issue PB

https://doi.org/10.1016/j.engappai.2023.107319

Published: 01 February 2024 Publication History

Abstract

Temperature changes usually result in abnormal signals and hence could significantly decrease the performance of sensors. To reduce the system errors caused by temperature changes, constructing an accurate temperature compensation model from the data is a promising issue. However, there are few effective methods to address the challenges when faced with practical difficulties, including large amounts of data, high volatility, strong non-stationarity, and high training cost. In this paper, we propose an unsupervised Deep Networks for Temperature Compensation (DNTC) to compensate temperature for non-stationary data. DNTC consists of three submodules: pooling, generation, and reconstruction modules. The pooling module employs a convolutional network to effectively compress features, the generation module uses a De-stationary Attention-based encoder–decoder structure to extract non-stationary information from the sequence, and the reconstruction module solves the statistical quantity deviation problem of the output sequence to achieve temperature compensation. DNTC employs an end-to-end architecture, avoiding the bias accumulation phenomenon caused by multi-stage operations in traditional methods; and it breaks free from the awkwardness of relying on labeled learning, thus expanding its applicability. Furthermore, it effectively handles large-scale sequences while considering their non-stationary characteristics. Extensive experiments on 9 datasets demonstrate that DNTC exhibits excellent compensation effects and is expected to be widely used in the engineering field. Code and data are available at: https://github.com/tietoucun/Temperature-Compensation.

References

[1]

Alcantarilla P.F., Stent S., Ros G., Arroyo R., Gherardi R., Street-view change detection with deconvolutional networks, Auton. Robots 42 (7) (2018) 1301–1322,.

Digital Library

[2]

Ba J.L., Kiros J.R., Hinton G.E., Layer normalization, 2016,.

[3]

Brossard M., Bonnabel S., Barrau A., Denoising IMU gyroscopes with deep learning for open-loop attitude estimation, IEEE Robot. Autom. Lett. 5 (3) (2020) 4796–4803,.

[4]

Chang H.C., Hsu Y.L., Yang S.C., Lin J.C., Wu Z.H., A wearable inertial measurement system with complementary filter for gait analysis of patients with Stroke or Parkinson’s disease, IEEE Access 4 (2016) 8442–8453,.

[5]

Chen F., Zhang K., Identification for temperature model and the method for temperature compensation of quartz flexible accelerometer, in: 2015 IEEE Advanced Information Technology, Electronic and Automation Control Conference, IAEAC, 2015, pp. 841–845,.

[6]

Cheng J., Fang J., Wu W., Li J., Temperature drift modeling and compensation of RLG based on PSO tuning SVM, Measurement 55 (2014) 246–254,.

[7]

Correia D.S., Alana J., Luna C.E., Attention, please! A survey of neural attention models in deep learning, Artif. Intell. Rev. 55 (8) (2022) 6037–6124,.

Digital Library

[8]

Cui J., Yan G., Zhao Q., Enhanced temperature stability of scale factor in MEMS gyroscope based on multi parameters fusion compensation method, Measurement 148 (2019),.

[9]

Draper N.R., Smith H., Applied Regression Analysis, Vol. 326, John Wiley & Sons, 1998,.

[10]

Du F., Wu S., Xing S., Xu C., Su Z., Temperature compensation to guided wave-based monitoring of bolt loosening using an attention-based multi-task network, Struct. Health Monit. 22 (3) (2023) 1893–1910,.

[11]

Günhan Y., Ünsal D., Polynomial degree determination for temperature dependent error compensation of inertial sensors, in: 2014 IEEE/ION Position, Location and Navigation Symposium - PLANS 2014, 2014, pp. 1209–1212,.

[12]

Guo G., Chai B., Cheng R., Wang Y., Temperature drift compensation of a MEMS accelerometer based on DLSTM and ISSA, Sensors 23 (4) (2023),.

[13]

Han Z., Hong L., Meng J., Li Y., Gao Q., Temperature drift modeling and compensation of capacitive accelerometer based on AGA-BP neural network, Measurement 164 (2020),.

[14]

Huang F., Wang Z., Xing L., Gao C., A MEMS IMU gyroscope calibration method based on deep learning, IEEE Trans. Instrum. Meas. 71 (2022) 1–9,.

[15]

Huo Z., Wang F., Shen H., Sun X., Zhang J., Li Y., Chu H., Optimal compensation of MEMS gyroscope noise Kalman filter based on conv-DAE and MultiTCN-attention model in static base environment, Sensors 22 (19) (2022),.

[16]

Ioffe S., Szegedy C., Batch normalization: Accelerating deep network training by reducing internal covariate shift, in: Bach F., Blei D. (Eds.), Proceedings of the 32nd International Conference on Machine Learning, in: Proceedings of Machine Learning Research, vol. 37, PMLR, Lille, France, 2015, pp. 448–456. URL https://proceedings.mlr.press/v37/ioffe15.html.

[17]

Jiang C., Chen S., Chen Y., Zhang B., Feng Z., Zhou H., Bo Y., A MEMS IMU de-noising method using long short term memory recurrent neural networks (LSTM-RNN), Sensors 18 (10) (2018),.

[18]

Kalman R.E., A new approach to linear filtering and prediction problems, J. Basic Eng. 82 (1) (1960) 35–45,.

[19]

Liu Y., Ma T., Parasitic resistance-based high precision capacitive MEMS accelerometer phase shift and its usage for temperature compensation, IEEE Sens. J. 18 (2) (2018) 629–634,.

[20]

Liu Y., Wu H., Wang J., Long M., Non-stationary transformers: Exploring the stationarity in time series forecasting, in: Oh A.H., Agarwal A., Belgrave D., Cho K. (Eds.), Advances in Neural Information Processing Systems, 2022, URL https://openreview.net/forum?id=ucNDIDRNjjv.

[21]

Liu Y.Y., Yang G.L., Li S.Y., Application of BP-bagging model in temperature compensation for fiber optic gyroscope, Zhongguo Guanxing Jishu Xuebao 22 (2014) 254–259,.

[22]

Mao N., Xu J., Li J., He H., A LSTM-RNN-based fiber optic gyroscope drift compensation, Math. Probl. Eng. 2021 (2021) 1–10,.

[23]

Nair V., Hinton G.E., Rectified Linear Units Improve Restricted Boltzmann Machines, ICML ’10, Omni Press, Madison, WI, USA, 2010, pp. 807–814,.

Digital Library

[24]

Pan Y., Li L., Ren C., Luo H., Study on the compensation for a quartz accelerometer based on a wavelet neural network, Meas. Sci. Technol. 21 (10) (2010),.

[25]

Qi B., Shi S., Zhao L., Cheng J., A novel temperature drift error precise estimation model for MEMS accelerometers using microstructure thermal analysis, Micromachines 13 (6) (2022),.

[26]

Rumelhart D.E., Hinton G.E., Williams R.J., Learning representations by back-propagating errors, Nature 323 (1986) 533–536,.

[27]

Shannon C.E., A mathematical theory of communication, Bell Syst. Tech. J. 27 (1948) 623–656,.

Digital Library

[28]

Song R., Chen X., Shen C., Zhang H., Modeling FOG drift using back-propagation neural network optimized by artificial fish swarm algorithm, J. Sensors 2014 (2014) 1–6,.

[29]

Stefan G., Manfred R., PrecTime: A deep learning architecture for precise time series segmentation in industrial manufacturing operations, Eng. Appl. Artif. Intell. 122 (2023),.

Digital Library

[30]

Vaswani A., Shazeer N., Parmar N., Uszkoreit J., Jones L., Gomez A.N., Kaiser Ł., Polosukhin I., Attention is all you need, in: Guyon I., Luxburg U.V., Bengio S., Wallach H., Fergus R., Vishwanathan S., Garnett R. (Eds.), Advances in Neural Information Processing Systems, Vol. 30, Curran Associates, Inc., 2017, URL https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf.

[31]

Wang X., Cao H., Improved VMD-ELM algorithm for MEMS gyroscope of temperature compensation model based on CNN-LSTM and PSO-SVM, Micromachines 13 (12) (2022),. URL https://www.mdpi.com/2072-666X/13/12/2056.

[32]

Wang P., Li G., Gao Y., A compensation method for random error of gyroscopes based on support vector machine and beetle antennae search algorithm, in: 2021 International Conference on Computer, Control and Robotics, ICCCR, 2021, pp. 283–287,.

[33]

Wang Z., Xie C., Liu B., Jiang Y., Li Z., Tai H., Li X., Self-adaptive temperature and humidity compensation based on improved deep BP neural network for NO2 detection in complex environment, Sensors Actuators B 362 (2022),.

[34]

Wang Y., Zhang J., Yao Z., Lin C., Zhou T., Su Y., Zhao J., A MEMS resonant accelerometer with high performance of temperature based on electrostatic spring softening and continuous ring-down technique, IEEE Sens. J. 18 (17) (2018) 7023–7031,.

[35]

Wang S., Zhu W., Shen Y., Ren J., Gu H., Wei X., Temperature compensation for MEMS resonant accelerometer based on genetic algorithm optimized backpropagation neural network, Sensors Actuators A 316 (2020),.

[36]

Wei G., Li G., Wu Y., Long X., Application of least squares-support vector machine in system-level temperature compensation of ring laser gyroscope, Measurement 44 (10) (2011) 1898–1903,.

[37]

Wei W., Xiyuan C., Temperature drift modeling and compensation of fiber optical gyroscope based on improved support vector machine and particle swarm optimization algorithms, Appl. Opt. 55 (23) (2016) 6243–6250,.

[38]

Wu H., Xu J., Wang J., Long M., Autoformer: Decomposition transformers with auto-correlation for long-term series forecasting, in: Ranzato M., Beygelzimer A., Dauphin Y., Liang P., Vaughan J.W. (Eds.), Advances in Neural Information Processing Systems, Vol. 34, Curran Associates, Inc., 2021, pp. 22419–22430. URL https://proceedings.neurips.cc/paper_files/paper/2021/file/bcc0d400288793e8bdcd7c19a8ac0c2b-Paper.pdf.

[39]

Xiong Q., Yuan C., He B., Xiong H., Kong Q., GTRF: A general deep learning framework for tuples recognition towards supervised, semi-supervised and unsupervised paradigms, Eng. Appl. Artif. Intell. 124 (2023),.

Digital Library

[40]

Xu D., Yang Z.G., Zhao H., Zhou X., A temperature compensation method for MEMS accelerometer based on LM_BP neural network, in: 2016 IEEE SENSORS, 2016, pp. 1–3,.

[41]

Xu X., Zhang Y., Corn cash price forecasting with neural networks, Comput. Electron. Agric. 184 (2021),.

[42]

Xu X., Zhang Y., House price forecasting with neural networks, Intell. Syst. Appl. 12 (2021),.

[43]

Xu X., Zhang Y., Second-hand house price index forecasting with neural networks, J. Prop. Res. 39 (3) (2022) 215–236,.

[44]

Xu X., Zhang Y., Soybean and soybean oil price forecasting through the nonlinear autoregressive neural network (NARNN) and NARNN with exogenous inputs (NARNN–X), Intell. Syst. Appl. 13 (2022),.

[45]

Yang W., Fang B., Tang Y., Qin X., A temperature compensation model for low cost quartz accelerometers and its application in tilt sensing, Math. Probl. Eng. 2016 (2016) 1–10,.

[46]

Yang Y., Liu Y., Liu Y., Zhao X., Temperature compensation of MEMS gyroscope based on support vector machine optimized by GA, in: 2019 IEEE Symposium Series on Computational Intelligence, SSCI, 2019, pp. 2989–2994,.

[47]

Yang J., Shao Y., Li C., Wang W., A multistage deep imputation framework for missing values large segment imputation with statistical metrics, Appl. Soft Comput. 146 (2023).

[48]

Zeng A., Chen M., Zhang L., Xu Q., Are transformers effective for time series forecasting?, 2022,.

[49]

Zhang J., Jiang G., Cumberland T., Xu P., Wu Y., Delaat S., Yu A., Chen Z., A highly sensitive breathable fuel cell gas sensor with nanocomposite solid electrolyte, InfoMat 1 (2) (2019) 234–241,.

[50]

Zhao X., Chen Y., Wei G., Pang L., Xu C., A comprehensive compensation method for piezoresistive pressure sensor based on surface fitting and improved grey wolf algorithm, Measurement 207 (2023),.

[51]

Zhao W., Cheng Y., Zhao S., Hu X., Rong Y., Duan J., Chen J., Navigation grade MEMS IMU for a satellite, Micromachines 12 (2) (2021),.

[52]

Zhao S., Zhou Y., Shu X., Study on nonlinear error calibration of fiber optical gyroscope scale factor based on LSTM, Measurement 190 (2022),.

[53]

Zhou H., Zhang S., Peng J., Zhang S., Li J., Xiong H., Zhang W., Informer: Beyond efficient transformer for long sequence time-series forecasting, Proc. AAAI Conf. Artif. Intell. 35 (12) (2021) 11106–11115,. URL https://ojs.aaai.org/index.php/AAAI/article/view/17325.

[54]

Zhu H., Gao K., Xia Y., Gao F., Weng S., Sun Y., Hu Q., Multi-rate data fusion for dynamic displacement measurement of beam-like supertall structures using acceleration and strain sensors, Struct. Health Monit. 19 (2) (2020) 520–536,.

[55]

Zhu M., Pang L., Xiao Z., Shen C., Cao H., Shi Y., Liu J., Temperature drift compensation for high-G MEMS accelerometer based on RBF NN improved method, Appl. Sci. 9 (4) (2019),.

[56]

Zhu L., Xie B., Xing Y., Chen D., Wang J., Wang Y., Wei Q., Chen J., A resonant pressure sensor capable of temperature compensation with least squares support vector machine, Procedia Eng. 168 (2016) 1731–1734. Proceedings of the 30th anniversary Eurosensors Conference – Eurosensors 2016, 4-7. Sepember 2016, Budapest, Hungary.

[57]

Zotov S.A., Simon B.R., Trusov A.A., Shkel A.M., High quality factor resonant MEMS accelerometer with continuous thermal compensation, IEEE Sens. J. 15 (9) (2015) 5045–5052,.

Index Terms

DNTC: An unsupervised Deep Networks for Temperature Compensation in non-stationary data
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
  2. Machine learning
    1. Machine learning approaches
      1. Neural networks
2. Theory of computation
  1. Theory and algorithms for application domains
    1. Machine learning theory

Index terms have been assigned to the content through auto-classification.

Recommendations

Compensation of temperature effects for in-situ soil moisture measurement by DPHP sensors

Low power DPHP sensor is fabricated.A simple approach for the temperature compensation in DPHP sensors.Soil temperature is measured using the DPHP sensors.Effect of soil temperature is studied on 8 different soils.A low power prototype is developed for ...
The Development of Infrared Temperature Sensor Based on Thermopile Detector TPS334 and PGA309
ICMTMA '09: Proceedings of the 2009 International Conference on Measuring Technology and Mechatronics Automation - Volume 01

The paper introduces a kind of infrared temperature sensor having wide measure range and stable readings which is developed based on thermopile detector TPS334 and PGA309. The principle of PGA309 signal amplification, ambient temperature compensation ...
Research on reflective intensity-modulated fibre-optical pressure sensor based on desensitisation of temperature compensation method

To address the need for pressure detection in oil field wells with large temperature fluctuations, this paper studies the Reflective Intensity-Modulated Fibre-Optic Pressure Sensor (RIM-FOPS) technology based on temperature compensation method ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Engineering Applications of Artificial Intelligence

Engineering Applications of Artificial Intelligence Volume 127, Issue PB

Jan 2024

1549 pages

Issue’s Table of Contents

Elsevier Ltd.

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 February 2024

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

0
Total Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Dec 2024

Other Metrics

View Author Metrics

Citations

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents