Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Addressing the Gap Between Training Data and Deployed Environment by On-Device Learning

Published: 14 September 2023 Publication History

Abstract

The accuracy of tiny machine learning applications is often affected by various environmental factors, such as noises, location/calibration of sensors, and time-related changes. This article introduces a neural network based on-device learning (ODL) approach to address this issue by retraining in deployed environments. Our approach relies on semisupervised sequential training of multiple neural networks tailored for low-end edge devices. This article introduces its algorithm and implementation on wireless sensor nodes consisting of a Raspberry Pi Pico and low-power wireless modules. Experiments using vibration patterns of rotating machines demonstrate that retraining by ODL improves anomaly detection accuracy compared with a prediction-only deep neural network in a noisy environment. The results also show that the ODL approach can save communication cost and energy consumption for battery-powered Internet of Things devices.

References

[1]
Z. Zhou et al., “Edge intelligence: Paving the last mile of artificial intelligence with edge computing,” Proc. IEEE, vol. 107, no. 8, pp. 1738–1762, Aug. 2019.
[2]
J. Lu et al., “Learning under concept drift: A review,” IEEE Trans. Knowl. Data Eng., vol. 31, no. 12, pp. 2346–2363, Dec. 2019.
[3]
M. Tsukada et al., “A neural network-based on-device learning anomaly detector for edge devices,” IEEE Trans. Comput., vol. 69, no. 7, pp. 1027–1044, Jul. 2020.
[4]
N. Liang et al., “A fast and accurate online sequential learning algorithm for feedforward networks,” IEEE Trans. Neural Networks, vol. 17, no. 6, pp. 1411–1423, Nov. 2006.
[5]
G. Hinton et al., “Reducing the dimensionality of data with neural networks,” Science, vol. 313, no. 5786, pp. 504–507, 2006.
[6]
M. Wozniak et al., “A survey of multiple classifier systems as hybrid systems,” Inf. Fusion, vol. 16, pp. 3–17, Mar. 2014.
[7]
T. Yamada et al., “A lightweight concept drift detection method for on-device learning on resource-limited edge devices,” in Proc. Int. Parallel Distrib. Process. Symp. Workshops, May 2023, pp. 761–768.

Index Terms

  1. Addressing the Gap Between Training Data and Deployed Environment by On-Device Learning
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          Publisher

          IEEE Computer Society Press

          Washington, DC, United States

          Publication History

          Published: 14 September 2023

          Qualifiers

          • Research-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • 0
            Total Citations
          • 0
            Total Downloads
          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 02 Oct 2024

          Other Metrics

          Citations

          View Options

          View options

          Get Access

          Login options

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media