Abstract
We consider an energy harvesting wireless sensor network (EH-WSN), where each sensor, equipped with the battery, senses its surrounding area. We first define the estimation error of the sensing data at a measuring point, which increases as the distance to the sensor increases and the age of information (AoI) of the data increases. The AoI is the elapsed time since the latest status is generated. We also define the network coverage, which is defined as the area having the estimation errors lower than a target value. As a performance metric, we use the \(\alpha \)-coverage probability, which is the probability that the network coverage is larger than a threshold \(\alpha \). Finally, in order to deal with dynamic and complex environments, we propose a reinforcement learning (RL) based algorithm which determines the activation of the sensors. In simulation results, we show the proposed algorithm achieves higher performance than baselines. In addition, we show the impact of the transmission power and the number of sensors on the \(\alpha \)-coverage probability.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Barth-Maron, G., et al.: Distributed distributional deterministic policy gradients. In: Int. Conf. on Learning Representations (ICLR), Vancouver, Canada, April 2018
Chen, H., Li, X., Zhao, F.: A reinforcement learning-based sleep scheduling algorithm for desired area coverage in solar-powered wireless sensor networks. IEEE Sens. J. 16(8), 2763–2774 (2016)
Hribar, J., Costa, M., Kaminski, N., DaSilva, L.A.: Using correlated information to extend device lifetime. IEEE Internet Things J. 6(2), 2439–2448 (2018)
Kaul, S., Yates, R., Gruteser, M.: Real-time status: How often should one update? In: Proceedings IEEE Conference on Computer Communications, pp. 2731–2735, FL, USA, March 2012
Lillicrap, T.P., et al.: Continuous control with deep reinforcement learning. In: International Conference on Learning Representations (ICLR), San Juan, Puerto Rico, May 2016
Liu, W., Zhou, X., Durrani, S., Mehrpouyan, H., Blostein, S.D.: Energy harvesting wireless sensor networks: delay analysis considering energy costs of sensing and transmission. IEEE Trans. Wirel. Commun. 15(7), 4635–4650 (2016)
Shaikh, F.K., Zeadally, S.: Energy harvesting in wireless sensor networks: a comprehensive review. Renew. Sustain. Energy Rev. 55, 1041–1054 (2016)
Yang, C., Chin, K.W.: Novel algorithms for complete targets coverage in energy harvesting wireless sensor networks. IEEE Commun. Lett. 18(1), 118–121 (2013)
Zheng, J., Cai, Y., Shen, X., Zheng, Z., Yang, W.: Green energy optimization in energy harvesting wireless sensor networks. IEEE Commun. Mag. 53(11), 150–157 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 Springer Nature Switzerland AG
About this paper
Cite this paper
Yun, S., Kim, D., Lee, J. (2022). Learning-Based Activation of Energy Harvesting Sensors for Fresh Data Acquisition. In: Bakaev, M., Ko, IY., Mrissa, M., Pautasso, C., Srivastava, A. (eds) ICWE 2021 Workshops. ICWE 2021. Communications in Computer and Information Science, vol 1508. Springer, Cham. https://doi.org/10.1007/978-3-030-92231-3_6
Download citation
DOI: https://doi.org/10.1007/978-3-030-92231-3_6
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-92230-6
Online ISBN: 978-3-030-92231-3
eBook Packages: Computer ScienceComputer Science (R0)