Abstract
Underwater Wireless Sensor Network (UWSN) is a popular technique for monitoring marine environments. It consists of several acoustic channels, sink nodes, sensor nodes and base stations. Source nodes are deployed at different depth levels of oceans for monitoring purposes. Acoustic channels communicate between a source node and a sink node. After that, the information from the sink node is delivered to the base station using an RF signal. Limited Bandwidth, Energy Consumption and propagation delay are major challenges faced by UWSN. Battery consumption of sensor nodes leads to a great impact on the performance of the underwater wireless network. Void-hole occurrence and duplication of packets from sensor nodes to sink nodes increases energy dissipation and reduces the lifespan of the UWSN. Hence energy-efficient opportunistic routing with emperor penguin optimized Q learning method (EPO-Q) for UWSN was introduced to avoid the void-hole problem and reduce energy dissipation. The proposed work was implemented in the MATLAB platform and improved performance in terms of end-to-end delay, network overhead, energy consumption, accumulated propagation distance, battery power, packet loss ratio, absorption loss, throughput, energy efficiency and packet delivery ratio.
Similar content being viewed by others
Data Availability
Data sharing not applicable to this article.
References
Awan, K. M., Shah, P. A., Iqbal, K., Gillani, S., Ahmad, W., & Nam, Y. (2019). Underwater wireless sensor networks: a review of recent issues and challenges. Wireless Communications and Mobile Computing. https://doi.org/10.1155/2019/6470359
Anuradha, D., & Srivatsa, S. K. (2019). Energy effectual reconfigurable routing protocol (E2R2P) for cluster based underwater wireless sensor networks. Journal of Ambient Intelligence and Humanized Computing, 1–8, 709.
Mateen, A., Awais, M., Javaid, N., Ishmanov, F., Afzal, M. K., & Kazmi, S. (2019). Geographic and opportunistic recovery with depth and power transmission adjustment for energy-efficiency and void hole alleviation in UWSNs. Sensors, 19(3), 709.
Javaid, N., Ahmad, Z., Sher, A., Wadud, Z., Khan, Z. A., & Ahmed, S. H. (2019). Fair energy management with void hole avoidance in intelligent heterogeneous underwater WSNs. Journal of Ambient Intelligence and Humanized Computing, 10(11), 4225–4241.
Lu, Y., He, R., Chen, X., Lin, B., & Yu, C. (2020). Energy-Efficient Depth-Based Opportunistic Routing with Q-Learning for Underwater Wireless Sensor Networks. Sensors, 20(4), 1025.
Rahman, Z., Hashim, F., Rasid, M. F. A., & Othman, M. (2018). Totally opportunistic routing algorithm (TORA) for underwater wireless sensor network. PLoS ONE, 13(6), e0197087.
Celik, A., Saeed, N., Shihada, B., Al-Naffouri, T.Y., and Alouini, M-S. (2020). Opportunistic Routing for Opto-Acoustic Internet of Underwater Things, arXiv preprint arXiv: 2002.08420.
Hussain, T., Rehman, Z. U., Iqbal, A., Saeed, K., & Ali, I. (2020). Two hop verification for avoiding void hole in underwater wireless sensor network using SM-AHH-VBF and AVH-AHH-VBF routing protocols. Transactions on Emerging Telecommunications Technologies, 31(8), e3992.
Awais, M., Ali, I., Alghamdi, T. A., Ramzan, M., Tahir, M., Akbar, M., & Javaid, N. (2020). Towards void hole alleviation: enhanced geographic and opportunistic routing protocols in harsh underwater WSNs. IEEE Access. https://doi.org/10.1109/ACCESS.2020.2996367
Ahmad, B., Jian, W., Enam, R. N., & Abbas, A. (2019). Classification of DoS attacks in smart underwater wireless sensor network. Wireless Personal Communications, 1–15, 1055–1069.
Chithaluru, P., Tiwari, R., and Kumar, K. (2020). ARIOR: Adaptive Ranking Based Improved Opportunistic Routing in Wireless Sensor Networks. Wireless Personal Communications, 1–24
Kumar, N., Singh, Y., and Singh, P.K. (2020). An energy efficient trust aware opportunistic routing protocol for wireless sensor network. In Sensor Technology: Concepts, Methodologies, Tools, and Applications, IGI Global, 628–643.
Baranidharan, V., Sivaradje, G., Varadharajan, K., & Vignesh, S. (2020). Clustered geographic-opportunistic routing protocol for underwater wireless sensor networks. Journal of Applied Research and Technology, 18(2), 628–643.
Coutinho, R. W. L., Boukerche, A., & Loureiro, A. A. F. (2020). A novel opportunistic power controlled routing protocol for internet of underwater things. Computer Communications, 150, 72–82.
Kim, S. (2018). A better-performing Q-learning game-theoretic distributed routing for underwater wireless sensor networks. International Journal of Distributed Sensor Networks, 14(1), 1550147718754728.
Liu, G., Wang, X., Li, X., Hao, J., and Feng, Z. (2018). Esrq: An efficient secure routing method in wireless sensor networks based on q-learning. In 2018 17th IEEE International Conference on Trust, Security and Privacy in Computing and Communications/12th IEEE International Conference on Big Data Science and Engineering (TrustCom/BigDataSE), 149–155.
Chang, H., Feng, J., & Duan, C. (2019). Reinforcement learning-based data forwarding in underwater wireless sensor networks with passive mobility. Sensors, 19(2), 256.
Jin, Z., Ma, Y., Su, Y., Li, S., & Fu, X. (2017). A Q-learning-based delay-aware routing algorithm to extend the lifetime of underwater sensor networks. Sensors, 17(7), 1660.
Chithaluru, P., Tiwari, R., & Kumar, K. (2019). AREOR–Adaptive ranking based energy efficient opportunistic routing scheme in Wireless Sensor Network. Computer Networks, 162, 106863.
Coutinho, R.W.L., Boukerche, A., and Loureiro, A.A.F. (2018). PCR: A power control-based opportunistic routing for underwater sensor networks. In Proceedings of the 21st ACM International Conference on Modeling, Analysis and Simulation of Wireless and Mobile Systems, 173–180.
Kamaruddin, A., Ngadi, M. A., Harun, H., & Haron, H. N. (2019). Energy Efficient Opportunistic Routing Protocol (EE-OR) for Underwater Wireless Sensor Network. In Journal of Physics Conference Series, 1174(1), 012010.
Kaur, S., & Mahajan, R. (2018). Hybrid meta-heuristic optimization based energy efficient protocol for wireless sensor networks. Egyptian Informatics Journal, 19(3), 145–150.
Fang, Z., Wang, J., Jiang, C., Zhang, B., Qin, C., and Ren, Y. (2020). QLACO: Q-learning Aided Ant Colony Routing Protocol for Underwater Acoustic Sensor Networks. In 2020 IEEE Wireless Communications and Networking Conference (WCNC). 1–6.
Zhou, Y., Cao, T., and Xiang, W. (2020). Anypath Routing Protocol Design via Q-Learning for Underwater Sensor Networks. arXiv preprint arXiv:2002.09623.
Zhang, Y., Zhang, Z., Chen, L., & Wang, X. (2021). Reinforcement learning-based opportunistic routing protocol for underwater acoustic sensor networks. IEEE Transactions on Vehicular Technology, 70(3), 2756–2770.
Zhu, R., Jiang, Q., Huang, X., Li, D., & Yang, Q. (2022). a reinforcement-learning-based opportunistic routing protocol for energy-efficient and Void-Avoided UASNs. IEEE Sensors Journal. https://doi.org/10.1109/JSEN.2022.3175994
Jin, Z., Zhao, Q., & Su, Y. (2019). RCAR: A reinforcement-learning-based routing protocol for congestion-avoided underwater acoustic sensor networks. IEEE sensors journal, 19(22), 10881–10891.
Funding
No funding is provided for the preparation of manuscript.
Author information
Authors and Affiliations
Contributions
All authors have equal contributions in this work.
Corresponding author
Ethics declarations
Conflict of Interest
Authors declare that they have no conflict of interest
Consent to participate
All the authors involved have agreed to participate in this submitted article
Consent to Publish
All the authors involved in this manuscript give full consent for publication of this submitted article.
Ethical Approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Priyalakshmi, B., Murugaveni, S. Emperor Penguin Optimized Q Learning Method for Energy Efficient Opportunistic Routing in Underwater WSN. Wireless Pers Commun 128, 2039–2072 (2023). https://doi.org/10.1007/s11277-022-10031-6
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11277-022-10031-6