Abstract
To ensure the reliability and operational efficiency of the grid system, this paper proposes an unmanned aerial vehicle (UAV)-assisted Power Internet of Things (PIoT), which obtains real-time grid data through PIoT devices to support the management optimization of the grid system. Compared with traditional UAV-assisted communication networks, this paper enables data collection and energy transmission services for PIoT devices through UAVs. Firstly, the flight-hover-communication protocol is used. When the UAVs approach the target devices, they stop flying and remain hovering to provide services. The UAV selects full duplex mode in the hovering state, i.e., within the coverage area of the UAV, it can collect data from the target device while providing charging for other devices. Secondly, the UAVs can provide services to the required devices in sequence. Considering the priorities of the devices, both the data queue state and the energy pair state of network devices are considered comprehensively. Therefore, the optimization problem is constructed as a multi-objective optimization problem. First, the multi-objective optimization problem is transformed into a Markov process. Then, a multi-objective dynamic resource allocation algorithm based on reinforcement learning is proposed for solving the multi-objective optimization problem. The simulation results show that the proposed resource allocation scheme can effectively achieve a reasonable allocation of UAV resources, joint multi-objective optimization, and improved system performance.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Availability of data and materials
All data generated or analyzed during this study are included in this manuscript. Code may be available from the corresponding author on request.
References
Deng X, Jiang Y, Yang L, Yi L, Chen J, Liu Y, Li X (2020) Learning-automata-based confident information coverage barriers for smart ocean internet of things. IEEE Internet Things J 7(10):9919–9929
Song F, Zhu M, Zhou Y, You I, Zhang H (2020) Smart collaborative tracking for ubiquitous power IoT in edge-cloud interplay domain. IEEE Internet Things J 7(7):6046–6055
Dong M, Ota K, Yang LT, Chang S, Zhu H, Zhou Z (2014) Mobile agent-based energy-aware and user-centric data collection in wireless sensor networks. Comput Netw 74:58–70
Song F, Ai Z, Zhou Y, You I, Choo R, Zhang H (2020) Smart collaborative automation for receive buffer control in multipath industrial networks. IEEE Trans Ind Inf 16(2):1385–1394
Song F, Li L, You I, Yu S, Zhang H (2022) Optimizing high-speed mobile networks with smart collaborative theory. IEEE Wirel Commun 29(3):48–54
Song F, Ai Z, Zhang H, You I, Li S (2021) Smart collaborative balancing for dependable network components in cyber-physical systems. IEEE Trans Ind Inf 17(10):6916–6924
Song F, Li L, You I, Zhang H (2021) Enabling heterogeneous deterministic networks with smart collaborative theory. IEEE Netw 35(3):64–71
Wang F, Xu J, Cui S (2020) Optimal energy allocation and task offloading policy for wireless powered mobile edge computing systems. IEEE Trans Wirel Commun 19(4):2443–2459
Fang X, Misra S, Xue G, Yang D (2012) Smart grid the new and improved power grid: a survey. IEEE Commun Surv Tutor 14(4):944–980
Qin P, Fu Y, Zhao X, Wu K, Liu J, Wang M (2022) Optimal task offloading and resource allocation for C-NOMA heterogeneous air-ground integrated power internet of things networks. IEEE Trans Wirel Commun 21(11):9276–9292
Bedi G, Venayagamoorthy GK, Singh R, Brooks RR, Wang K-C (2018) Review of Internet of Things (IoT) in electric power and energy systems. IEEE Internet Things J 5(2):847–870
Sun R, Wang Y, Su R, Cheng N, Shen XS (2019) A destination-aided wireless energy transfer scheme in multi-antenna relay sensor networks. IEEE Wirel Commun Lett 8(3):689–692
Anajemba JH, Tue T, Iwendi C, Ohwoekevwo A, Srivastava G, Jo O (2020) Realizing efficient security and privacy in IoT networks. Sensors 20(9):1–24
Guo H, Liu J (2020) UAV-enhanced intelligent offloading for internet of things at the edge. IEEE Trans Ind Inf 16(4):2737–2746
Wang B, Sun Y, Sun Z, Nguyen LD, Duong TQ (2020) UAV-assisted emergency communications in social IoT: a dynamic hypergraph coloring approach. IEEE Internet Things J 7(8):7663–7677
Wang H, Wang J, Ding G, Wang L, Tsiftsis TA, Sharma PK (2018) Resource allocation for energy harvesting-powered D2D communication underlaying UAV-assisted networks. IEEE Trans Green Commun Netw 2(1):14–24
Cheng N et al (2019) Space/aerial-assisted computing offloading for IoT applications: a learning-based approach. IEEE J Sel Areas Commun 37(5):1117–1129
Chen M, Hao Y, Lin K, Yuan Z, Hu L (2018) Label-less learning for traffic control in an edge network. IEEE Netw 32(6):8–14
Zeng Y, Zhang R, Lim TJ (2016) Wireless communications with unmanned aerial vehicles: opportunities and challenges. IEEE Commun Mag 54(5):36–42
Liu Z, Meng X, Yang Y, Ma K, Guan X (2022) Energy-efficient UAV-aided ocean monitoring networks: joint resource allocation and trajectory design. IEEE Internet Things J 9(18):17871–17884
Zhou Z, Zhang C, Xu C, Xiong F, Zhang Y, Umer T (2018) Energy-efficient industrial internet of UAVs for power line inspection in smart grid. IEEE Trans Ind Inf 14(6):2705–2714
Dai M, Wu Y, Qian L, Su Z, Lin B, Chen N (2023) UAV-assisted multi-access computation offloading via hybrid NOMA and FDMA in marine networks. IEEE Trans Netw Sci Eng 10(1):113–127
Jia Z, Sheng M, Li J, Niyato D, Han Z (2021) LEO-satellite-assisted UAV: joint trajectory and data collection for internet of remote things in 6G aerial access networks. IEEE Internet Things J 8(12):9814–9826
Zhang T, Lei J, Liu Y, Feng C, Nallanathan A (2021) Trajectory optimization for UAV emergency communication with limited user equipment energy: a safe-DQN approach. IEEE Trans Green Commun Netw 5(3):1236–1247
Yang Y, Wei X, Xu R, Peng L (2022) Joint optimization of AoI, SINR, completeness, and energy in UAV-aided SDCNs: coalition formation game and cooperative order. IEEE Trans Green Commun Netw 6(1):265–280
Wang W, Srivastava G, Lin JC-W, Yang Y, Alazab M, Gadekallu TR (2023) Data freshness optimization under CAA in the UAV-aided MECN: a potential game perspective. IEEE Trans Intell Transp Syst 24(11):12912–12921
Yang Y, Wang W, Xu R, Srivastava G, Alazab M, Gadekallu TR, Su C (2022) AoI optimization for UAV-aided MEC networks under channel access attacks: a game theoretic viewpoint. In: IEEE international conference on communications, Seoul, Republic of Korea, May 2022, pp 1–6
Yang Y, Wang W, Liu L, Dev K, Qureshi NMF (2023) AoI optimization in the UAV-aided traffic monitoring network under attack: a stackelberg game viewpoint. IEEE Trans Intell Transp Syst 24(1):932–941
Gu J, Wang H, Ding G, Xu Y, Xue Z, Zhou H (2020) Energy-constrained completion time minimization in UAV-enabled internet of things. IEEE Internet Things J 7(6):5491–5503
Gao X, Zhu X, Zhai L (2023) Minimization of aerial cost and mission completion time in multi-UAV-enabled IoT networks. IEEE Trans Commun 71(9):5335–5347
Yang G, Yao Y (2023) Resource allocation control of UAV-assisted IoT communication device. IEEE Trans Intell Transp Syst 24(11):13341–13349
Liu L, Xiong K, Cao J, Lu Y, Fan P, Letaief KB (2022) Average AoI minimization in UAV-assisted data collection with RF wireless power transfer: a deep reinforcement learning scheme. IEEE Internet Things J 9(7):5216–5228
Liu Y, Xiong K, Lu Y, Ni Q, Fan P, Letaief KB (2021) UAV-aided wireless power transfer and data collection in Rician fading. IEEE J Sel Areas Commun 39(10):3097–3113
Pang Y, Zhang Y, Gu Y, Pan M, Han Z, Li P (2014) Efficient data collection for wireless rechargeable sensor clusters in Harsh terrains using UAVs. In: 2014 IEEE global communications conference, Austin, TX, USA, pp 234–239
Yan H, Chen Y, Yang S-H (2020) UAV-enabled wireless power transfer with base station charging and UAV power consumption. IEEE Trans Veh Technol 69(11):12883–12896
Xie L, Xu J, Zhang R (2019) Throughput maximization for UAV-enabled wireless powered communication networks. IEEE Internet Things J 6(2):1690–1703
Hu X, Wong K-K, Zhang Y (2020) Wireless-powered edge computing with cooperative UAV: task, time scheduling and trajectory design. IEEE Trans Wirel Commun 19(12):8083–8098
Ye H-T, Kang X, Joung J, Liang Y-C (2020) Optimization for full-duplex rotary-wing UAV-enabled wireless-powered IoT networks. IEEE Trans Wirel Commun 19(7):5057–5072
Yang Z, Xu W, Shikh-Bahaei M (2020) Energy efficient UAV communication with energy harvesting. IEEE Trans Veh Technol 69(2):1913–1927
Ye H-T, Kang X, Joung J, Liang Y-C (2021) Joint uplink-and-downlink optimization of 3-D UAV swarm deployment for wireless-powered IoT networks. IEEE Internet Things J 8(17):13397–13413
Yu Y, Tang J, Huang J, Zhang X, So DKC, Wong K-K (2021) Multi-objective optimization for UAV-assisted wireless powered IoT networks based on extended DDPG algorithm. IEEE Trans Commun 69(9):6361–6374
Zeng Y, Xu J, Zhang R (2019) Energy minimization for wireless communication with rotary-wing UAV. IEEE Trans Wirel Commun 18(4):2329–2345
Boshkovska E, Ng DWK, Zlatanov N, Schober R (2015) Practical non-linear energy harvesting model and resource allocation for SWIPT systems. IEEE Commun Lett 19(12):2082–2085
Sun Q-M, Zhang C, Jiang N-Y, Yu J-J, Xu L (2020) Data-driven nonlinear near-optimal regulation based on multi-dimensional Taylor network dynamic programming. IEEE Access 8:36476–36484
Jiang W, Feng D, Sun Y, Feng G, Wang Z, Xia X-G (2022) Proactive content caching based on actor-critic reinforcement learning for mobile edge networks. IEEE Trans Cogn Commun Netw 8(2):1239–1252
Ye J, Zhang YJA (2020) DRAG: deep reinforcement learning based base station activation in heterogeneous networks. IEEE Trans Mob Comput 19(9):2076–2087
Lillicrap TP, Hunt JJ, Pritzel A, Heess N, Erez T, Tassa Y, Silver D, Wierstra D (2015) Continuous control with deep reinforcement learning, arXiv preprint arXiv:1509.02971
Kong X et al (2022) Deep reinforcement learning-based energy-efficient edge computing for internet of vehicles. IEEE Trans Ind Inf 18(9):6308–6316
Hu H, Xiong K, Qu G, Ni Q, Fan P, Letaief KB (2021) AoI-minimal trajectory planning and data collection in UAV-assisted wireless powered IoT networks. IEEE Internet Things J 8(2):1211–1223
Fan X, Liu M, Chen Y, Sun S, Li Z, Guo X (2023) RIS-assisted UAV for fresh data collection in 3D urban environments: a deep reinforcement learning approach. IEEE Trans Veh Technol 72(1):632–647
Han X, Yang W, Li M, Zhang L, Yan F, Ma X (2020) A trajectory planning algorithm for data collection in UAV-aided wireless sensor networks. In: 2020 IEEE 6th international conference on computer and communications (ICCC), Chengdu, China, pp 846–851
Author information
Authors and Affiliations
Contributions
TL, JA, and HX wrote the main manuscript text, ML and FL prepared figures and tables. All authors reviewed the manuscript.
Corresponding authors
Ethics declarations
Confict of interest
The authors declare no competing interests.
Ethics approval
Not applicable.
Consent to participate
Not applicable.
Consent for publication
The publication has been approved by all co-authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Lyu, T., An, J., Li, M. et al. UAV-assisted wireless charging and data processing of power IoT devices. Computing 106, 789–819 (2024). https://doi.org/10.1007/s00607-023-01245-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00607-023-01245-y