Enhancing Data Freshness in Air-Ground Collaborative Heterogeneous Networks through Contract Theory and Generative Diffusion-Based Mobile Edge Computing
<p>Heterogeneous network model (HNM).</p> "> Figure 2
<p>Process of producing an AI-generated contract.</p> "> Figure 3
<p>Types of MT versus utilities of MTs under different MEC servers.</p> "> Figure 4
<p>Utilities of MTs and MEC server versus number of MT types under different interference strategies.</p> "> Figure 5
<p>Utilities of MTs and the SP versus maximum delay under different incentives.</p> "> Figure 6
<p>Performance system versus trade-off parameter.</p> "> Figure 7
<p>Performance system versus trade-off parameter.</p> "> Figure 8
<p>Performance system versus trade-off parameter.</p> "> Figure 9
<p>Performance system versus maximum delay.</p> "> Figure 10
<p>Performance system versus maximum AoI.</p> "> Figure 11
<p>Training process.</p> "> Figure 12
<p>Contract design algorithms.</p> "> Figure 13
<p>Optimal location of UVAs in different MEC servers.</p> "> Figure 14
<p>Utility of the SP versus different interference strategies under the optimal location of UVAs.</p> ">
Abstract
:1. Introduction
- This study designs an incentive mechanism that includes both the contract design and the deployment phases. In particular, during the contract design phase, we model the quality of service of users as a function of delay and age of the information, taking into account NOMA communication. Based on this model, we then design the incentive mechanism to account for asymmetric information.
- During the contract design phase, we utilize contract theory to model a contract problem that optimizes the utility of a service provider (SP) while satisfying individual rationality (IR) and incentive compatibility (IC) criteria for mobile users. By reducing constraints and transforming variables, the original contract problem is transformed into a problem that can be solved by the BCD algorithm. To enhance the effectiveness of finding the optimal contract, a new solution based on the generative diffusion mode is proposed.
- During the contract deployment phase, we strive to maximize the utility of the SP contract deployment by optimizing the location of the UAV. To this end, an improved differential evolution algorithm is proposed to identify the optimal UAV locations.
- Compared with the existing methods, our numerical analysis experiment proves that our proposed methods are better and more effective under certain and uncertain environments.
2. Related Work
3. System Model
3.1. Utility of Mobile Terminal
3.2. Utility of Service Provider
3.3. Contract Formulation
4. Optimal Contract Design and Contract Deployment
4.1. Mathematical Based Contract Design
- and .
4.2. AI-Generated Contract Design
- Training Phase: focuses on training AI-generated contracts. It initializes key components such as replay buffer, contract generation and quality networks, and target networks. The main loop iterates through episodes and steps, where the agent interacts with the environment, generates contracts, and learns to optimize contract quality. The training process involves computing rewards, updating networks, and performing target network updates, which are core elements of reinforcement learning (RL).
- Looping Pseudo-code: indicates the inference phase. In this phase, the trained AI-generated contract is used to generate the optimal contract design based on the given environment vectors. It utilizes the network, which has learned from the training phase to produce effective contracts.
Algorithm 1 The algorithm for diffusion-generated contract. |
|
4.3. Deployment of Contracts
Algorithm 2 Finding optimal location using differential evolution algorithm. |
|
5. Simulation Results
5.1. Evaluation of the Proposed Contract Design under Certain Environment
5.1.1. Efficiency of Contract Design
5.1.2. Impact of Interference on System Performance
- OFDMA: Each MT in cross-layer and co-layer adopts orthogonal frequency-division multiple access (OFDMA) to offload computation tasks. OFDMA optimizes bandwidth via orthogonal subcarriers, ensuring interference-free transmission. Users on different subcarriers achieve mutual orthogonality, enhancing communication efficiency.
- NOMA: In both cross-layer and co-layer scenarios, each MT employs NOMA as a means to offload computational chores. NOMA permits multiple users to share the same subchannel, boosting spectral efficiency and ensuring rapid transmission. Unlike OFDMA, NOMA has less of the near–far effect and works best in dynamic link states, maintaining a strong rate performance even when there are problems with multi-access interference.
- Baseline: Each MT in both cross-layer and co-layer settings shares the same channel for computational task offloading.
5.1.3. Performance Comparison
5.1.4. Impact of System Parameters on System Performance
5.2. Evaluation of the Proposed Generative AI-Aided Contract Design under Uncertain Environment
- Our algorithm produces higher-quality samples by utilizing diffusion models and fine-tuning multiple times. By setting the diffusion step to 10 and gradually adjusting the model’s output with each fine tuning, the impact of uncertainty and noise is reduced, resulting in improved sampling accuracy.
- Our approach is better able to handle long-term dependencies. In contrast to traditional neural network generation models that solely take into account the input at the present time step, the diffusion model undergoes numerous fine-tuning iterations to produce samples including a greater number of time steps. This phenomenon leads to an enhanced capacity for long-term reliance processing.
5.3. Contract Deployment Optimal Design
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
References
- Mao, Y.; You, C.; Zhang, J.; Huang, K.; Letaief, K.B. A survey on mobile edge computing: The communication perspective. IEEE Commun. Surv. Tutor. 2017, 19, 2322–2358. [Google Scholar] [CrossRef]
- Chen, M.; Hao, Y. Task offloading for mobile edge computing in software defined ultra-dense network. IEEE J. Sel. Areas Commun. 2018, 36, 587–597. [Google Scholar] [CrossRef]
- Yates, R.D.; Sun, Y.; Brown, D.R.; Kaul, S.K.; Modiano, E.; Ulukus, S. Age of information: An introduction and survey. IEEE J. Sel. Areas Commun. 2021, 39, 1183–1210. [Google Scholar] [CrossRef]
- Chen, X.; Wu, C.; Chen, T.; Liu, Z.; Zhang, H.; Bennis, M.; Liu, H.; Ji, Y. Information freshness-aware task offloading in air-ground integrated edge computing systems. IEEE J. Sel. Areas Commun. 2021, 40, 243–258. [Google Scholar] [CrossRef]
- Singh, S.; Andrews, J.G. Joint resource partitioning and offloading in heterogeneous cellular networks. IEEE Trans. Wirel. Commun. 2013, 13, 888–901. [Google Scholar] [CrossRef]
- Al-Zahrani, A.Y.; Yu, F.R. An energy-efficient resource allocation and interference management scheme in green heterogeneous networks using game theory. IEEE Trans. Veh. Technol. 2015, 65, 5384–5396. [Google Scholar] [CrossRef]
- Xu, C.; Zheng, G.; Zhao, X. Energy-minimization task offloading and resource allocation for mobile edge computing in noma heterogeneous networks. IEEE Trans. Veh. Technol. 2020, 69, 16001–16016. [Google Scholar] [CrossRef]
- Fan, W.; Han, J.; Su, Y.; Liu, X.; Wu, F.; Tang, B.; Liu, Y. Joint task offloading and service caching for multi-access edge computing in wifi-cellular heterogeneous networks. IEEE Trans. Wirel. Commun. 2022, 21, 9653–9667. [Google Scholar] [CrossRef]
- Ma, X.; Zhou, A.; Sun, Q.; Wang, S. Freshness-aware information update and computation offloading in mobile-edge computing. IEEE Internet Things J. 2021, 8, 13115–13125. [Google Scholar] [CrossRef]
- Kang, J.; Xiong, Z.; Niyato, D.; Yu, H.; Liang, Y.-C.; Kim, D.I. Incentive design for efficient federated learning in mobile networks: A contract theory approach. In 2019 IEEE VTS Asia Pacific Wireless Communications Symposium (APWCS); IEEE: Piscataway, NJ, USA, 2019; pp. 1–5. [Google Scholar]
- Zhu, P.; Hu, J.; Li, X.; Zhu, Q. Using blockchain technology to enhance the traceability of original achievements. IEEE Trans. Eng. Manag. 2023, 70, 1693–1707. [Google Scholar] [CrossRef]
- Cai, Y.; Ke, W.; Cui, E.; Yu, F. A deep recommendation model of cross-grained sentiments of user reviews and ratings. Inf. Process. Manag. 2022, 59, 102842. [Google Scholar] [CrossRef]
- Du, H.; Wang, J.; Niyato, D.; Kang, J.; Xiong, Z.; Kim, D.I. Ai-generated incentive mechanism and full-duplex semantic communications for information sharing. IEEE J. Sel. Areas Commun. 2023, 41, 2981–2997. [Google Scholar] [CrossRef]
- Park, C.; Lee, J. Mobile edge computing-enabled heterogeneous networks. IEEE Trans. Wirel. Commun. 2020, 20, 1038–1051. [Google Scholar] [CrossRef]
- Wu, H.; Tian, H.; Fan, S.; Ren, J. Data age aware scheduling for wireless powered mobile-edge computing in industrial internet of things. IEEE Trans. Ind. Inform. 2020, 17, 398–408. [Google Scholar] [CrossRef]
- Sun, J.; Jiang, Z.; Krishnamachari, B.; Zhou, S.; Niu, Z. Closed-form whittle’s index-enabled random access for timely status update. IEEE Trans. Commun. 2019, 68, 1538–1551. [Google Scholar] [CrossRef]
- Kuang, Q.; Gong, J.; Chen, X.; Ma, X. Age-of-information for computation-intensive messages in mobile edge computing. In Proceedings of the 2019 11th International Conference on Wireless Communications and Signal Processing (WCSP), Xi’an, China, 23–25 October 2019; IEEE: Piscataway, NJ, USA, 2019; pp. 1–6. [Google Scholar]
- Kuang, Q.; Gong, J.; Chen, X.; Ma, X. Analysis on computation-intensive status update in mobile edge computing. IEEE Trans. Veh. Technol. 2020, 69, 4353–4366. [Google Scholar] [CrossRef]
- Liu, L.; Qin, X.; Zhang, Z.; Zhang, P. Joint task offloading and resource allocation for obtaining fresh status updates in multi-device mec systems. IEEE Access 2020, 8, 38248–38261. [Google Scholar] [CrossRef]
- Muhammad, A.; Sorkhoh, I.; Samir, M.; Ebrahimi, D.; Assi, C. Minimizing age of information in multiaccess-edge-computing-assisted iot networks. IEEE Internet Things J. 2021, 9, 13052–13066. [Google Scholar] [CrossRef]
- Zhu, Z.; Wan, S.; Fan, P.; Letaief, K.B. An edge federated marl approach for timeliness maintenance in mec collaboration. In Proceedings of the 2021 IEEE International Conference on Communications Workshops (ICC Workshops), Montreal, QC, Canada, 14–23 June 2021; IEEE: Piscataway, NJ, USA, 2021; pp. 1–6. [Google Scholar]
- Zhang, G.; Shen, C.; Shi, Q.; Ai, B.; Zhong, Z. Aoi minimization for wsn data collection with periodic updating scheme. IEEE Trans. Wirel. Commun. 2023, 22, 32–46. [Google Scholar] [CrossRef]
- Yuan, X.; Xie, Z.; Tan, X. Computation offloading in uav-enabled edge computing: A stackelberg game approach. Sensors 2022, 22, 3854. [Google Scholar] [CrossRef]
- Chen, X.; Wu, C.; Chen, T.; Liu, Z.; Bennis, M.; Ji, Y. Age of information-aware resource management in uav-assisted mobile-edge computing systems. In Proceedings of the GLOBECOM 2020-2020 IEEE Global Communications Conference, Taipei, Taiwan, 7–11 December 2020; IEEE: Piscataway, NJ, USA, 2020; pp. 1–6. [Google Scholar]
- Qin, Z.; Wei, Z.; Qu, Y.; Zhou, F.; Wang, H.; Ng, D.W.K.; Chae, C.-B. Aoi-aware scheduling for air-ground collaborative mobile edge computing. IEEE Trans. Wirel. Commun. 2023, 22, 2989–3005. [Google Scholar] [CrossRef]
- Zhu, B.; Chi, K.; Liu, J.; Yu, K.; Mumtaz, S. Efficient offloading for minimizing task computation delay of noma-based multiaccess edge computing. IEEE Trans. Commun. 2022, 70, 3186–3203. [Google Scholar] [CrossRef]
- Liu, L.; Qiang, J.; Wang, Y.; Jiang, F. Age of information analysis of noma-mec offloading with dynamic task arrivals. In Proceedings of the 2022 14th International Conference on Wireless Communications and Signal Processing (WCSP), Nanjing, China, 14–17 October 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 181–186. [Google Scholar]
- Yang, Y.; Wang, W.; Xu, R.; Srivastava, G.; Alazab, M.; Gadekallu, T.R.; Su, C. Aoi optimization for uav-aided mec networks under channel access attacks: A game theoretic viewpoint. In Proceedings of the ICC 2022-IEEE International Conference on Communications, Seoul, Republic of Korea, 16–20 May 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 1–6. [Google Scholar]
- Lv, H.; Zheng, Z.; Wu, F.; Chen, G. Strategy-proof online mechanisms for weighted aoi minimization in edge computing. IEEE J. Sel. Areas Commun. 2021, 39, 1277–1292. [Google Scholar] [CrossRef]
- Su, C.; Ye, F.; Liu, T.; Tian, Y.; Han, Z. Computation offloading in hierarchical multi-access edge computing based on contract theory and bayesian matching game. IEEE Trans. Veh. Technol. 2020, 69, 13686–13701. [Google Scholar] [CrossRef]
- Lim, W.Y.B.; Xiong, Z.; Kang, J.; Niyato, D.; Leung, C.; Miao, C.; Shen, X. When information freshness meets service latency in federated learning: A task-aware incentive scheme for smart industries. IEEE Trans. Ind. Inform. 2022, 18, 457–466. [Google Scholar] [CrossRef]
- Li, S.; Hu, X.; Du, Y. Deep reinforcement learning and game theory for computation offloading in dynamic edge computing markets. IEEE Access 2021, 9, 121456–121466. [Google Scholar] [CrossRef]
- Xu, Y.; Xiao, M.; Zhu, Y.; Wu, J.; Zhang, S.; Zhou, J. Aoi-guaranteed incentive mechanism for mobile crowdsensing with freshness concerns. IEEE Trans. Mob. Comput. 2023, 1–17. [Google Scholar] [CrossRef]
- Diao, X.; Zheng, J.; Wu, Y.; Cai, Y.; Anpalagan, A. Joint trajectory design, task data, and computing resource allocations for noma-based and uav-assisted mobile edge computing. IEEE Access 2019, 7, 117448–117459. [Google Scholar] [CrossRef]
- Makki, B.; Chitti, K.; Behravan, A.; Alouini, M.-S. A survey of noma: Current status and open research challenges. IEEE Open J. Commun. Soc. 2020, 1, 179–189. [Google Scholar] [CrossRef]
- Li, C.; Wang, S.; Huang, X.; Li, X.; Yu, R.; Zhao, F. Parked vehicular computing for energy-efficient internet of vehicles: A contract theoretic approach. IEEE Internet Things J. 2018, 6, 6079–6088. [Google Scholar] [CrossRef]
- Sun, Z.; Chen, G. Contract-optimization approach (coa): A new approach for optimizing service caching, computation offloading, and resource allocation in mobile edge computing network. Sensors 2023, 23, 4806. [Google Scholar] [CrossRef] [PubMed]
- Zhou, Z.; Liu, P.; Feng, J.; Zhang, Y.; Mumtaz, S.; Rodriguez, J. Computation resource allocation and task assignment optimization in vehicular fog computing: A contract-matching approach. IEEE Trans. Veh. Technol. 2019, 68, 3113–3125. [Google Scholar] [CrossRef]
- Zhang, K.; Mao, Y.; Leng, S.; Maharjan, S.; Vinel, A.; Zhang, Y. Contract-theoretic approach for delay constrained offloading in vehicular edge computing networks. Mob. Netw. Appl. 2019, 24, 1003–1014. [Google Scholar] [CrossRef]
- Hou, Z.; Chen, H.; Li, Y.; Vucetic, B. Incentive mechanism design for wireless energy harvesting-based internet of things. IEEE Internet Things J. 2017, 5, 2620–2632. [Google Scholar] [CrossRef]
- Xu, Y. Block Coordinate Descent for Regularized Multi-Convex Optimization; Rice University: Houston, TX, USA, 2013. [Google Scholar]
- Gao, L.; Wang, X.; Xu, Y.; Zhang, Q. Spectrum trading in cognitive radio networks: A contract-theoretic modeling approach. IEEE J. Sel. Areas Commun. 2011, 29, 843–855. [Google Scholar] [CrossRef]
- Ho, J.; Jain, A.; Abbeel, P. Denoising diffusion probabilistic models. Adv. Neural Inf. Process. Syst. 2020, 33, 6840–6851. [Google Scholar]
- Hasselt, H. Double q-learning. In Advances in Neural Information Processing Systems 23; Neural Information Processing Systems Foundation, Inc. (NeurIPS): La Jolla, CA, USA, 2010. [Google Scholar]
- Liu, M.; Liu, Y. Price-based distributed offloading for mobile-edge computing with computation capacity constraints. IEEE Wirel. Commun. Lett. 2017, 7, 420–423. [Google Scholar] [CrossRef]
- Wang, S.; Ye, D.; Huang, X.; Yu, R.; Wang, Y.; Zhang, Y. Consortium blockchain for secure resource sharing in vehicular edge computing: A contract-based approach. IEEE Trans. Netw. Sci. Eng. 2020, 8, 1189–1201. [Google Scholar] [CrossRef]
- Xiao, H.; Zhao, J.; Pei, Q.; Feng, J.; Liu, L.; Shi, W. Vehicle selection and resource optimization for federated learning in vehicular edge computing. IEEE Trans. Intell. Transp. Syst. 2021, 23, 11073–11087. [Google Scholar] [CrossRef]
- Feng, J.; Zhang, W.; Pei, Q.; Wu, J.; Lin, X. Heterogeneous computation and resource allocation for wireless powered federated edge learning systems. IEEE Trans. Commun. 2022, 70, 3220–3233. [Google Scholar] [CrossRef]
Ref. | Optimization Perspective | Energy Consumption | Delay | AoI | UAV | Interference | |
---|---|---|---|---|---|---|---|
OFDMA | NOMA | ||||||
[19] | System | 🗸 | 🗸 | ||||
[20] | System | 🗸 | 🗸 | ||||
[25] | System | 🗸 | 🗸 | ||||
[21] | System | 🗸 | |||||
[17,18] | System | 🗸 | 🗸 | ||||
[22] | System | 🗸 | 🗸 | 🗸 | |||
[26] | System | 🗸 | 🗸 | ||||
[27] | System | 🗸 | 🗸 | ||||
[31] | Incentive | 🗸 | 🗸 | ||||
[28,29] | Incentive | 🗸 | 🗸 | 🗸 | |||
[23,24] | Incentive | 🗸 | 🗸 | 🗸 | |||
[32,33] | Incentive | 🗸 |
Symbol | Description |
---|---|
Set of MEC servers | |
Set of MTs | |
Set of UAVs | |
Service rate of the transmission queue | |
Service rate of the MEC computation queue | |
Queue utilization of device in MEC server m | |
(Mcycles) | CPU cycles |
s(MBits) | Data packet size |
MEC server’s computational capacity | |
Channel power gain between MEC server and MT | |
Channel power at the reference distance | |
Location of the MEC server m or UAV | |
Location of MT | |
Transmission power of MT | |
B | Bandwidth |
Power spectral density of Gaussian white noise | |
Transmission rate of task offloading | |
Average AoI of MT | |
Average latency of service | |
Maximum tolerated AoI | |
Trade-off parameter between the saved delay and saved AoI | |
Gain of MT when offloading tasks | |
Cost of SP | |
Satisfaction gained from the saved delay performance | |
Utility of MT | |
Category of MT | |
Probability distribution of category | |
Unit costs paid by SP for offloading computing tasks | |
Computational cost of completing the task | |
Effective switching capacitance | |
State spaces | |
Latent policy space | |
Optimal contract for given state | |
Gaussian noise | |
Loss function |
Networks | Layer | Activation | Units |
---|---|---|---|
Actor | SinusoidalPosEmb FullyConnect FullyConnect Concatenation FullyConnect FullyConnect FullyConnect | - Tanh - - Tanh Tanh Tanh | 16 32 16 - 256 256 12 |
Critic | FullyConnect FullyConnect FullyConnect FullyConnect | Mish Mish Mish - | 256 256 256 1 |
Parameter | Value |
---|---|
Learning rate of the actor network | |
Learning rate of the critic networks | |
Temperature of action entropy regularization | |
Weight of soft update | |
Batch size | 512 |
Weight decay | |
Discount factor to accumulate rewards | |
Diffusion steps for the diffusion model | 5 |
Maximum capacity of the replay buffer | |
Total number of training steps | |
Number of collected transitions per training step | 1000 |
Parameter | Setting |
---|---|
Number of MEC servers | |
Number of UAVs | |
Number of types | |
Effective switched capacitance | |
Number of CPU cycles executing one bit | cycles/bit |
Maximum tolerance time | s |
Bandwidth | Bits |
Computational capability | cycles/bit |
Size of computation task | KB |
Others | , |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Sun, Z.; Chen, G. Enhancing Data Freshness in Air-Ground Collaborative Heterogeneous Networks through Contract Theory and Generative Diffusion-Based Mobile Edge Computing. Sensors 2024, 24, 74. https://doi.org/10.3390/s24010074
Sun Z, Chen G. Enhancing Data Freshness in Air-Ground Collaborative Heterogeneous Networks through Contract Theory and Generative Diffusion-Based Mobile Edge Computing. Sensors. 2024; 24(1):74. https://doi.org/10.3390/s24010074
Chicago/Turabian StyleSun, Zhiyao, and Guifen Chen. 2024. "Enhancing Data Freshness in Air-Ground Collaborative Heterogeneous Networks through Contract Theory and Generative Diffusion-Based Mobile Edge Computing" Sensors 24, no. 1: 74. https://doi.org/10.3390/s24010074