Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

A learning-based data and task placement mechanism for IoT applications in fog computing: a context-aware approach

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

In recent years, with the technological advancement and rapid growth in the Internet of Things (IoT), many physical devices and real-time applications have generated an enormous amount of data. Fog computing, as a decentralized computing infrastructure, facilitates the distribution of compute and storage resources nearer to IoT devices, where data is generated and processed. Despite the emergence of efficient fog computing models to address challenges like communication delays, network congestion, and energy consumption, the fog-cloud architecture is still in its early stages. Due to computationally intensive tasks and the huge amount of generated data on IoT infrastructure, task placement strategy has been considered an essential solution to low-memory IoT infrastructure and IoT-sensitive applications. This research proposes a novel context-aware framework for data and task placement within fog computing. The proposed framework is focused on separating data from tasks and employing context-based scheduling to enhance performance and efficiency. To address the limitations of static data placement, a high-performance reinforcement learning algorithm, federated learning, is utilized to dynamically determine the number of data replicas. Furthermore, an autonomous framework is designed to demonstrate the replica transferring between devices and fog nodes. Through extensive simulations, the proposed dynamic data replica framework has been shown cost-effectiveness and superiority by reducing total latency, average runtime, and enhancing system availability and reliability.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Algorithm 1
Algorithm 2
Algorithm 3
Fig. 4
Fig. 5
Algorithm 4
Algorithm 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability statements

Data sharing does not apply to this article as no datasets were generated or analyzed during the current study. The proposed framework has been uploaded to Git: https://github.com/EsmaelTorabi/fog_simulator_Placement . https://github.com/EsmaelTorabi/fog_simulator_web

References

  1. Moustafa N (2021) A systemic IoT–Fog–cloud architecture for big-data analytics and cyber security systems: a review of fog computing. Secure Edge Comput, pp 41–50

  2. Samann FEF, Zeebaree SR, Askar S (2021) IoT provisioning QoS based on cloud and fog computing. J Appl Sci Technol Trends 2(01):29–40

    Article  Google Scholar 

  3. Shakarami A, Ghobaei-Arani M, Shahidinejad A et al (2021) Data replication schemes in cloud computing: a survey. Cluster Comput 24:2545–2579. https://doi.org/10.1007/s10586-021-03283-7

    Article  Google Scholar 

  4. Huang S, Niu B, Wang H, Xu N, Zhao X (2024) Prescribed Performance-Based Low- Complexity Adaptive 2-Bit-Triggered Control for Unknown Nonlinear Systems With Actuator Dead-Zone. IEEE Trans Circuits and Syst—II: Express Briefs 71(2):762–766

    Article  Google Scholar 

  5. Torabi E, Ghobaei-Arani M, Shahidinejad A (2022) Data replica placement approaches in fog computing: a review. Cluster Comput 25:3561–3589. https://doi.org/10.1007/s10586-022-03575-6

    Article  Google Scholar 

  6. Ghorbian M, Ghobaei-Arani M, Esmaeili L (2024) A survey on the scheduling mechanisms in serverless computing: a taxonomy, challenges, and trends. Cluster Comput. https://doi.org/10.1007/s10586-023-04264-8

    Article  Google Scholar 

  7. Etemadi M, Ghobaei-Arani M, Shahidinejad A (2021) A cost-efficient auto-scaling mechanism for IoT applications in fog computing environment: a deep learning-based approach. Cluster Comput 24:3277–3292. https://doi.org/10.1007/s10586-021-03307-2

    Article  Google Scholar 

  8. Wang R, Zhang Q, Zhang Y, Shi H, Nguyen KT, Zhou X (2019) Unconventional Split Aptamers Cleaved at Functionally Essential Sites Preserve Biorecognition Capability. Anal Chem 91(24):15811–15817

    Article  Google Scholar 

  9. Ghimire B, Rawat DB (2022) Recent advances on federated learning for cybersecurity and cybersecurity for federated learning for internet of things. IEEE Internet Things J

  10. Zhang C, Liu D, Zhang X, Spencer C, Kong X (2020) Hafnium isotopic disequilibrium during sediment melting and assimilation. Geochem Perspect 12:34–39

    Article  Google Scholar 

  11. Xu N, Liu X, Li Y, Zong G, Zhao X (2024) Dynamic event-triggered control for a class of uncertain strict-feedback systems via an improved adaptive neural networks backstepping approach. IEEE Trans Autom Sci Eng. https://doi.org/10.1109/TASE.2024.3374522

    Article  Google Scholar 

  12. Khan LU, Saad W, Han Z, Hossain E, Hong CS (v) Federated learning for internet of things: Recent advances, taxonomy, and open challenges. IEEE Commun Surv Tutorials

  13. Zhang H, Zou Q, Ju Y, Song C, Chen D (2022) Distance-based Support Vector Machine to Predict DNA N6-methyladine Modification. Curr Bioinf 17(5):473–482

    Article  Google Scholar 

  14. Binwal DC, Kapoor M (2022) A survey on architecture, applications, and challenges in vehicular fog computing. Int J Sens Wireless Commun Control 12(3):194–211

    Article  Google Scholar 

  15. Ebrahimi A, Ghobaei-Arani M, Saboohi H (2024) Cold Start Latency Mitigation Mechanisms in Serverless Computing: Taxonomy, Review, and Future Directions. J Syst Archit 103115

  16. Breitbach M, Schäfer D, Edinger J, Becker C (2019) Context-aware data and task placement in edge computing environments. In: 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom): IEEE, pp 1–10

  17. Sarwar K, Yongchareon S, Yu J, ur Rehman S (2022) Efficient privacy-preserving data replication in fog-enabled IoT. Future Generation Comput Syst 128:538–551

  18. Pfandzelter T, Bermbach D (2021) Towards predictive replica placement for distributed data stores in fog environments. In: 2021 IEEE International Conference on Cloud Engineering (IC2E), IEEE, pp 280–281

  19. Bellmann M, Pfandzelter T, Bermbach D (2021) Predictive replica placement for mobile users in distributed fog data stores with client-side markov models. In: Proceedings of the 14th IEEE/ACM International Conference on Utility and Cloud Computing Companion, pp 1–8

  20. Taghizadeh J, Ghobaei-Arani M, Shahidinejad A (2021) An efficient data replica placement mechanism using biogeography-based optimization technique in the fog computing environment. J Ambient Intell Human Comput, pp 1–21

  21. Dang-Quang N-M, Yoo M (2022) An efficient multivariate autoscaling framework using Bi-LSTM for cloud computing. Appl Sci 12(7):3523

    Article  Google Scholar 

  22. Ben Salah N, Bellamine Ben Saoud N (2021) An IoT-oriented multiple data replicas placement strategy in hybrid fog-cloud environment. In: Proceedings of the 2021 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation, pp 119–128

  23. Salah NB, Saoud NBB () IoT data placement in the fog infrastructure with mobile devices. In: 2021 IEEE/ACM 21st International Symposium on Cluster, Cloud and Internet Computing (CCGrid), 2021: IEEE, pp 21–30

  24. Tseng F-H, Tsai M-S, Tseng C-W, Yang Y-T, Liu C-C, Chou L-D (2018) A lightweight autoscaling mechanism for fog computing in industrial applications. IEEE Trans Industr Inf 14(10):4529–4537

    Article  Google Scholar 

  25. Guerrero C, Lera I, Juiz C (2020) Optimization policy for file replica placement in fog domains. Concurrency Comput Pract Exp 32(21):e5343

    Article  Google Scholar 

  26. Ma X, Wang S, Zhang S, Yang P, Lin C, Shen X (2019) Cost-efficient resource provisioning for dynamic requests in cloud assisted mobile edge computing. IEEE Trans Cloud Comput 9(3):968–980

    Article  Google Scholar 

  27. Yao J, Ansari N (2018) QoS-aware fog resource provisioning and mobile device power control in IoT networks. IEEE Trans Netw Serv Manage 16(1):167–175

    Article  Google Scholar 

  28. Peng L, Dhaini AR, Ho P-H (2018) Toward integrated Cloud-Fog networks for efficient IoT provisioning: key challenges and solutions. Futur Gener Comput Syst 88:606–613

    Article  Google Scholar 

  29. Wang N, Varghese B, Matthaiou M, Nikolopoulos DS (2017) ENORM: A framework for edge node resource management. IEEE Trans Serv Comput 13(6):1086–1099

    Google Scholar 

  30. Salimian M, Ghobaei-Arani M, Shahidinejad A (2022) Toward an autonomic approach for Internet of Things service placement using gray wolf optimization in the fog computing environment. Softw Pract Experience 51(8):1745–1772. https://doi.org/10.1002/spe.2986

    Article  Google Scholar 

  31. Khosroabadi F, Fotouhi-Ghazvini F, Fotouhi H (2021) SCATTER: service placement in real-time fog-assisted IoT networks. J Sens Actuator Netw 10(2):26

    Article  Google Scholar 

  32. Natesha B, Guddeti RMR (2021) Adopting elitism-based Genetic Algorithm for minimizing multi-objective problems of IoT service placement in fog computing environment. J Netw Comput Appl 178:102972

    Article  Google Scholar 

  33. Naas MI, Lemarchand L, Raipin P, Boukhobza J (2021) IoT data replication and consistency management in fog computing. J Grid Comput 19(3):1–25

    Article  Google Scholar 

  34. Shao Z-L, Huang C, Li H (2021) Replica selection and placement techniques on the IoT and edge computing: a deep study. Wireless Netw 27(7):5039–5055

    Article  Google Scholar 

  35. Epifâneo L, Correia C, Rodrigues L (2021)Cathode: a consistency-aware data placement algorithm for the edge. In 2021 IEEE 20th International Symposium on Network Computing and Applications (NCA), IEEE, pp 1–10

  36. Chen Y, Deng S, Ma H, Yin J (2020) Deploying data-intensive applications with multiple services components on edge. Mobile Netw Appl 25(2):426–441

    Article  Google Scholar 

  37. Mahmud R, Pallewatta S, Goudarzi M, Buyya R (2022) iFogSim2: An extended iFogSim simulator for mobility, clustering, and microservice management in edge and fog computing environments. J Syst Softw 190:111351

    Article  Google Scholar 

  38. La QD, Ngo MV, Dinh TQ, Quek TQ, Shin H (2019) Enabling intelligence in fog computing to achieve energy and latency reduction. Digital Commun Netw 5(1):3–9

    Article  Google Scholar 

  39. Rathi S, Nagpal R, Mehrotra D, Srivastava G (2022) A metric focused performance assessment of fog computing environments: a critical review. Comput Electr Eng 103:108350

    Article  Google Scholar 

  40. Cao C, Wang J, Kwok D, Zhang Z, Cui F, Zhao D, Li MJ, Zou Q (2022) webTWAS: a resource for disease candidate susceptibility genes identified by transcriptome-wide association study. Nucleic Acids Res 50(D1):D1123–D1130

    Article  Google Scholar 

  41. Liu Y, Dong Y, Wang H, Jiang H, Xu Q (2022) Distributed fog computing and federated learning enabled secure aggregation for IoT devices. IEEE Internet Things J

  42. Li Q et al., (2021) A survey on federated learning systems: vision, hype and reality for data privacy and protection. IEEE Trans Knowl Data Eng

Download references

Funding

This research received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Qom Branch, Islamic Azad University, Qom, Iran

    Esmaeil Torabi, Mostafa Ghobaei-Arani & Ali Shahidinejad

  2. School of Information Technology, University, VIC 3220, Geelong, Australia

    Ali Shahidinejad

Authors
  1. Esmaeil Torabi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mostafa Ghobaei-Arani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ali Shahidinejad
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

ET, AS, and MGA conducted this research. ET: Methodology, Software, Validation, Writing original draft. AS: Conceptualization, Supervision, Writing review and editing, Formal analysis, Project administration. MGA: Investigation, Resources, Data curation, Visualization.

Corresponding author

Correspondence to Mostafa Ghobaei-Arani.

Ethics declarations

Conflict of interest

We certify that there is no actual or potential conflict of interest about this article.

Ethical approval

All procedures performed in studies involving human participants were by the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards. This article does not contain any studies with human participants or animals performed by any of the authors

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Torabi, E., Ghobaei-Arani, M. & Shahidinejad, A. A learning-based data and task placement mechanism for IoT applications in fog computing: a context-aware approach. J Supercomput 80, 21726–21763 (2024). https://doi.org/10.1007/s11227-024-06278-4

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-024-06278-4

Keywords

Search

Navigation