Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3571306.3571358acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicdcnConference Proceedingsconference-collections
extended-abstract

Reinforcement Learning for Real-Time Multi-Access Edge Computing

Published: 04 January 2023 Publication History

Abstract

We examine data-intensive real-time applications, such as forest fire detection, medical emergency services, oil pipeline monitoring, etc., that require relatively low response time in processing data from the Internet of Things (IoT) devices. Typically, in such circumstances, the edge computing paradigm is utilised to drastically reduce the processing delay of such applications. However, with the growing IoT devices, the edge device cluster needs to be configured properly such that the real-time requirements are met. Therefore, the cluster configuration must be dynamically adapted to the changing network topology of the edge cluster in order to minimise the observed overall communication delay incurred by edge devices when processing data from IoT devices. To this end, we propose an intelligent assignment of IoT devices to edge devices based on Reinforcement Learning such that communication delay is minimised and none of the edge devices is overloaded. We demonstrate, with some preliminary results, that our algorithm outperforms the state-of-the-art.

References

[1]
Juan A Dıaz and Elena Fernández. 2001. A tabu search heuristic for the generalized assignment problem. European Journal of Operational Research 132, 1 (2001), 22–38.
[2]
Nina Mazyavkina, Sergey Sviridov, Sergei Ivanov, and Evgeny Burnaev. 2020. Reinforcement Learning for Combinatorial Optimization: A Survey. https://doi.org/10.48550/ARXIV.2003.03600
[3]
Zeeshan Hameed Mir, Deepesh Man Shrestha, Geun-Hee Cho, and Young-Bae Ko. 2006. Mobility-aware distributed topology control for mobile multi-hop wireless networks. In International Conference on Information Networking. Springer, 257–266.
[4]
Dieudonné Nijimbere, Songzheng Zhao, Xunhao Gu, Moses Olabhele Esangbedo, and Nyiribakwe Dominique. 2021. Tabu search guided by reinforcement learning for the max-mean dispersion problem. Journal of Industrial and Management Optimization 17, 6(2021), 3223–3246.
[5]
Tao Ouyang, Zhi Zhou, and Xu Chen. 2018. Follow me at the edge: Mobility-aware dynamic service placement for mobile edge computing. IEEE Journal on Selected Areas in Communications 36, 10(2018), 2333–2345.
[6]
Changyang She, Yifan Duan, Guodong Zhao, Tony Q. S. Quek, Yonghui Li, and Branka Vucetic. 2019. Cross-Layer Design for Mission-Critical IoT in Mobile Edge Computing Systems. IEEE Internet of Things Journal 6, 6 (2019), 9360–9374. https://doi.org/10.1109/JIOT.2019.2930983

Index Terms

  1. Reinforcement Learning for Real-Time Multi-Access Edge Computing

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICDCN '23: Proceedings of the 24th International Conference on Distributed Computing and Networking
    January 2023
    461 pages
    ISBN:9781450397964
    DOI:10.1145/3571306
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 January 2023

    Check for updates

    Author Tags

    1. datasets
    2. gaze detection
    3. neural networks
    4. text tagging

    Qualifiers

    • Extended-abstract
    • Research
    • Refereed limited

    Conference

    ICDCN 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 68
      Total Downloads
    • Downloads (Last 12 months)23
    • Downloads (Last 6 weeks)5
    Reflects downloads up to 01 Nov 2024

    Other Metrics

    Citations

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media