Nothing Special   »   [go: up one dir, main page]
Skip to main content
Springer Nature Link
Log in

Perception data fusion-based computation offloading in cooperative vehicle infrastructure systems

  • Published:
The Journal of Supercomputing Aims and scope Submit manuscript

Abstract

With the rapid advancement of intelligent transportation systems, cooperative vehicle infrastructure systems emerge as a vital frontier for development. Real-time mutual fusion of perception data is a crucial technology for ensuring the security of ITS systems. However, the computation-intensive nature of perception data fusion poses a significant challenge in terms of computing resource allocation and scheduling. In this paper, we propose a vehicle-road cooperative network that facilitates computation offloading during the real-time perception data fusion process. We present an architecture that enables users to generate tasks and offload computations, and we formulate an integer nonlinear programming problem within this framework. Considering the dynamic, random, and time-varying characteristics of cooperative vehicle infrastructure systems, we introduced the Deep Deterministic Policy Gradient (DDPG) algorithm for perception fusion computing offloading (DDPG-PFCO). Through extensive experiments conducted on a real map, experimental results show that the proposed algorithm outperforms other comparison algorithms, exhibiting significant improvements in performance.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Algorithm 1
Fig. 5
Algorithm 2
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Data availability

Data in this research paper will be shared upon request.

References

  1. Storck CR, Duarte-Figueiredo F (2020) A survey of 5g technology evolution, standards, and infrastructure associated with vehicle-to-everything communications by internet of vehicles. IEEE Access 8:117593–117614

    Article  Google Scholar 

  2. Li B, Ruizhi W (2023) Joint perception data caching and computation offloading in MEC-enabled vehicular networks. Comput Commun 199:139–152

    Article  Google Scholar 

  3. Dai B, Fanglin X, Cao Y, Yang X (2021) Hybrid sensing data fusion of cooperative perception for autonomous driving with augmented vehicular reality. IEEE Syst J 15(1):1413–1422

    Article  Google Scholar 

  4. Mahbub M, Shubair RM (2023) Contemporary advances in multi-access edge computing: a survey of fundamentals, architecture, technologies, deployment cases, security, challenges, and directions. J Netw Comput Appl 219:103726

    Article  Google Scholar 

  5. Lv P, Wenbiao X, Nie J, Yuan Y, Cai C, Chen Z, Jia X (2023) Edge computing task offloading for environmental perception of autonomous vehicles in 6g networks. IEEE Trans Netw Sci Eng 10(3):1228–1245

    Article  Google Scholar 

  6. Shahian Jahromi B, Tulabandhula T, Cetin S (2019) Real-time hybrid multi-sensor fusion framework for perception in autonomous vehicles. Sensors 19(20):4357

    Article  Google Scholar 

  7. Yu R, Yang D, Zhang H (2021) Edge-assisted collaborative perception in autonomous driving: a reflection on communication design. In: 2021 IEEE/ACM Symposium on Edge Computing (SEC), pp 371–375

  8. Saeik F, Avgeris M, Spatharakis D, Santi N, Dechouniotis D, Violos J, Leivadeas A, Athanasopoulos N, Mitton N, Papavassiliou S (2021) Task offloading in edge and cloud computing: a survey on mathematical, artificial intelligence and control theory solutions. Comput Netw 195:108177

    Article  Google Scholar 

  9. Liu Q, Liang H, Luo R, Liu Q (2022) Energy-efficiency computation offloading strategy in uav aided v2x network with integrated sensing and communication. IEEE Open J Commun Soc 3:1337–1346

    Article  Google Scholar 

  10. Liu D, Sun F, Wang W, Dev K (2023) Distributed computation offloading with low latency for artificial intelligence in vehicular networking. IEEE Commun Standards Mag 7(1):74–80

    Article  Google Scholar 

  11. Xiao Z, Shu J, Jiang H, Min G, Chen H, Han Z (2023) Perception task offloading with collaborative computation for autonomous driving. IEEE J Sel Areas Commun 41(2):457–473

    Article  Google Scholar 

  12. Qi Y, Zhou Y, Liu Y-F, Liu L, Pan Z (2021) Traffic-aware task offloading based on convergence of communication and sensing in vehicular edge computing. IEEE Internet Things J 8(24):17762–17777

    Article  Google Scholar 

  13. Xu D, Anguelov D, Jain A (2018) Pointfusion: Deep sensor fusion for 3d bounding box estimation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 244–253

  14. Huynh Lam, Nguyen Phong, Matas Jiří, Rahtu Esa, Heikkilä Janne (2021) Boosting monocular depth estimation with lightweight 3d point fusion. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp 12767–12776

  15. Liu M, Li D, Wu H, Lyu F, Shen XS (2021) Cooperative edge-cloud caching for real-time sensing big data search in vehicular networks. In: IEEE International Conference on Communications (ICC 2021), IEEE, pp 1–6

  16. Shi S, Cui J, Jiang Z, Yan Z, Xing G, Niu J, Ouyang Z (2022) Vips: real-time perception fusion for infrastructure-assisted autonomous driving. In: Proceedings of the 28th annual international conference on mobile computing and networking. pp 133–146

  17. Liu Z, Cai Y, Wang H, Chen L, Gao H, Jia Y, Li Y (2021) Robust target recognition and tracking of self-driving cars with radar and camera information fusion under severe weather conditions. IEEE Trans Intell Transp Syst 23(7):6640–6653

    Article  Google Scholar 

  18. Yao J, Han T, Ansari N (2019) On mobile edge caching. IEEE Commun Surv Tutor 21(3):2525–2553

    Article  Google Scholar 

  19. Zhu H, Cao Y, Wei X, Wang W, Jiang T, Jin S (2018) Caching transient data for internet of things: a deep reinforcement learning approach. IEEE Internet Things J 6(2):2074–2083

    Article  Google Scholar 

  20. Suto K, Nishiyama H, Kato N (2017) Postdisaster user location maneuvering method for improving the qoe guaranteed service time in energy harvesting small cell networks. IEEE Trans Veh Technol 66(10):9410–9420

    Article  Google Scholar 

  21. Abdel-Aziz MK, Samarakoon S, Perfecto C, Bennis M (2020) Cooperative perception in vehicular networks using multi-agent reinforcement learning. In: 54th Asilomar Conference on Signals, Systems, and Computers, pages 408–412. IEEE

  22. Chen J, Wu H, Lyu F, Yang P, Shen XS (2021) Multi-dimensional resource allocation for diverse safety message transmissions in vehicular networks. In: IEEE International Conference on Communications (ICC 2021), pages 1–6. IEEE

  23. Lv P, Huang J, Liu H (2023) Cooperative environmental perception task offloading for connected and autonomous vehicles. Electronics 12(17):3714

    Article  Google Scholar 

  24. Xiao Z, Shu J, Jiang H, Min G, Chen H, Han Z (2023) Overcoming occlusions: perception task-oriented information sharing in connected and autonomous vehicles. IEEE Network 37:224–229

    Article  Google Scholar 

  25. He Y, Ma L, Jiang Z, Tang Y, Xing G (2021) Vi-eye: semantic-based 3d point cloud registration for infrastructure-assisted autonomous driving. In: Proceedings of the 27th Annual International Conference on Mobile Computing and Networking, pages 573–586

  26. He Y, Ma L, Jiang Z, Tang Y, Xing G (2019) Bridging the edge-cloud barrier for real-time advanced vision analytics. In: USENIX Workshop on Hot Topics in Cloud Computing, USENIX Association

  27. Haklay M, Weber P (2008) Openstreetmap: user-generated street maps. IEEE Pervasive Comput 7(4):12–18

    Article  Google Scholar 

  28. Behrisch M, Bieker L, Erdmann J, Krajzewicz D (2011) Sumo–simulation of urban mobility: an overview. In: The Third International Conference on Advances in System Simulation. ThinkMind

Download references

Funding

This work was supported by the National Natural Science Foundation of China (Grant number 61562092).

Author information

Authors and Affiliations

  1. School of Information Science and Engineering, Yunnan University, Kunming, 650091, Yunnan, China

    Ruizhi Wu & Bo Li

  2. School of Computer Science and Engineering, Fudan University, Shanghai, 200438, China

    Peng Hou

  3. Department of Electrical and Computer Engineering, University of Macau, Macau, 999078, China

    Fen Hou

Authors
  1. Ruizhi Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bo Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Peng Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fen Hou
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RW, PH, and FH were involved in conceptualization, methodology, formal analysis and writing—reviewing and editing. BL was responsible for conceptualization, methodology, funding acquisition, investigation, formal analysis, writing—reviewing and editing, and supervision.

Corresponding author

Correspondence to Bo Li.

Ethics declarations

Conflict of interest

The authors have no Conflict of interest to declare that are relevant to the content of this article.

Ethical approval

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wu, R., Li, B., Hou, P. et al. Perception data fusion-based computation offloading in cooperative vehicle infrastructure systems. J Supercomput 80, 17688–17710 (2024). https://doi.org/10.1007/s11227-024-06145-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11227-024-06145-2

Keywords

Search

Navigation