Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3589334.3645595acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Open access

Robust Route Planning under Uncertain Pickup Requests for Last-mile Delivery

Published: 13 May 2024 Publication History

Abstract

Empowered by the widespread adoption of Internet of Things (IoT) devices and smartphones, last-mile delivery services have evolved to accommodate both delivery and pickup tasks. An essential challenge in last-mile delivery is efficiently planning routes for couriers to handle pre-scheduled delivery requests as well as stochastic pickup requests. Existing work approaches this problem by either adjusting routes on the fly when new requests arise or preplanning routes based on predicted future pickup requests. However, these methods either compromise the optimality of planned routes or heavily rely on the accuracy of predictions. In this work, we take conformal prediction as an opportunity to address the issue of prediction uncertainty. We design ROPU, a novel courier route planning framework for logistics systems that incorporates conformal prediction into reinforcement learning. Our work advances the existing work from two aspects: (i) Pickup request prediction utilizes spatial-temporal conformal prediction to capture historical pickup request patterns, providing a unified spatial-temporal conformal interval with high confidence (ii) A spatial-temporal attention network assesses location importance from various perspectives and enables the actor to perceive time and integrate the spatial-temporal conformal interval. We implement and evaluate ROPU on one of the largest logistics platforms. Extensive experiment results demonstrate that our method outperforms other state-of-the-art methods with improvements of at least 30.49% in the pickup overdue rate, 25.00% in the delivery overdue rate, and 5.49% in the traveling distance metric.

Supplemental Material

MP4 File
Supplemental video

References

[1]
Anastasios Angelopoulos, Stephen Bates, Jitendra Malik, and Michael I Jordan. 2020. Uncertainty sets for image classifiers using conformal prediction. arXiv preprint arXiv:2009.14193 (2020).
[2]
Kai Arulkumaran, Marc Peter Deisenroth, Miles Brundage, and Anil Anthony Bharath. 2017. Deep reinforcement learning: A brief survey. IEEE Signal Processing Magazine 34, 6 (2017), 26--38.
[3]
Irwan Bello, Hieu Pham, Quoc V Le, Mohammad Norouzi, and Samy Bengio. 2016. Neural combinatorial optimization with reinforcement learning. arXiv preprint arXiv:1611.09940 (2016).
[4]
Tianqi Chen and Carlos Guestrin. 2016. Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining. 785--794.
[5]
Arthur Delarue, Ross Anderson, and Christian Tjandraatmadja. 2020. Reinforcement learning with combinatorial actions: An application to vehicle routing. Advances in Neural Information Processing Systems 33 (2020), 609--620.
[6]
Yi Ding, Yu Yang, Wenchao Jiang, Yunhuai Liu, Tian He, and Desheng Zhang. 2021. Nationwide deployment and operation of a virtual arrival detection system in the wild. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference. 705--717.
[7]
Gianpaolo Ghiani, Emanuele Manni, Antonella Quaranta, and Chefi Triki. 2009. Anticipatory algorithms for same-day courier dispatching. Transportation Research Part E: Logistics and Transportation Review 45, 1 (2009), 96--106.
[8]
Isaac Gibbs and Emmanuel Candes. 2021. Adaptive conformal inference under distribution shift. Advances in Neural Information Processing Systems 34 (2021), 1660--1672.
[9]
Yulong Gu. 2021. Attentive neural point processes for event forecasting. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 7592--7600.
[10]
Baoshen Guo, Shuai Wang, Yi Ding, Guang Wang, Suining He, Desheng Zhang, and Tian He. 2021. Concurrent order dispatch for instant delivery with timeconstrained actor-critic reinforcement learning. In 2021 IEEE Real-Time Systems Symposium (RTSS). IEEE, 176--187.
[11]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation 9, 8 (1997), 1735--1780.
[12]
Zhiqing Hong, GuangWang,Wenjun Lyu, Baoshen Guo, Yi Ding, HaotianWang, Shuai Wang, Yunhuai Liu, and Desheng Zhang. 2022. CoMiner: nationwide behavior-driven unsupervised spatial coordinate mining from uncertain delivery events. In Proceedings of the 30th International Conference on Advances in Geographic Information Systems. 1--10.
[13]
Waldy Joe and Hoong Chuin Lau. 2020. Deep reinforcement learning approach to solve dynamic vehicle routing problem with stochastic customers. In Proceedings of the international conference on automated planning and scheduling, Vol. 30. 394--402.
[14]
Michael Jünger, Gerhard Reinelt, and Giovanni Rinaldi. 1995. The traveling salesman problem. Handbooks in operations research and management science 7 (1995), 225--330.
[15]
Gitae Kim, Yew-Soon Ong, Chen Kim Heng, Puay Siew Tan, and Nengsheng Allan Zhang. 2015. City vehicle routing problem (city VRP): A review. IEEE Transactions on Intelligent Transportation Systems 16, 4 (2015), 1654--1666.
[16]
Sirui Li, Zhongxia Yan, and Cathy Wu. 2021. Learning to delegate for large-scale vehicle routing. Advances in Neural Information Processing Systems 34 (2021), 26198--26211.
[17]
Xijun Li, Weilin Luo, Mingxuan Yuan, Jun Wang, Jiawen Lu, Jie Wang, Jinhu Lü, and Jia Zeng. 2021. Learning to optimize industry-scale dynamic pickup and delivery problems. In 2021 IEEE 37th International Conference on Data Engineering (ICDE). IEEE, 2511--2522.
[18]
Wenjun Lyu, Haotian Wang, Zhiqing Hong, Guang Wang, Yu Yang, Yunhuai Liu, and Desheng Zhang. 2023. REDE: Exploring Relay Transportation for Efficient Last-mile Delivery. In 2023 IEEE 39th International Conference on Data Engineering (ICDE). IEEE, 3003--3016.
[19]
Wenjun Lyu, Kexin Zhang, Baoshen Guo, Zhiqing Hong, Guang Yang, Guang Wang, Yu Yang, Yunhuai Liu, and Desheng Zhang. 2022. Towards Fair Workload Assessment via Homogeneous Order Grouping in Last-mile Delivery. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management. 3361--3370.
[20]
Fei Miao, Shuo Han, Shan Lin, Qian Wang, John A Stankovic, Abdeltawab Hendawi, Desheng Zhang, Tian He, and George J Pappas. 2017. Data-driven robust taxi dispatch under demand uncertainties. IEEE Transactions on Control Systems Technology 27, 1 (2017), 175--191.
[21]
Mohammadreza Nazari, Afshin Oroojlooy, Lawrence Snyder, and Martin Takác. 2018. Reinforcement learning for solving the vehicle routing problem. Advances in neural information processing systems 31 (2018).
[22]
DanielWOtter, Julian R Medina, and Jugal K Kalita. 2020. A survey of the usages of deep learning for natural language processing. IEEE transactions on neural networks and learning systems 32, 2 (2020), 604--624.
[23]
Ulrike Ritzinger, Jakob Puchinger, and Richard F Hartl. 2016. A survey on dynamic and stochastic vehicle routing problems. International Journal of Production Research 54, 1 (2016), 215--231.
[24]
Yaniv Romano, Evan Patterson, and Emmanuel Candes. 2019. Conformalized quantile regression. Advances in neural information processing systems 32 (2019).
[25]
Yaniv Romano, Matteo Sesia, and Emmanuel Candes. 2020. Classification with valid and adaptive coverage. Advances in Neural Information Processing Systems 33 (2020), 3581--3591.
[26]
Sijie Ruan, Zi Xiong, Cheng Long, Yiheng Chen, Jie Bao, Tianfu He, Ruiyuan Li, Shengnan Wu, Zhongyuan Jiang, and Yu Zheng. 2020. Doing in one go: delivery time inference based on couriers' trajectories. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2813--2821.
[27]
Glenn Shafer and Vladimir Vovk. 2008. A Tutorial on Conformal Prediction. Journal of Machine Learning Research 9, 3 (2008).
[28]
Sanket Shah, Meghna Lowalekar, and Pradeep Varakantham. 2020. Neural approximate dynamic programming for on-demand ride-pooling. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 507--515.
[29]
Yanxing Song, F Richard Yu, Li Zhou, Xi Yang, and Zefang He. 2020. Applications of the Internet of Things (IoT) in smart logistics: A comprehensive survey. IEEE Internet of Things Journal 8, 6 (2020), 4250--4274.
[30]
Kamile Stankeviciute, Ahmed M Alaa, and Mihaela van der Schaar. 2021. Conformal time-series forecasting. Advances in neural information processing systems 34 (2021), 6216--6228.
[31]
Sophia Sun. 2022. Conformal methods for quantifying uncertainty in spatiotemporal data: A survey. arXiv preprint arXiv:2209.03580 (2022).
[32]
Heng Tan, Yukun Yuan, Hua Yan, Shuxin Zhong, and Yu Yang. 2024. Human Preference-aware Rebalancing and Charging for Shared Electric Micromobility Vehicles. In 2024 IEEE International Conference on Robotics and Automation (ICRA). IEEE.
[33]
Heng Tan, Yukun Yuan, Shuxin Zhong, and Yu Yang. 2023. Joint Rebalancing and Charging for Shared Electric Micromobility Vehicles with Energy-informed Demand. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 2392--2401.
[34]
Marlin W Ulmer, Justin C Goodson, Dirk C Mattfeld, and Marco Hennig. 2019. Offline--online approximate dynamic programming for dynamic vehicle routing with stochastic requests. Transportation Science 53, 1 (2019), 185--202.
[35]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, ?ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems 30 (2017).
[36]
Hai Wang, Shuai Wang, Yu Yang, and Desheng Zhang. 2023. GCRL: Efficient Delivery Area Assignment for Last-mile Logistics with Group-based Cooperative Reinforcement Learning. In 2023 IEEE 39th International Conference on Data Engineering (ICDE). IEEE, 3522--3534.
[37]
Michael Wilbur, Salah Uddin Kadir, Youngseo Kim, Geoffrey Pettet, Ayan Mukhopadhyay, Philip Pugliese, Samitha Samaranayake, Aron Laszka, and Abhishek Dubey. 2022. An online approach to solve the dynamic vehicle routing problem with stochastic trip requests for paratransit services. In 2022 ACM/IEEE 13th International Conference on Cyber-Physical Systems (ICCPS). IEEE, 147--158.
[38]
Chen Xu and Yao Xie. 2021. Conformal prediction interval for dynamic timeseries. In International Conference on Machine Learning. PMLR, 11559--11569.
[39]
Huatao Xu, Pengfei Zhou, Rui Tan, Mo Li, and Guobin Shen. 2021. Limu-bert: Unleashing the potential of unlabeled data for imu sensing applications. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 220--233.
[40]
Hua Yan, Yingqiang Ge, Haotian Wang, Desheng Zhang, and Yu Yang. 2023. Logistics Audience Expansion via Temporal Knowledge Graph. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management. 4879--4886.
[41]
Yu Yang, Yi Ding, Dengpan Yuan, Guang Wang, Xiaoyang Xie, Yunhuai Liu, Tian He, and Desheng Zhang. 2020. Transloc: transparent indoor localization with uncertain human participation for instant delivery. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking. 1--14.
[42]
Chak Fai Yuen, Abhishek Pratap Singh, Sagar Goyal, Sayan Ranu, and Amitabha Bagchi. 2019. Beyond shortest paths: Route recommendations for ride-sharing. In The World Wide Web Conference. 2258--2269.
[43]
Margaux Zaffran, Olivier Féron, Yannig Goude, Julie Josse, and Aymeric Dieuleveut. 2022. Adaptive conformal predictions for time series. In International Conference on Machine Learning. PMLR, 25834--25866.
[44]
Desheng Zhang, Juanjuan Zhao, Fan Zhang, Ruobing Jiang, and Tian He. 2015. Feeder: supporting last-mile transit with extreme-scale urban infrastructure data. In Proceedings of the 14th International Conference on Information Processing in Sensor Networks. 226--237.
[45]
Zhiyuan Zhou, Xiaolei Zhou, Yao Lu, Hua Yan, Baoshen Guo, and Shuai Wang. 2021. Multi-Source Data-Driven Route Prediction for Instant Delivery. In 2021 17th International Conference on Mobility, Sensing and Networking (MSN). IEEE, 374--381.
[46]
Zefang Zong, Hansen Wang, Jingwei Wang, Meng Zheng, and Yong Li. 2022. Rbg: Hierarchically solving large-scale routing problems in logistic systems via reinforcement learning. In Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining. 4648--4658.

Cited By

View all
  • (2024)Behavior-aware Sparse Trajectory Recovery in Last-mile Delivery with Multi-scale Attention FusionProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680079(4931-4938)Online publication date: 21-Oct-2024
  • (2024)A Behavior-aware Cause Identification Framework for Order Cancellation in Logistics ServiceProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680051(5119-5126)Online publication date: 21-Oct-2024
  • (2024)Adaptive Cross-platform Transportation Time Prediction for LogisticsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680024(5127-5134)Online publication date: 21-Oct-2024
  • Show More Cited By

Index Terms

  1. Robust Route Planning under Uncertain Pickup Requests for Last-mile Delivery

      Recommendations

      Comments

      Please enable JavaScript to view thecomments powered by Disqus.

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      WWW '24: Proceedings of the ACM Web Conference 2024
      May 2024
      4826 pages
      ISBN:9798400701719
      DOI:10.1145/3589334
      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 13 May 2024

      Check for updates

      Author Tags

      1. conformal prediction
      2. last-mile delivery
      3. route planning

      Qualifiers

      • Research-article

      Funding Sources

      Conference

      WWW '24
      Sponsor:
      WWW '24: The ACM Web Conference 2024
      May 13 - 17, 2024
      Singapore, Singapore

      Acceptance Rates

      Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)305
      • Downloads (Last 6 weeks)89
      Reflects downloads up to 18 Nov 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Behavior-aware Sparse Trajectory Recovery in Last-mile Delivery with Multi-scale Attention FusionProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680079(4931-4938)Online publication date: 21-Oct-2024
      • (2024)A Behavior-aware Cause Identification Framework for Order Cancellation in Logistics ServiceProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680051(5119-5126)Online publication date: 21-Oct-2024
      • (2024)Adaptive Cross-platform Transportation Time Prediction for LogisticsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3680024(5127-5134)Online publication date: 21-Oct-2024
      • (2024)MalLight: Influence-Aware Coordinated Traffic Signal Control for Traffic Signal MalfunctionsProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679605(2879-2889)Online publication date: 21-Oct-2024
      • (2024)Robust Multi-vehicle Routing with Communication Enhanced Multi-agent Reinforcement Learning for Last-Mile LogisticsWeb and Big Data10.1007/978-981-97-7244-5_41(470-480)Online publication date: 28-Aug-2024

      View Options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Login options

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media