Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3678717.3691308acmconferencesArticle/Chapter ViewAbstractPublication PagesgisConference Proceedingsconference-collections
research-article
Open access

Harnessing LLMs for Cross-City OD Flow Prediction

Published: 22 November 2024 Publication History

Abstract

Understanding and predicting Origin-Destination (OD) flows is crucial for urban planning and transportation management. Traditional OD prediction models, while effective within single cities, often face limitations when applied across different cities due to varied traffic conditions, urban layouts, and socio-economic factors.
In this paper, by employing Large Language Models (LLMs), we introduce a new method for cross-city OD flow prediction. Our approach leverages the advanced semantic understanding and contextual learning capabilities of LLMs to bridge the gap between cities with different characteristics, providing a robust and adaptable solution for accurate OD flow prediction that can be transferred from one city to another. Our novel framework involves four major components: collecting OD training datasets from a source city, instruction-tuning the LLMs, predicting destination POIs in a target city, and identifying the locations that best match the predicted destination POIs. We introduce a new loss function that integrates POI semantics and trip distance during training. By extracting high-quality semantic features from human mobility and POI data, the model understands spatial and functional relationships within urban spaces and captures interactions between individuals and various POIs. Extensive experimental results demonstrate the superiority of our approach over the state-of-the-art learning-based methods in cross-city OD flow prediction.

References

[1]
Shahriar Afandizadeh Zargari, Amirmasoud Memarnejad, and Hamid Mirzahossein. 2021. Hourly origin-destination matrix estimation using intelligent transportation systems data and deep learning. Sensors 21, 21 (2021), 7080.
[2]
Shai Ben-David, John Blitzer, Koby Crammer, Alex Kulesza, Fernando Pereira, and Jennifer Wortman Vaughan. 2010. A theory of learning from different domains. Machine learning 79 (2010), 151--175.
[3]
Tom Brown, Benjamin Mann, Nick Ryder, Melanie Subbiah, Jared D Kaplan, Prafulla Dhariwal, Arvind Neelakantan, Pranav Shyam, Girish Sastry, Amanda Askell, et al. 2020. Language models are few-shot learners. Advances in neural information processing systems 33 (2020), 1877--1901.
[4]
Mingfei Cai, Yanbo Pang, and Yoshihide Sekimoto. 2022. Spatial Attention Based Grid Representation Learning For Predicting Origin-Destination Flow. In 2022 IEEE International Conference on Big Data (Big Data). IEEE, 485--494.
[5]
Sofia Cerqueira, Elisabete Arsenio, and Rui Henriques. 2022. Inference of dynamic origin-destination matrices with trip and transfer status from individual smart card data. European Transport Research Review 14, 1 (2022), 42.
[6]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In North American Chapter of the Association for Computational Linguistics.
[7]
Guido Gentile and Klaus Nökel. 2016. Modelling public transport passenger flows in the era of intelligent transport systems. Springer Tracts on Transportation and Traffic 10 (2016), 641.
[8]
Guangzeng Han, Weisi Liu, Xiaolei Huang, and Brian Borsari. 2024. Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contexts. 392--401 pages. https://doi.org/10.1109/ICHI61247.2024.00057
[9]
Mingliang Hou, Feng Xia, Haoran Gao, Xin Chen, and Honglong Chen. 2022. Urban Region Profiling With Spatio-Temporal Graph Neural Networks. IEEE Transactions on Computational Social Systems 9, 6 (2022), 1736--1747. https://doi.org/10.1109/TCSS.2022.3183570
[10]
Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021. LoRA: Low-Rank Adaptation of Large Language Models. arXiv:2106.09685 [cs.CL]
[11]
Liping Huang, Yongjian Yang, Xuehua Zhao, Hepeng Gao, Limin Yu, et al. 2018. Mining the Relationship between Spatial Mobility Patterns and POIs. Wireless Communications and Mobile Computing 2018 (2018).
[12]
Md. Ashraful Islam, Mir Mahathir Mohammad, Sarkar Snigdha Sarathi Das, and Mohammed Eunus Ali. 2022. A survey on deep learning based Point-of-Interest (POI) recommendations. Neurocomputing 472 (2022), 306--325. https://doi.org/10.1016/j.neucom.2021.05.114
[13]
Dongjun Kang, Joonsuk Park, Yohan Jo, and JinYeong Bak. 2023. From Values to Opinions: Predicting Human Behaviors and Stances Using Value-Injected Large Language Models. arXiv:2310.17857 [cs.CL]
[14]
Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907 (2016).
[15]
Kevin S. Kung, Kael Greco, Stanislav Sobolevsky, and Carlo Ratti. 2014. Exploring Universal Patterns in Human Home-Work Commuting from Mobile Phone Data. PLOS ONE 9, 6 (06 2014), 1--15. https://doi.org/10.1371/journal.pone.0096180
[16]
Zhixin Lai, Jing Wu, Suiyao Chen, Yucheng Zhou, and Naira Hovakimyan. 2024. Residual-based Language Models are Free Boosters for Biomedical Imaging Tasks. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 5086--5096.
[17]
Minjin Lee and Petter Holme. 2015. Relating land use and human intra-city mobility. PloS one 10, 10 (2015), e0140152.
[18]
Maxime Lenormand, Aleix Bassolas, and José J Ramasco. 2016. Systematic comparison of trip distribution laws and models. Journal of Transport Geography 51 (2016), 158--169.
[19]
Zhicheng Liu, Fabio Miranda, Weiting Xiong, Junyan Yang, Qiao Wang, and Claudio Silva. 2020. Learning geo-contextual embeddings for commuting flow prediction. In Proceedings of the AAAI conference on artificial intelligence, Vol. 34. 808--816.
[20]
Michael Muchisky and Geoffrey Bingham. 2002. Trajectory forms as a source of information about events. Perception & psychophysics 64 (02 2002), 15--31. https://doi.org/10.3758/BF03194554
[21]
Nastaran Pourebrahim, Selima Sultana, Amirreza Niakanlahiji, and Jean-Claude Thill. 2019. Trip distribution modeling with Twitter data. Computers, Environment and Urban Systems 77 (2019), 101354.
[22]
Jiale Qian, Zhang Liu, Yunyan Du, Fuyuan Liang, Jiawei Yi, Ting Ma, and Tao Pei. 2021. Quantify city-level dynamic functions across China using social media and POIs data. Computers, Environment and Urban Systems 85 (2021), 101552.
[23]
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, et al. 2018. Improving language understanding by generative pre-training. (2018).
[24]
Alec Radford, Jeffrey Wu, Rewon Child, David Luan, Dario Amodei, Ilya Sutskever, et al. 2019. Language models are unsupervised multitask learners. OpenAI blog 1, 8 (2019), 9.
[25]
Yihui Ren, Mária Ercsey-Ravasz, Pu Wang, Marta C González, and Zoltán Toroczkai. 2014. Predicting commuter flows in spatial networks using a radiation model based on temporal ranges. Nature communications 5, 1 (2014), 1--9.
[26]
Caleb Robinson and Bistra Dilkina. 2018. A machine learning approach to modeling human migration. In Proceedings of the 1st ACM SIGCAS Conference on Computing and Sustainable Societies. 1--8.
[27]
Can Rong, Jingtao Ding, Zhicheng Liu, and Yong Li. 2023. Complexity-aware large scale origin-destination network generation via diffusion model. arXiv preprint arXiv:2306.04873 (2023).
[28]
Can Rong, Jie Feng, and Jingtao Ding. 2023. GODDAG: generating origin-destination flow for new cities via domain adversarial training. IEEE Transactions on Knowledge and Data Engineering (2023).
[29]
Zeyuan Shang, Guoliang Li, and Zhifeng Bao. 2018. DITA: Distributed In-Memory Trajectory Analytics (SIGMOD '18). Association for Computing Machinery, New York, NY, USA, 725--740. https://doi.org/10.1145/3183713.3183743
[30]
Wenzhe Sun and Jan-Dirk Schmöcker. 2021. Demand estimation for public transport network planning. In The Routledge Handbook of Public Transport. Routledge, 289--305.
[31]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Ł ukasz Kaiser, and Illia Polosukhin. 2017. Attention is All you Need. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc. https://proceedings.neurips.cc/paper_files/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf
[32]
Petar Veličković, Guillem Cucurull, Arantxa Casanova, Adriana Romero, Pietro Lio, and Yoshua Bengio. 2017. Graph attention networks. arXiv preprint arXiv:1710.10903 (2017).
[33]
Jing Wu, Zhixin Lai, Suiyao Chen, Ran Tao, Pan Zhao, and Naira Hovakimyan. 2024. The New Agronomists: Language Models are Experts in Crop Management. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops. 5346--5356.
[34]
Lun Wu, Liu Yang, Zhou Huang, Yaoli Wang, Yanwei Chai, Xia Peng, and Yu Liu. 2019. Inferring demographics from human trajectories and geographical context. Computers, Environment and Urban Systems 77 (2019), 101368. https://doi.org/10.1016/j.compenvurbsys.2019.101368
[35]
Li Yan, Haiying Shen, Juanjuan Zhao, Chengzhong Xu, Feng Luo, and Chenxi Qiu. 2017. CatCharger: Deploying wireless charging lanes in a metropolitan road network through categorization and clustering of vehicle traffic. In IEEE INFOCOM 2017 - IEEE Conference on Computer Communications. 1--9. https://doi.org/10.1109/INFOCOM.2017.8057019
[36]
Dapeng Zhang and Feng Xiao. 2023. Dynamic Auto-Structuring Graph Neural Network: A Joint Learning Framework for Origin-Destination Demand Prediction. IEEE Transactions on Knowledge and Data Engineering 35, 4 (2023), 3699--3711. https://doi.org/10.1109/TKDE.2021.3135898
[37]
Dapeng Zhang and Feng Xiao. 2023. Dynamic Auto-Structuring Graph Neural Network: A Joint Learning Framework for Origin-Destination Demand Prediction. IEEE Transactions on Knowledge and Data Engineering 35, 4 (2023), 3699--3711.

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGSPATIAL '24: Proceedings of the 32nd ACM International Conference on Advances in Geographic Information Systems
October 2024
743 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 November 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Cross-City Transferability
  2. Large Language Models(LLMs)
  3. Urban Computing
  4. origin-destination

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

Conference

SIGSPATIAL '24
Sponsor:

Acceptance Rates

SIGSPATIAL '24 Paper Acceptance Rate 37 of 122 submissions, 30%;
Overall Acceptance Rate 257 of 1,238 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 15
    Total Downloads
  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)15
Reflects downloads up to 29 Nov 2024

Other Metrics

Citations

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media