Spatio-temporal Graph Normalizing Flow for Probabilistic Traffic Prediction
Authors: 
Yang An, Zhibin Li, Wei Liu, Haoliang Sun, Meng Chen, Wenpeng Lu, Yongshun GongAuthors Info & Claims
Pages 45 - 55
Abstract
With the development of the Intelligent Transportation Systems, a great deal of work has been proposed to tackle traffic prediction tasks. Despite their good performance, most traffic prediction models are point estimation models, lacking the capability to estimate the uncertainties of future traffic data, which is crucial in practical traffic decision-making. Aiming at this problem, we combine the probabilistic estimation capabilities of conditional normalizing flows with the spatio-temporal relationship learning of spatio-temporal graphs, leading to a Spatio-Temporal Graph Normalizing Flow (STGNF) model to estimate the distribution of future traffic data. We are the first to employ the conditional normalizing flows as the backbone for probabilistic traffic prediction. Then we design a spatio-temporal graph conditional fusion network to learn the spatio-temporal relationships between future and historical traffic data, which are provided to the conditional normalizing flows as conditional information. Extensive experiments on two real-world traffic datasets demonstrate that our proposed model significantly outperforms the state-of-the-art baselines.
References
[1]
Arjun Ashok, Étienne Marcotte, Valentina Zantedeschi, Nicolas Chapados, and Alexandre Drouin. 2023. Tactis-2: better, faster, simpler attentional copulas for multivariate time series. arXiv preprint arXiv:2310.01327.
[2]
Lei Bai, Lina Yao, Can Li, Xianzhi Wang, and Can Wang. 2020. Adaptive graph convolutional recurrent network for traffic forecasting. Advances in neural information processing systems, 33, 17804--17815.
[3]
Changlu Chen, Yanbin Liu, Ling Chen, and Chengqi Zhang. 2022. Bidirectional spatial-temporal adaptive transformer for urban traffic flow forecasting. IEEE Transactions on Neural Networks and Learning Systems.
[4]
Jie Chen, Tong Liu, and Ruiyuan Li. 2023. Region profile enhanced urban spatio-temporal prediction via adaptive meta-learning. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 224--233.
[5]
Kyunghyun Cho, Bart Van Merriënboer, Caglar Gulcehre, Dzmitry Bahdanau, Fethi Bougares, Holger Schwenk, and Yoshua Bengio. 2014. Learning phrase representations using rnn encoder-decoder for statistical machine translation. arXiv preprint arXiv:1406.1078.
[6]
Enyan Dai and Jie Chen. 2022. Graph-augmented normalizing flows for anomaly detection of multiple time series. arXiv preprint arXiv:2202.07857.
[7]
Laurent Dinh, Jascha Sohl-Dickstein, and Samy Bengio. 2017. Density estimation using real nvp. (2017). arXiv: 1605.08803 [cs.LG].
[8]
Alexandre Drouin, Étienne Marcotte, and Nicolas Chapados. 2022. Tactis: transformer-attentional copulas for time series. In International Conference on Machine Learning. PMLR, 5447--5493.
[9]
Wenying Duan, Xiaoxi He, Zimu Zhou, Lothar Thiele, and Hong Rao. 2023. Localised adaptive spatial-temporal graph neural network. In Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, 448--458.
[10]
Shibo Feng, Chunyan Miao, Ke Xu, Jiaxiang Wu, Pengcheng Wu, Yang Zhang, and Peilin Zhao. 2023. Multi-scale attention flow for probabilistic time series forecasting. IEEE Transactions on Knowledge and Data Engineering.
[11]
Yongshun Gong, Tiantian He, Meng Chen, Bin Wang, Liqiang Nie, and Yilong Yin. 2024. Spatio-temporal enhanced contrastive and contextual learning for weather forecasting. IEEE Transactions on Knowledge and Data Engineering.
[12]
Yongshun Gong, Zhibin Li, Jian Zhang, Wei Liu, and Yu Zheng. 2020. Online spatio-temporal crowd flow distribution prediction for complex metro system. IEEE Transactions on knowledge and data engineering, 34, 2, 865--880.
[13]
Siwei Guan, Zhiwei He, Shenhui Ma, and Mingyu Gao. 2023. Conditional normalizing flow for multivariate time series anomaly detection. ISA transactions, 143, 231--243.
[14]
Kan Guo, Yongli Hu, Zhen Qian, Yanfeng Sun, Junbin Gao, and Baocai Yin. 2020. Dynamic graph convolution network for traffic forecasting based on latent network of laplace matrix estimation. IEEE Transactions on Intelligent Transportation Systems, 23, 2, 1009--1018.
[15]
Shengnan Guo, Youfang Lin, Ning Feng, Chao Song, and Huaiyu Wan. 2019. Attention based spatial-temporal graph convolutional networks for traffic flow forecasting. In Proceedings of the AAAI conference on artificial intelligence number 01. Vol. 33, 922--929.
[16]
Liangzhe Han, Bowen Du, Leilei Sun, Yanjie Fu, Yisheng Lv, and Hui Xiong. 2021. Dynamic and multi-faceted spatio-temporal deep learning for traffic speed forecasting. In Proceedings of the 27th ACM SIGKDD conference on knowledge discovery & data mining, 547--555.
[17]
Sumin Han, Youngjun Park, Minji Lee, Jisun An, and Dongman Lee. 2023. Enhancing spatio-temporal traffic prediction through urban human activity analysis. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 689--698.
[18]
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in neural information processing systems, 33, 6840--6851.
[19]
Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, 9, 8, 1735--1780.
[20]
Jiawei Jiang, Chengkai Han, Wayne Xin Zhao, and Jingyuan Wang. 2023. Pdformer: propagation delay-aware dynamic long-range transformer for traffic flow prediction. In Proceedings of the AAAI conference on artificial intelligence number 4. Vol. 37, 4365--4373.
[21]
Xinke Jiang, Dingyi Zhuang, Xianghui Zhang, Hao Chen, Jiayuan Luo, and Xiaowei Gao. 2023. Uncertainty quantification via spatial-temporal tweedie model for zero-inflated and long-tail travel demand prediction. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 3983--3987.
[22]
Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907.
[23]
Shiyong Lan, Yitong Ma, Weikang Huang, Wenwu Wang, Hongyu Yang, and Pyang Li. 2022. Dstagnn: dynamic spatial-temporal aware graph neural network for traffic flow forecasting. In International conference on machine learning. PMLR, 11906--11917.
[24]
Mengzhang Li and Zhanxing Zhu. 2021. Spatial-temporal fusion graph neural networks for traffic flow forecasting. In Proceedings of the AAAI conference on artificial intelligence number 5. Vol. 35, 4189--4196.
[25]
Xiaoyu Li, Yongshun Gong, Wei Liu, Yilong Yin, Yu Zheng, and Liqiang Nie. 2024. Dual-track spatio-temporal learning for urban flow prediction with adaptive normalization. Artificial Intelligence, 328, 104065.
[26]
Hangchen Liu, Zheng Dong, Renhe Jiang, Jiewen Deng, Jinliang Deng, Quanjun Chen, and Xuan Song. 2023. Spatio-temporal adaptive embedding makes vanilla transformer sota for traffic forecasting. In Proceedings of the 32nd ACM international conference on information and knowledge management, 4125--4129.
[27]
Qian Ma, Zijian Zhang, Xiangyu Zhao, Haoliang Li, Hongwei Zhao, Yiqi Wang, Zitao Liu, and Wanyu Wang. 2023. Rethinking sensors modeling: hierarchical information enhanced traffic forecasting. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 1756--1765.
[28]
James E Matheson and Robert L Winkler. 1976. Scoring rules for continuous probability distributions. Management science, 22, 10, 1087--1096.
[29]
George Papamakarios, Eric Nalisnick, Danilo Jimenez Rezende, Shakir Mohamed, and Balaji Lakshminarayanan. 2021. Normalizing flows for probabilistic modeling and inference. Journal of Machine Learning Research, 22, 57, 1--64.
[30]
George Papamakarios, Theo Pavlakou, and Iain Murray. 2017. Masked autoregressive flow for density estimation. Advances in neural information processing systems, 30.
[31]
Bryan Perozzi, Rami Al-Rfou, and Steven Skiena. 2014. Deepwalk: online learning of social representations. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining, 701--710.
[32]
Hao Qu, Yongshun Gong, Meng Chen, Junbo Zhang, Yu Zheng, and Yilong Yin. 2022. Forecasting fine-grained urban flows via spatio-temporal contrastive self-supervision. IEEE Transactions on Knowledge and Data Engineering.
[33]
Kashif Rasul, Calvin Seward, Ingmar Schuster, and Roland Vollgraf. 2021. Autoregressive denoising diffusion models for multivariate probabilistic time series forecasting. In International Conference on Machine Learning. PMLR, 8857--8868.
[34]
Kashif Rasul, Abdul-Saboor Sheikh, Ingmar Schuster, Urs Bergmann, and Roland Vollgraf. 2021. Multivariate probabilistic time series forecasting via conditioned normalizing flows. (2021). arXiv: 2002.06103 [cs.LG].
[35]
Danilo Rezende and Shakir Mohamed. 2015. Variational inference with normalizing flows. In International conference on machine learning. PMLR, 1530--1538.
[36]
David Salinas, Michael Bohlke-Schneider, Laurent Callot, Roberto Medico, and Jan Gasthaus. 2019. High-dimensional multivariate forecasting with low-rank gaussian copula processes. Advances in neural information processing systems, 32.
[37]
David Salinas, Valentin Flunkert, Jan Gasthaus, and Tim Januschowski. 2020. Deepar: probabilistic forecasting with autoregressive recurrent networks. International journal of forecasting, 36, 3, 1181--1191.
[38]
Abraham Savitzky and Marcel JE Golay. 1964. Smoothing and differentiation of data by simplified least squares procedures. Analytical chemistry, 36, 8, 1627--1639.
[39]
Zezhi Shao, Zhao Zhang, Fei Wang, Wei Wei, and Yongjun Xu. 2022. Spatial-temporal identity: a simple yet effective baseline for multivariate time series forecasting. In Proceedings of the 31st ACM International Conference on Information & Knowledge Management, 4454--4458.
[40]
Chao Song, Youfang Lin, Shengnan Guo, and Huaiyu Wan. 2020. Spatial-temporal synchronous graph convolutional networks: a new framework for spatial-temporal network data forecasting. In Proceedings of the AAAI conference on artificial intelligence number 01. Vol. 34, 914--921.
[41]
Esteban G Tabak and Cristina V Turner. 2013. A family of nonparametric density estimation algorithms. Communications on Pure and Applied Mathematics, 66, 2, 145--164.
[42]
Yusuke Tashiro, Jiaming Song, Yang Song, and Stefano Ermon. 2021. Csdi: conditional score-based diffusion models for probabilistic time series imputation. Advances in Neural Information Processing Systems, 34, 24804--24816.
[43]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. Advances in neural information processing systems, 30.
[44]
Ruifeng Wang, Yuansheng Liu, Yongshun Gong, Wei Liu, Meng Chen, Yilong Yin, and Yu Zheng. 2023. Fine-grained urban flow inference with unobservable data via space-time attraction learning. In 2023 IEEE International Conference on Data Mining (ICDM). IEEE, 1367--1372.
[45]
Haomin Wen, Youfang Lin, Yutong Xia, Huaiyu Wan, Qingsong Wen, Roger Zimmermann, and Yuxuan Liang. 2023. Diffstg: probabilistic spatio-temporal graph forecasting with denoising diffusion models. In Proceedings of the 31st ACM International Conference on Advances in Geographic Information Systems, 1--12.
[46]
Zonghan Wu, Shirui Pan, Guodong Long, Jing Jiang, and Chengqi Zhang. 2019. Graph wavenet for deep spatial-temporal graph modeling. arXiv preprint arXiv:1906.00121.
[47]
Junbo Zhang, Yu Zheng, and Dekang Qi. 2017. Deep spatio-temporal residual networks for citywide crowd flows prediction. In Proceedings of the AAAI conference on artificial intelligence number 1. Vol. 31.
[48]
Junping Zhang, Fei-Yue Wang, Kunfeng Wang, Wei-Hua Lin, Xin Xu, and Cheng Chen. 2011. Data-driven intelligent transportation systems: a survey. IEEE Transactions on Intelligent Transportation Systems, 12, 4, 1624--1639.
[49]
Xu Zhang, Yongshun Gong, Chengqi Zhang, Xiaoming Wu, Ying Guo, Wenpeng Lu, Long Zhao, and Xiangjun Dong. 2023. Spatio-temporal fusion and contrastive learning for urban flow prediction. Knowledge-Based Systems, 282, 111104.
[50]
Xu Zhang, Yongshun Gong, Xinxin Zhang, Xiaoming Wu, Chengqi Zhang, and Xiangjun Dong. 2023. Mask-and contrast-enhanced spatio-temporal learning for urban flow prediction. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 3298--3307.
[51]
Zijian Zhang, Xiangyu Zhao, Qidong Liu, Chunxu Zhang, Qian Ma, Wanyu Wang, Hongwei Zhao, Yiqi Wang, and Zitao Liu. 2023. Promptst: prompt-enhanced spatio-temporal multi-attribute prediction. In Proceedings of the 32nd ACM International Conference on Information and Knowledge Management, 3195--3205.
Index Terms
- Spatio-temporal Graph Normalizing Flow for Probabilistic Traffic Prediction
Recommendations
Spatio-Temporal Correlation Augmented Model for Traffic Flow Prediction in Urban Areas
ICBDT '22: Proceedings of the 5th International Conference on Big Data TechnologiesAs an important component of modern intelligent traffic management systems, traffic forecasting can provide effective technical support for highway traffic control and scheduling. However, existing temporal convolutional networks for traffic flow ...
Citywide Traffic Flow Prediction Based on Multiple Gated Spatio-temporal Convolutional Neural Networks
Traffic flow prediction is crucial for public safety and traffic management, and remains a big challenge because of many complicated factors, e.g., multiple spatio-temporal dependencies, holidays, and weather. Some work leveraged 2D convolutional neural ...
Deep spatio-temporal 3D densenet with multiscale ConvLSTM-Resnet network for citywide traffic flow forecasting
AbstractReliable traffic flow forecasting is paramount in Intelligent Transportation Systems (ITS) as it can effectively improve traffic efficiency and social security. Its vital challenge is to effectively integrate various factors (such as ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
5705 pages
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 21 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Funding Sources
- The Natural Science Foundation of Shandong Province, China
- The Shandong Excellent Young Scientists Fund (Oversea)
- The Taishan Scholar Project of Shandong Province
- The National Natural Science Foundation of China
Conference
CIKM '24
Sponsor:
CIKM '24: The 33rd ACM International Conference on Information and Knowledge Management
October 21 - 25, 2024
ID, Boise, USA
Acceptance Rates
Overall Acceptance Rate 1,861 of 8,427 submissions, 22%
Upcoming Conference
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 145Total Downloads
- Downloads (Last 12 months)145
- Downloads (Last 6 weeks)145
Reflects downloads up to 21 Nov 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in