research-article

A nationwide study on cellular reliability: measurement, analysis, and enhancements

Authors:

Tianyin XuAuthors Info & Claims

SIGCOMM '21: Proceedings of the 2021 ACM SIGCOMM 2021 Conference

Pages 597 - 609

https://doi.org/10.1145/3452296.3472908

Published: 09 August 2021 Publication History

Abstract

With recent advances on cellular technologies (such as 5G) that push the boundary of cellular performance, cellular reliability has become a key concern of cellular technology adoption and deployment. However, this fundamental concern has never been addressed due to the challenges of measuring cellular reliability on mobile devices and the cost of conducting large-scale measurements. This paper closes the knowledge gap by presenting the first large-scale, in-depth study on cellular reliability with more than 70 million Android phones across 34 different hardware models. Our study identifies the critical factors that affect cellular reliability and clears up misleading intuitions indicated by common wisdom. In particular, our study pinpoints that software reliability defects are among the main root causes of cellular data connection failures. Our work provides actionable insights for improving cellular reliability at scale. More importantly, we have built on our insights to develop enhancements that effectively address cellular reliability issues with remarkable real-world impact---our optimizations on Android's cellular implementations have effectively reduced 40% cellular connection failures for 5G phones and 36% failure duration across all phones.

Supplementary Material

qiu-public-review (207-public-review.pdf)

A Nationwide Study on Cellular Reliability: Measurement, Analysis, and Enhancements: Public Review

Download
70.80 KB

MP4 File (video-presentation.mp4)

Conference Presentation Video

Download
203.62 MB

MP4 File (video-long.mp4)

Long Version Video

Download
523.10 MB

References

[1]

Android.org. 2021a. Android 10 Highlights. https://developer.android.com/about/versions/10/highlights.

[2]

Android.org. 2021b. Data Connection Management in Android. https://android.googlesource.com/platform/frameworks/opt/telephony/+/master/src/java/com/android/internal/telephony/dataconnection/DataConnection.java.

[3]

Android.org. 2021c. Data Fail Cause in Android. https://android.googlesource.com/platform/frameworks/base/+/master/telephony/java/android/telephony/DataFailCause.java.

[4]

Android.org. 2021d. Data Setup Error in Android. https://android.googlesource.com/platform/frameworks/opt/telephony/+/refs/heads/master/src/java/com/android/internal/telephony/dataconnection/DcTracker.java.

[5]

Android.org. 2021e. Data Stall Report in Android. https://developer.android.com/reference/android/net/ConnectivityDiagnosticsManager.DataStallReport.

[6]

Android.org. 2021f. Enhance Your Apps with 5G. https://developer.android.com/training/connectivity/5g/enhance-with-5g.

[7]

Android.org. 2021g. SMS Manager in Android. https://developer.android.com/reference/android/telephony/SmsManager.

[8]

Android.org. 2021h. State Out of Service in Android. https://developer.android.com/reference/android/telephony/ServiceState.

[9]

Pavan K Athivarapu, Ranjita Bhagwan, Saikat Guha, Vishnu Navda, Ramachandran Ramjee, Dushyant Arora, Venkat N Padmanabhan, and George Varghese. 2012. Radiojockey: Mining Program Execution to Optimize Cellular Radio Usage. In Proc. of ACM MobiCom. 101--112.

Digital Library

[10]

Niranjan Balasubramanian, Aruna Balasubramanian, and Arun Venkataramani. 2009. Energy Consumption in Mobile Phones: A Measurement Study and Implications for Network Applications. In Proc. of ACM SIGCOMM. 280--293.

Digital Library

[11]

Lorela Cano, Antonio Capone, Giuliana Carello, Matteo Cesana, and Mauro Passacantando. 2017. On Optimal Infrastructure Sharing Strategies in Mobile Radio Networks. IEEE Transactions on Wireless Communications 16, 5 (2017), 3003--3016.

Digital Library

[12]

Haotian Deng, Chunyi Peng, Ans Fida, Jiayi Meng, and Y Charlie Hu. 2018a. Mobility Support in Cellular Networks: A Measurement Study on Its Configurations and Implications. In Proc. of ACM IMC. 147--160.

Digital Library

[13]

Haotian Deng, Weicheng Wang, and Chunyi Peng. 2018b. Ceive: Combating Caller ID Spoofing on 4G Mobile Phones via Callee-only Inference and Verification. In Proc. of ACM MobiCom. 369--384.

Digital Library

[14]

Clare Duffy. 2020. The big differences between 4G and 5G. https://www.cnn.com/2020/01/17/tech/5g-technical-explainer/index.html.

[15]

Aaron Gember, Aditya Akella, Jeffrey Pang, Alexander Varshavsky, and Ramon Caceres. 2012. Obtaining In-context Measurements of Cellular Network Performance. In Proc. of ACM IMC. 287--300.

Digital Library

[16]

Jann Horn. 2021. Mitigations Are Attack Surface, Too. https://googleprojectzero.blogspot.com/2020/02/mitigations-are-attack-surface-too.html.

[17]

Zhenxian Hu, Yi-Chao Chen, Lili Qiu, Guangtao Xue, Hongzi Zhu, Nicholas Zhang, Cheng He, Lujia Pan, and Caifeng He. 2015. An In-depth Analysis of 3G Traffic and Performance. In Proc. of ACM SIGCOMM Workshop (AllThingsCellular). 1--6.

Digital Library

[18]

Junxian Huang, Feng Qian, Alexandre Gerber, Z Morley Mao, Subhabrata Sen, and Oliver Spatscheck. 2012. A Close Examination of Performance and Power Characteristics of 4G LTE Networks. In Proc. of ACM MobiSys. 225--238.

Digital Library

[19]

Junxian Huang, Feng Qian, Yihua Guo, Yuanyuan Zhou, Qiang Xu, Z Morley Mao, Subhabrata Sen, and Oliver Spatscheck. 2013. An In-depth Study of LTE: Effect of Network Protocol and Application Behavior on Performance. ACM SIGCOMM Computer Communication Review 43, 4 (2013), 363--374.

Digital Library

[20]

Jie Hui and Kevin Lau. 2013. T-Mobile QoE Lab: Making Mobile Browsing Faster and Open Research Problems. In Proc. of ACM MobiCom. 239--242.

Digital Library

[21]

Keon Jang, Mongnam Han, Soohyun Cho, Hyung-Keun Ryu, Jaehwa Lee, Yeongseok Lee, and Sue B Moon. 2009. 3G and 3.5 G Wireless Network Performance Measured from Moving Cars and High-Speed Trains. In Proc. of ACM MICNET. 19--24.

[22]

Anant Kumar, Jon Postel, Cliff Neuman, Peter Danzig, and Steve Miller. 1993. Common DNS Implementation Errors and Suggested Fixes. Technical Report. Oct. 1993, RFC 1536.

[23]

Swarun Kumar, Ezzeldin Hamed, Dina Katabi, and Li Erran Li. 2014. LTE Radio Analytics Made Easy and Accessible. ACM SIGCOMM Computer Communication Review 44, 4 (2014), 211--222.

Digital Library

[24]

Zeqi Lai, Y Charlie Hu, Yong Cui, Linhui Sun, Ningwei Dai, and Hung-Sheng Lee. 2019. Furion: Engineering High-quality Immersive Virtual Reality on Today's Mobile Devices. IEEE Transactions on Mobile Computing (2019).

[25]

Chi-Yu Li, Guan-Hua Tu, Chunyi Peng, Zengwen Yuan, Yuanjie Li, Songwu Lu, and Xinbing Wang. 2015a. Insecurity of Voice Solution VoLTE in LTE Mobile Networks. In Proc. of ACM SIGSAC. 316--327.

Digital Library

[26]

Li Li, Ke Xu, Tong Li, Kai Zheng, Chunyi Peng, Dan Wang, Xiangxiang Wang, Meng Shen, and Rashid Mijumbi. 2018. A Measurement Study on Multi-Path TCP with Multiple Cellular Carriers on High Speed Rails. In Proc. of ACM SIGCOMM. 161--175.

Digital Library

[27]

Li Li, Ke Xu, Dan Wang, Chunyi Peng, Qingyang Xiao, and Rashid Mijumbi. 2015b. A Measurement Study on TCP Behaviors in HSPA+ Networks on High-Speed Rails. In Proc. of IEEE INFOCOM. 2731--2739.

[28]

Yuanjie Li, Haotian Deng, Jiayao Li, Chunyi Peng, and Songwu Lu. 2016a. Instability in Distributed Mobility Management: Revisiting Configuration Management in 3G/4G Mobile Networks. In Proc. of ACM SIGMETRICS. 261--272.

Digital Library

[29]

Yuanjie Li, Qianru Li, Zhehui Zhang, Ghufran Baig, Lili Qiu, and Songwu Lu. 2020a. Beyond 5G: Reliable Extreme Mobility Management. In Proc. of ACM SIGCOMM. 344--358.

Digital Library

[30]

Yuanjie Li, Chunyi Peng, Zengwen Yuan, Jiayao Li, Haotian Deng, and Tao Wang. 2016b. Mobileinsight: Extracting and Analyzing Cellular Network Information on Smartphones. In Proc. of ACM MobiCom. 202--215.

Digital Library

[31]

Yuanjie Li, Jiaqi Xu, Chunyi Peng, and Songwu Lu. 2016d. A First Look at Unstable Mobility Management in Cellular Networks. In Proc. of ACM HotMobile. 15--20.

Digital Library

[32]

Yang Li, Jianwei Zheng, Zhenhua Li, Yunhao Liu, Feng Qian, Sen Bai, Yao Liu, and Xianlong Xin. 2020b. Understanding the Ecosystem and Addressing the Fundamental Concerns of Commercial MVNO. IEEE/ACM Transactions on Networking 28, 3 (2020), 1364--1377.

Digital Library

[33]

Zhenhua Li, Weiwei Wang, Christo Wilson, Jian Chen, Chen Qian, Taeho Jung, Lan Zhang, Kebin Liu, Xiangyang Li, and Yunhao Liu. 2017. FBS-Radar: Uncovering Fake Base Stations at Scale in the Wild. In Proc. of ISOC NDSS. 1--15.

[34]

Zhenhua Li, Weiwei Wang, Tianyin Xu, Xin Zhong, Xiang-Yang Li, Yunhao Liu, Christo Wilson, and Ben Y Zhao. 2016c. Exploring Cross-Application Cellular Traffic Optimization with Baidu TrafficGuard. In Proc. of USENIX NSDI. 61--76.

[35]

Yeon-sup Lim, Erich M Nahum, Don Towsley, and Richard J Gibbens. 2017. ECF: An MPTCP Path Scheduler to Manage Heterogeneous Paths. In Proc. of ACM CoNEXT. 147--159.

[36]

Craig J. Mathias. 2008. Opinion: How not to Build more Reliable Cellular Networks. https://www.computerworld.com/article/2537774/opinion--how-not-to-build-more-reliable-cellular-networks.html.

[37]

Ruben Merz, Daniel Wenger, Damiano Scanferla, and Stefan Mauron. 2014. Performance of LTE in A High-Velocity Environment: A Measurement Study. In Proc. of ACM SIGCOMM Workshop (AllThingsCellular). 47--52.

Digital Library

[38]

Martin Klaus Müller, Martin Taranetz, and Markus Rupp. 2015. Providing Current and Future Cellular Services to High Speed Trains. IEEE Communications Magazine 53, 10 (2015), 96--101.

Digital Library

[39]

Arvind Narayanan, Eman Ramadan, Jason Carpenter, Qingxu Liu, Yu Liu, Feng Qian, and Zhi-Li Zhang. 2020. A First Look at Commercial 5G Performance on Smartphones. In Proc. of WWW. 894--905.

Digital Library

[40]

Ashkan Nikravesh, Yihua Guo, Feng Qian, Z Morley Mao, and Subhabrata Sen. 2016. An In-depth Understanding of Multipath TCP on Mobile Devices: Measurement and System Design. In Proc. of ACM MobiCom. 189--201.

Digital Library

[41]

Ashkan Nikravesh, Hongyi Yao, Shichang Xu, David Choffnes, and Z Morley Mao. 2015. Mobilyzer: An Open Platform for Controllable Mobile Network Measurements. In Proc. of ACM MobiSys. 389--404.

Digital Library

[42]

Ralph HJM Otten and Lukas PPP van Ginneken. 2012. The Annealing Algorithm. Vol. 72. Springer Science & Business Media.

[43]

Chunyi Peng and Yuanjie Li. 2016. Demystify Undesired Handoff in Cellular Networks. In Proc. of IEEE ICCCN. 1--9.

[44]

M Zubair Shafiq, Lusheng Ji, Alex X Liu, Jeffrey Pang, and Jia Wang. 2013. Large-scale Measurement and Characterization of Cellular Machine-to-Machine Traffic. IEEE/ACM Transactions on Networking 21, 6 (2013), 1960--1973.

Digital Library

[45]

Jie Sheng, Ziwen Tang, Cheng Wu, Bo Ai, and Yiming Wang. 2020. Game Theory-Based Multi-Objective Optimization Interference Alignment Algorithm for HSR 5G Heterogeneous Ultra-Dense Network. IEEE Transactions on Vehicular Technology 69, 11 (2020), 13371--13382.

[46]

Pyda Srisuresh, Bryan Ford, Senthil Sivakumar, Saikat Guha, et al. 2009. NAT Behavioral Requirements for ICMP. Technical Report. Apr. 2009, RFC 5508.

[47]

3GPP TS 37.340 v15.0.0. 2018. 3rd Generation Partnership Project; NR; Technical Specification Group Radio Access Network; Multi-connectivity; Overall description; Stage-2 (Release 15). Vol. 15. 3GPP.

[48]

Jing Wang, Yufan Zheng, Yunzhe Ni, Chenren Xu, Feng Qian, Wangyang Li, Wantong Jiang, Yihua Cheng, Zhuo Cheng, Yuanjie Li, et al. 2019. An Active-Passive Measurement Study of TCP Performance over LTE on High-Speed Rails. In Proc. of ACM MobiCom. 1--16.

Digital Library

[49]

Gerhard Winkler. 2012. Image Analysis, Random Fields and Markov Chain Monte Carlo Methods: A Mathematical Introduction. Vol. 27. Springer Science & Business Media.

[50]

Keith Winstein, Anirudh Sivaraman, and Hari Balakrishnan. 2013. Stochastic Forecasts Achieve High Throughput and Low Delay over Cellular Networks. In Proc. of USENIX NSDI. 459--471.

[51]

Ao Xiao, Yunhao Liu, Yang Li, Feng Qian, Zhenhua Li, Sen Bai, Yao Liu, Tianyin Xu, and Xianlong Xin. 2019. An In-depth Study of Commercial MVNO: Measurement and Optimization. In Proc. of ACM MobiSys. 457--468.

Digital Library

[52]

Xiufeng Xie and Xinyu Zhang. 2017. Poi360: Panoramic Mobile Video Telephony over LTE Cellular Networks. In Proc. of ACM CoNEXT. 336--349.

Digital Library

[53]

Xiufeng Xie, Xinyu Zhang, Swarun Kumar, and Li Erran Li. 2015. piStream: Physical Layer Informed Adaptive Video Streaming over LTE. In Proc. of ACM MobiCom. 413--425.

Digital Library

[54]

Xiufeng Xie, Xinyu Zhang, and Shilin Zhu. 2017. Accelerating Mobile Web Loading Using Cellular Link Information. In Proc. of ACM MobiSys. 427--439.

Digital Library

[55]

Yaxiong Xie, Fan Yi, and Kyle Jamieson. 2020. PBE-CC: Congestion Control via Endpoint-Centric, Physical-Layer Bandwidth Measurements. In Proc. of ACM SIGCOMM. 451--464.

Digital Library

[56]

Dongzhu Xu, Anfu Zhou, Xinyu Zhang, Guixian Wang, Xi Liu, Congkai An, Yiming Shi, Liang Liu, and Huadong Ma. 2020. Understanding Operational 5G: A First Measurement Study on Its Coverage, Performance and Energy Consumption. In Proc. of ACM SIGCOMM. 479--494.

Digital Library

[57]

Yin Xu, Zixiao Wang, Wai Kay Leong, and Ben Leong. 2014. An End-to-End Measurement Study of Modern Cellular Data Networks. In Proc. of PAM. 34--45.

Digital Library

[58]

Yasir Zaki, Thomas Pötsch, Jay Chen, Lakshminarayanan Subramanian, and Carmelita Görg. 2015. Adaptive Congestion Control for Unpredictable Cellular Networks. In Proc. of ACM SIGCOMM. 509--522.

Digital Library

[59]

Gongzheng Zhang, Tony QS Quek, Aiping Huang, and Hangguan Shan. 2015. Delay and Reliability Tradeoffs in Heterogeneous Cellular Networks. IEEE Transactions on Wireless Communications 15, 2 (2015), 1101--1113.

Digital Library

[60]

George Kingsley Zipf. 1949. Human Behavior and the Principle of Least Effort: An Introd. to Human Ecology. Addison-Wesley Press.

Cited By

Wang HLi YYang JHu DLiao Z(2025)CamDroid: Context-Aware Model-Based Automated GUI Testing for Android AppsTsinghua Science and Technology10.26599/TST.2024.901003830:1(55-67)Online publication date: Feb-2025
https://doi.org/10.26599/TST.2024.9010038
Liu DQian CRong HZhou SXiang CJiang H(2024)Energy and QoE Optimization for Mobile Video Streaming with Adaptive Brightness ScalingACM Transactions on Sensor Networks10.1145/367099920:4(1-24)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3670999
Zhu RZhu XZhang AZhang XSun JQian FQiu HMao ZLee MShu YLiu JTan RHe YChen J(2024)Boosting Collaborative Vehicular Perception on the Edge with Vehicle-to-Vehicle CommunicationProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699328(141-154)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699328
Show More Cited By

Index Terms

A nationwide study on cellular reliability: measurement, analysis, and enhancements
1. Networks

Recommendations

Modeling of Cellular Network Subscriber Mobility
AICT '09: Proceedings of the 2009 Fifth Advanced International Conference on Telecommunications

In this work, we have studied the behavior and mobility of a cellular network subscriber who belong to a determined class such as (personal employee, student, retired and others) between different areas. Our contribution in this work is a proposition of ...
Predictive Impact Analysis for Designing a Resilient Cellular Backhaul Network

Backhaul transport network design and optimization for cellular service providers involve a unique challenge stemming from the fact that an end-user's equipment (UE) is within the radio reach of multiple cellular towers: It is hard to evaluate the impact ...
Performance analysis of mobility management architectures in cellular networks

Flattened cellular network architecture for the mobile internet is expected to meet the demands of rapidly increasing traffic from mobile users. Dynamic mobility anchoring (DMA) mechanism distributes the mobility management functions using such network ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '21: Proceedings of the 2021 ACM SIGCOMM 2021 Conference

August 2021

868 pages

ISBN:9781450383837

DOI:10.1145/3452296

General Chairs:
Fernando Kuipers
Delft University of Technology
,
Matthew Caesar
University of Illinois at Urbana-Champaign

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 August 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

SIGCOMM '21

Sponsor:

SIGCOMM

SIGCOMM '21: ACM SIGCOMM 2021 Conference

August 23 - 27, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
1,693
Total Downloads

Downloads (Last 12 months)178
Downloads (Last 6 weeks)10

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Wang HLi YYang JHu DLiao Z(2025)CamDroid: Context-Aware Model-Based Automated GUI Testing for Android AppsTsinghua Science and Technology10.26599/TST.2024.901003830:1(55-67)Online publication date: Feb-2025
https://doi.org/10.26599/TST.2024.9010038
Liu DQian CRong HZhou SXiang CJiang H(2024)Energy and QoE Optimization for Mobile Video Streaming with Adaptive Brightness ScalingACM Transactions on Sensor Networks10.1145/367099920:4(1-24)Online publication date: 8-Jul-2024
https://dl.acm.org/doi/10.1145/3670999
Zhu RZhu XZhang AZhang XSun JQian FQiu HMao ZLee MShu YLiu JTan RHe YChen J(2024)Boosting Collaborative Vehicular Perception on the Edge with Vehicle-to-Vehicle CommunicationProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699328(141-154)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699328
Kalntis MSuárez-Varela JIglesias JBhattacharjee AIosifidis GKuipers FLutu AVallina-Rodríguez NSuarez-Tángil GLevin DPelsser C(2024)Through the Telco Lens: A Countrywide Empirical Study of Cellular HandoversProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688452(51-67)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3646547.3688452
Pochaba SMaier CHerlich MDorfinger P(2024)WIP: An Open Data Set about Multi-Provider Redundancy in Cellular Networks2024 IEEE 25th International Symposium on a World of Wireless, Mobile and Multimedia Networks (WoWMoM)10.1109/WoWMoM60985.2024.00063(359-362)Online publication date: 4-Jun-2024
https://doi.org/10.1109/WoWMoM60985.2024.00063
Jin FLiu KLiu CCheng TZhang HLee V(2024)A Cooperative Vehicle Localization and Trajectory Prediction Framework Based on Belief Propagation and Transformer ModelIEEE Transactions on Consumer Electronics10.1109/TCE.2024.336405270:1(2746-2758)Online publication date: Feb-2024
https://doi.org/10.1109/TCE.2024.3364052
Fan CCui JZhong HBolodurina IHe D(2024)MM-SDVN: Efficient Mobility Management Scheme for Optimal Network Handover in Software-Defined Vehicular NetworkIEEE Internet of Things Journal10.1109/JIOT.2024.342265911:19(32089-32104)Online publication date: 1-Oct-2024
https://doi.org/10.1109/JIOT.2024.3422659
E JHe LZhao ZWang YChen GChen W(2024)AggDeliv: Aggregating Multiple Wireless Links for Efficient Mobile Live Video DeliveryIEEE INFOCOM 2024 - IEEE Conference on Computer Communications10.1109/INFOCOM52122.2024.10621184(1173-1180)Online publication date: 20-May-2024
https://doi.org/10.1109/INFOCOM52122.2024.10621184
Li YLi ZHan ZZhang QMa X(2023)Automating Cloud Deployment for Real-Time Online Foundation Model InferenceIEEE/ACM Transactions on Networking10.1109/TNET.2023.332196732:2(1509-1523)Online publication date: 13-Oct-2023
https://dl.acm.org/doi/10.1109/TNET.2023.3321967
Jin YJiao LJi MQian ZZhang SChen NLu S(2023)Scheduling In-Band Network Telemetry With Convergence-Preserving Federated LearningIEEE/ACM Transactions on Networking10.1109/TNET.2023.325330231:5(2313-2328)Online publication date: 14-Mar-2023
https://dl.acm.org/doi/10.1109/TNET.2023.3253302
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents