Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3469393.3469402acmotherconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article

Evaluating Network Stacks for the Virtualized Mobile Packet Core

Published: 01 February 2022 Publication History

Abstract

Several novel userspace network stacks have been proposed in recent research to overcome the limitations of the Linux network stack in providing high-performance I/O for Virtual Network Functions (VNFs). In this paper, we evaluate the performance of several state-of-the-art network stacks in the context of the VNFs of the 5G mobile packet core. The VNFs in the 5G core are several times more compute-intensive than the VNFs used to benchmark network stacks in prior work, given the need to perform user authentication and other such cryptographic operations. Our evaluation shows that while modern stacks outperform the Linux kernel stack over I/O intensive VNFs (as observed in prior work), the performance gap is not as wide in the case of CPU-intensive VNFs of the 5G core. We also find that the packet core VNFs can obtain up to 67% higher performance if the network stack could partition traffic to CPU cores at the granularity at which VNFs maintain state (mobile subscriber in this case), enabling a lockfree architecture within the VNF. The insights from our work can help us design a network stack that is better suited for compute-intensive VNFs such as those in the 5G core.

References

[1]
3GPP. 2018. The Evolved Packet Core. http://www.3gpp.org/technologies/keywords-acronyms/100-the-evolved-packet-core.
[2]
3GPP. 2020. 3GPP Specification Set: 5G. https://www.3gpp.org/dynareport/SpecList.htm?release=Rel-15&tech=4.
[3]
3GPP. 2020. Access and Mobility management Function (AMF). https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=3445.
[4]
Bhavish Aggarwal, Aditya Akella, Ashok Anand, Athula Balachandran, Pushkar Chitnis, Chitra Muthukrishnan, Ramachandran Ramjee, and George Varghese. 2010. EndRE: An End-System Redundancy Elimination Service for Enterprises. In Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation.
[5]
Ashkan Aghdai 2018. Transparent Edge Gateway for Mobile Networks. In IEEE 26th International Conference on Network Protocols (ICNP).
[6]
Abdul Alim, Richard G. Clegg, Luo Mai, Lukas Rupprecht, Eric Seckler, Paolo Costa, Peter Pietzuch, Alexander L. Wolf, Nik Sultana, Jon Crowcroft, Anil Madhavapeddy, Andrew W. Moore, Richard Mortier, Masoud Koleni, Luis Oviedo, Matteo Migliavacca, and Derek McAuley. 2016. FLICK: Developing and Running Application-Specific Network Services. In 2016 USENIX Annual Technical Conference (USENIX ATC 16).
[7]
Apache. 2020. Traffic Server. https://github.com/apache/trafficserver.
[8]
João Taveira Araújo, Lorenzo Saino, Lennert Buytenhek, and Raul Landa. 2018. Balancing on the Edge: Transport Affinity without Network State. In Proceedings of the 15th USENIX Conference on Networked Systems Design and Implementation.
[9]
Adam Belay, Andrea Bittau, Ali Mashtizadeh, David Terei, David Mazières, and Christos Kozyrakis. 2012. Dune: Safe User-level Access to Privileged CPU Features. In 10th USENIX Symposium on Operating Systems Design and Implementation (OSDI 12).
[10]
Adam Belay, George Prekas, Ana Klimovic, Samuel Grossman, Christos Kozyrakis, and Edouard Bugnion. 2014. IX: A Protected Dataplane Operating System for High Throughput and Low Latency. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14).
[11]
Carmelo Cascone and Uyen Chau. 2018. Offloading VNFs to programmable switches using P4. In ONS North America.
[12]
Tencent Cloud. 2019. f-stack. http://www.f-stack.org/.
[13]
FCC Technological Advisory Council. 2018. 5G Edge Computing Whitepaper. https://transition.fcc.gov/bureaus/oet/tac/tacdocs/reports/2018/5G-Edge-Computing-Whitepaper-v6-Final.pdf.
[14]
Haprxy Developers. 2019. HAProxy. http://www.haproxy.org/.
[15]
T. Dietz, R. Bifulco, F. Manco, J. Martins, H. Kolbe, and F. Huici. 2015. Enhancing the BRAS through virtualization. In Proceedings of the 2015 1st IEEE Conference on Network Softwarization (NetSoft).
[16]
DoT. 2020. 5G Testbed @ CSE IITB. https://www.cse.iitb.ac.in/~5gtestbed/.
[17]
DoT. 2021. 5G Testbed. https://5gtestbed.in/.
[18]
Pekka Enberg, Ashwin Rao, and Sasu Tarkoma. 2019. Partition-Aware Packet Steering Using XDP and EBPF for Improving Application-Level Parallelism. In Proceedings of the 1st ACM CoNEXT Workshop on Emerging In-Network Computing Paradigms.
[19]
ETSI. 2020. Network Functions Virtualisation (NFV). https://www.etsi.org/technologies/nfv.
[20]
F5. 2020. Ngnix. https://www.nginx.com/.
[21]
Facebook. 2020. Mcrouter. https://github.com/facebook/mcrouter.
[22]
Open Information Security Foundation. 2020. Suricata. https://suricata-ids.org/.
[23]
Younghwan Go, Jongil Won, Denis Foo Kune, EunYoung Jeong, Yongdae Kim, and KyoungSoo Park. 2014. Gaining Control of Cellular Traffic Accounting by Spurious TCP Retransmission. In Proc. of Network and Distributed System Security Symposium (NDSS)’14.
[24]
GSMA. 2019. Internet of Things in the 5G Era: Opportunities and Benefits for Enterprises and Consumers. https://www.gsma.com/iot/wp-content/uploads/2019/11/201911-GSMA-IoT-Report-IoT-in-the-5G-Era.pdf.
[25]
Sangjin Han, Scott Marshall, Byung-Gon Chun, and Sylvia Ratnasamy. 2012. MegaPipe: A New Programming Interface for Scalable Network I/O. In Proceedings of the 10th USENIX Conference on Operating Systems Design and Implementation.
[26]
Tom Herbert and Willem de Bruijn. 2018. Receive Side Scaling (RSS). https://www.kernel.org/doc/Documentation/networking/scaling.txt.
[27]
Michio Honda, Felipe Huici, Costin Raiciu, Joao Araujo, and Luigi Rizzo. 2014. Rekindling Network Protocol Innovation with User-level Stacks. SIGCOMM Comput. Commun. Rev.(2014).
[28]
IBM. 2017. 5G Will Accelerate a New Wave of IoT Applications. https://newsroom.ibm.com/5G-accelerate-IOT.
[29]
Intel. 2018. Intel Data Plane Development Kit. http://dpdk.org/.
[30]
Muhammad Asim Jamshed, Jihyung Lee, Sangwoo Moon, Insu Yun, Deokjin Kim, Sungryoul Lee, Yung Yi, and KyoungSoo Park. 2012. Kargus: A Highly-Scalable Software-Based Intrusion Detection System. In Proceedings of the 2012 ACM Conference on Computer and Communications Security.
[31]
Eun Young Jeong, Shinae Woo, Muhammad Jamshed, Haewon Jeong, Sunghwan Ihm, Dongsu Han, and KyoungSoo Park. 2014. MTCP: A Highly Scalable User-Level TCP Stack for Multicore Systems. In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation.
[32]
Xin Jin, Xiaozhou Li, Haoyu Zhang, Robert Soulé, Jeongkeun Lee, Nate Foster, Changhoon Kim, and Ion Stoica. 2017. NetCache: Balancing Key-Value Stores with Fast In-Network Caching. In Proceedings of the 26th Symposium on Operating Systems Principles.
[33]
Kostis Kaffes, Timothy Chong, Jack Tigar Humphries, Adam Belay, David Mazières, and Christos Kozyrakis. 2019. Shinjuku: Preemptive Scheduling for µSecond-Scale Tail Latency. In Proceedings of the 16th USENIX Conference on Networked Systems Design and Implementation.
[34]
Antoine Kaufmann, Tim Stamler, Simon Peter, Naveen Kr. Sharma, Arvind Krishnamurthy, and Thomas Anderson. 2019. TAS: TCP Acceleration as an OS Service. In Proceedings of the Fourteenth EuroSys Conference 2019.
[35]
Kernel.org. 2020. perf: Linux profiling with performance counters. https://perf.wiki.kernel.org/index.php/Main_Page.
[36]
Xiaofeng Lin, Yu Chen, Xiaodong Li, Junjie Mao, Jiaquan He, Wei Xu, and Yuanchun Shi. 2016. Scalable Kernel TCP Design and Implementation for Short-Lived Connections. In Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating Systems.
[37]
Michael Marty, Marc de Kruijf, Jacob Adriaens, Christopher Alfeld, Sean Bauer, Carlo Contavalli, Michael Dalton, Nandita Dukkipati, William C. Evans, Steve Gribble, Nicholas Kidd, Roman Kononov, Gautam Kumar, Carl Mauer, Emily Musick, Lena Olson, Erik Rubow, Michael Ryan, Kevin Springborn, Paul Turner, Valas Valancius, Xi Wang, and Amin Vahdat. 2019. Snap: A Microkernel Approach to Host Networking. In Proceedings of the 27th ACM Symposium on Operating Systems Principles.
[38]
Netflix. 2020. Ribbon. https://github.com/Netflix/ribbon.
[39]
Amy Ousterhout, Joshua Fried, Jonathan Behrens, Adam Belay, and Hari Balakrishnan. 2019. Shenango: Achieving High CPU Efficiency for Latency-Sensitive Datacenter Workloads. In Proceedings of the 16th USENIX Conference on Networked Systems Design and Implementation.
[40]
Vern Paxson. 1999. Bro: A System for Detecting Network Intruders in Real-Time. Comput. Netw. (1999).
[41]
Aleksey Pesterev, Jacob Strauss, Nickolai Zeldovich, and Robert T. Morris. 2012. Improving Network Connection Locality on Multicore Systems. In Proceedings of the 7th ACM European Conference on Computer Systems(EuroSys ’12).
[42]
Simon Peter, Jialin Li, Irene Zhang, Dan R. K. Ports, Doug Woos, Arvind Krishnamurthy, Thomas Anderson, and Timothy Roscoe. 2014. Arrakis: The Operating System is the Control Plane. In 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI 14).
[43]
George Prekas, Marios Kogias, and Edouard Bugnion. 2017. ZygOS: Achieving Low Tail Latency for Microsecond-Scale Networked Tasks. In Proceedings of the 26th Symposium on Operating Systems Principles.
[44]
The Zeek Project. 2020. An Open Source Network Security Monitoring Tool. https://zeek.org/.
[45]
Qualcomm. 2020. What is 5G. https://www.qualcomm.com/invention/5g/what-is-5g.
[46]
Luigi Rizzo. 2012. Netmap: A Novel Framework for Fast Packet I/O. In Proceedings of the 2012 USENIX Conference on Annual Technical Conference.
[47]
ScyllaDB. 2019. Seastar. http://seastar.io/.
[48]
Rinku Shah, Vikas Kumar, Mythili Vutukuru, and Purushottam Kulkarni. 2020. TurboEPC: Leveraging Dataplane Programmability to Accelerate the Mobile Packet Core. In Proceedings of the Symposium on SDN Research.
[49]
Squid. 2020. Squid: Optimising Web Delivery. http://www.squid-cache.org/.
[50]
Twitter. 2019. Memcached Proxy. https://github.com/twitter/twemproxy.
[51]
Ubuntu. 2020. PRADS. http://manpages.ubuntu.com/manpages/eoan/en/man1/prads.1.html.
[52]
Varnish-Cache. 2020. Varnish Cache. http://varnish-cache.org/.
[53]
Kenichi Yasukata, Michio Honda, Douglas Santry, and Lars Eggert. 2016. StackMap: Low-Latency Networking with the OS Stack and Dedicated NICs. In 2016 USENIX Annual Technical Conference (USENIX ATC 16).

Cited By

View all
  • (2023)Characterizing and Modeling Mobile Networks User Traffic at Millisecond LevelProceedings of the 17th ACM Workshop on Wireless Network Testbeds, Experimental evaluation & Characterization10.1145/3615453.3616509(64-71)Online publication date: 6-Oct-2023
  • (2023)FlexCore: Leveraging XDP-SCTP for Scalable and Resilient Network Slice Service in Future 5G CoreProceedings of the 7th Asia-Pacific Workshop on Networking10.1145/3600061.3600073(61-66)Online publication date: 29-Jun-2023

Index Terms

  1. Evaluating Network Stacks for the Virtualized Mobile Packet Core
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image ACM Other conferences
          APNet '21: Proceedings of the 5th Asia-Pacific Workshop on Networking
          June 2021
          79 pages
          ISBN:9781450385879
          DOI:10.1145/3469393
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 01 February 2022

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. 5G core
          2. Cellular networks
          3. DPDK
          4. Kernel bypass
          5. Kernel network stack
          6. Network Function Virtualization

          Qualifiers

          • Research-article
          • Research
          • Refereed limited

          Conference

          APNet 2021
          APNet 2021: 5th Asia-Pacific Workshop on Networking
          June 24 - 25, 2021
          Shenzhen, China, China

          Acceptance Rates

          Overall Acceptance Rate 50 of 118 submissions, 42%

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)38
          • Downloads (Last 6 weeks)5
          Reflects downloads up to 10 Nov 2024

          Other Metrics

          Citations

          Cited By

          View all
          • (2023)Characterizing and Modeling Mobile Networks User Traffic at Millisecond LevelProceedings of the 17th ACM Workshop on Wireless Network Testbeds, Experimental evaluation & Characterization10.1145/3615453.3616509(64-71)Online publication date: 6-Oct-2023
          • (2023)FlexCore: Leveraging XDP-SCTP for Scalable and Resilient Network Slice Service in Future 5G CoreProceedings of the 7th Asia-Pacific Workshop on Networking10.1145/3600061.3600073(61-66)Online publication date: 29-Jun-2023

          View Options

          Get Access

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          HTML Format

          View this article in HTML Format.

          HTML Format

          Media

          Figures

          Other

          Tables

          Share

          Share

          Share this Publication link

          Share on social media