short-paper

Open access

Parking packet payload with P4

Authors:

Ivan Beschastnikh,

Margo SeltzerAuthors Info & Claims

CoNEXT '20: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies

Pages 274 - 281

https://doi.org/10.1145/3386367.3431295

Published: 24 November 2020 Publication History

Abstract

Network Function (NF) deployments suffer from poor link goodput, because popular NFs such as firewalls process only packet headers while receiving and transmitting complete packets. As a result, unnecessary packet payloads needlessly consume link bandwidth. We introduce PayloadPark, which improves goodput by temporarily parking packet payloads in the stateful memory of dataplane programmable switches. PayloadPark forwards only packet headers to NF servers, thereby saving bandwidth between the switch and the NF server. PayloadPark is a transparent in-network optimization that complements existing approaches for optimizing NF performance on end-hosts.

We prototyped PayloadPark on a Barefoot Tofino ASIC using the P4 language. Our prototype, when deployed on a top-of-rack switch, can service up to 8 NF servers using less than 40% of the on-chip memory resources. The prototype improves goodput by 10-26% for a Firewall → NAT NF chain and reduces PCIe bandwidth load by 2-58%. With workloads that have datacenter network traffic characteristics, PayloadPark provides a 13% goodput gain with a Firewall → NAT → LB NF chain, without latency penalty. In this scenario, we can further increase the goodput gain to 28% by using packet recirculation.

Supplementary Material

MP4 File (3386367.3431295_01.mp4)

Parking Packet Payload with P4 (CoNEXT 2020)

Download
8.16 MB

References

[1]

2020. PayloadPark on Github. https://github.com/PayloadPark/payloadpark

[2]

Theophilus Benson, Aditya Akella, and David A. Maltz. 2010. Network Traffic Characteristics of Data Centers in the Wild. In Proceedings of the 10th ACM SIGCOMM Conference on Internet Measurement (IMC '10). ACM, 267--280.

Digital Library

[3]

Pat Bosshart, Dan Daly, Glen Gibb, Martin Izzard, Nick McKeown, Jennifer Rexford, Cole Schlesinger, Dan Talayco, Amin Vahdat, George Varghese, and David Walker. 2014. P4: Programming Protocol-independent Packet Processors. SIGCOMM Comput. Commun. Rev. 44, 3 (2014), 87--95.

Digital Library

[4]

Pat Bosshart, Glen Gibb, Hun-Seok Kim, George Varghese, Nick McKeown, Martin Izzard, Fernando Mujica, and Mark Horowitz. 2013. Forwarding Metamorphosis: Fast Programmable Match-action Processing in Hardware for SDN. In Proceedings of the 2013 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '13). ACM, 99--110.

Digital Library

[5]

Peng Cheng, Fengyuan Ren, Ran Shu, and Chuang Lin. 2014. Catch the Whole Lot in an Action: Rapid Precise Packet Loss Notification in Data Centers. In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation (NSDI '14). USENIX Association, 17--28. http://dl.acm.org/citation.cfm?id=2616448.2616451

[6]

The P4 Language Consortium. 2017. P4 16 Language Specification. Retrieved Oct. 30, 2019 from https://p4.org/p4-spec/docs/P4-16-v1.0.0-spec.pdf

[7]

Huynh Tu Dang, Daniele Sciascia, Marco Canini, Fernando Pedone, and Robert Soulé. 2015. NetPaxos: Consensus at Network Speed. In Proceedings of the Symposium on SDN Research (SOSR '15). ACM, 5:1--5:7.

Digital Library

[8]

Daniel E. Eisenbud, Cheng Yi, Carlo Contavalli, Cody Smith, Roman Kononov, Eric Mann-Hielscher, Ardas Cilingiroglu, Bin Cheyney, Wentao Shang, and Jinnah Dylan Hosein. 2016. Maglev: A Fast and Reliable Software Network Load Balancer. In Proceedings of the 13th USENIX Symposium on Networked Systems Design and Implementation (NSDI '16). Santa Clara, CA, 523--535. https://www.usenix.org/conference/nsdi16/technical-sessions/presentation/eisenbud

[9]

ETSI. 2013. NFV Whitepaper. Retrieved Oct. 30, 2019 from portal.etsi.org/NFV/NFV_White_Paper2.pdf

[10]

The Linux Foundation. 2011. Process Counter Monitor. Retrieved Oct. 30, 2019 from https://github.com/opcm/pcm

[11]

Swati Goswami, Nodir Kodirov, Craig Mustard, Ivan Beschastnikh, and Margo Seltzer. 2020. Parking Packet Payload with P4. arXiv:cs.NI/2006.05182 https://arxiv.org/abs/2006.05182

[12]

B. Han, V. Gopalakrishnan, L. Ji, and S. Lee. 2015. Network function virtualization: Challenges and opportunities for innovations. IEEE Communications Magazine 53, 2 (2015), 90--97.

Digital Library

[13]

Sangjin Han, Keon Jang, KyoungSoo Park, and Sue Moon. 2010. PacketShader: A GPU-accelerated Software Router. In Proceedings of the 2010 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '10). ACM, 195--206.

Digital Library

[14]

IETF. 2003. Benchmarking Methodology for Firewall Performance. Retrieved Oct. 30, 2019 from https://tools.ietf.org/html/rfc3511

[15]

IETF. 2003. Service Function Chaining Use Cases In Data Centers. Retrieved Oct. 30, 2019 from https://tools.ietf.org/html/draft-ietf-sfc-dc-use-cases-06

[16]

Yimin Jiang, Yong Cui, Wenfei Wu, Zhe Xu, Jiahan Gu, K. K. Ramakrishnan, Yongchao He, and Xuehai Qian. 2019. SpeedyBox: Low-Latency NFV Service Chains with Cross-NF Runtime Consolidation. In International Conference on Distributed Computing Systems (ICDCS '19). IEEE, 68--79.

[17]

Xin Jin, Xiaozhou Li, Haoyu Zhang, Robert Soulé, Jeongkeun Lee, Nate Foster, Changhoon Kim, and Ion Stoica. 2017. NetCache: Balancing Key-Value Stores with Fast In-Network Caching. In Proceedings of the 26th Symposium on Operating Systems Principles (SOSP '17). ACM, 121--136.

Digital Library

[18]

Raj Joshi, Ting Qu, Mun Choon Chan, Ben Leong, and Boon Thau Loo. 2018. BurstRadar: Practical Real-time Microburst Monitoring for Datacenter Networks. In Proceedings of the 9th Asia-Pacific Workshop on Systems (APSys '18). ACM, 8:1--8:8.

Digital Library

[19]

Georgios P. Katsikas, Tom Barbette, Dejan Kostić, Rebecca Steinert, and Gerald Q. Maguire Jr. 2018. Metron: NFV Service Chains at the True Speed of the Underlying Hardware. In Proceedings of the 15th USENIX Conference on Networked Systems Design and Implementation (NSDI '18). USENIX Association, 171--186. https://www.usenix.org/conference/nsdi18/presentation/katsikas

[20]

Bojie Li, Kun Tan, Layong (Larry) Luo, Yanqing Peng, Renqian Luo, Ningyi Xu, Yongqiang Xiong, Peng Cheng, and Enhong Chen. 2016. ClickNP: Highly Flexible and High Performance Network Processing with Reconfigurable Hardware. In Proceedings of the 2016 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '16). ACM, 1--14.

Digital Library

[21]

Jialin Li, Ellis Michael, Naveen Kr. Sharma, Adriana Szekeres, and Dan R. K. Ports. 2016. Just Say No to Paxos Overhead: Replacing Consensus with Network Ordering. In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16). USENIX Association, 467--483. http://dl.acm.org/citation.cfm?id=3026877.3026914

Digital Library

[22]

Ming Liu, Simon Peter, Arvind Krishnamurthy, and Phitchaya Mangpo Phothilimthana. 2019. E3: Energy-Efficient Microservices on SmartNIC-Accelerated Servers. In Proceedings of the 2019 USENIX Conference on Usenix Annual Technical Conference (USENIX ATC '19). USENIX Association, USA, 363--378.

[23]

James McCauley, Aurojit Panda, Arvind Krishnamurthy, and Scott Shenker. 2019. Thoughts on Load Distribution and the Role of Programmable Switches. SIGCOMM Comput. Commun. Rev. 49, 1 (Feb. 2019), 18--23.

Digital Library

[24]

Rui Miao, Hongyi Zeng, Changhoon Kim, Jeongkeun Lee, and Minlan Yu. 2017. SilkRoad: Making Stateful Layer-4 Load Balancing Fast and Cheap Using Switching ASICs. In Proceedings of the 2017 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '17). ACM, 15--28.

Digital Library

[25]

David Naylor, Alessandro Finamore, Ilias Leontiadis, Yan Grunenberger, Marco Mellia, Maurizio Munafò, Konstantina Papagiannaki, and Peter Steenkiste. 2014. The Cost of the "S" in HTTPS. In Proceedings of the 10th ACM International on Conference on Emerging Networking Experiments and Technologies (CoNEXT '14). ACM, 133--140.

Digital Library

[26]

Barefoot Networks. 2019. Tofino ASIC. Retrieved Oct. 30, 2019 from https://www.barefootnetworks.com/products/brief-tofino/

[27]

Rolf Neugebauer, Gianni Antichi, José Fernando Zazo, Yury Audzevich, Sergio López-Buedo, and Andrew W. Moore. 2018. Understanding PCIe Performance for End Host Networking. In Proceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '18). ACM, 327--341.

Digital Library

[28]

Aurojit Panda, Sangjin Han, Keon Jang, Melvin Walls, Sylvia Ratnasamy, and Scott Shenker. 2016. NetBricks: Taking the V out of NFV. In Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation (OSDI'16). USENIX Association, 203--216. http://dl.acm.org/citation.cfm?id=3026877.3026894

Digital Library

[29]

Parveen Patel, Deepak Bansal, Lihua Yuan, Ashwin Murthy, Albert Greenberg, David A. Maltz, Randy Kern, Hemant Kumar, Marios Zikos, Hongyu Wu, Changhoon Kim, and Naveen Karri. 2013. Ananta: Cloud Scale Load Balancing. In Proceedings of the 2013 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '13). ACM, 207--218.

Digital Library

[30]

Rishabh Poddar, Chang Lan, Raluca Ada Popa, and Sylvia Ratnasamy. 2018. SafeBricks: Shielding Network Functions in the Cloud. In Proceedings of the 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI '18). USENIX Association, 201--216. https://www.usenix.org/conference/nsdi18/presentation/poddar

[31]

Vyas Sekar, Norbert Egi, Sylvia Ratnasamy, Michael K. Reiter, and Guangyu Shi. 2012. Design and Implementation of a Consolidated Middlebox Architecture. In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI '12). USENIX Association, 24--24. http://dl.acm.org/citation.cfm?id=2228298.2228331

Digital Library

[32]

Justine Sherry, Shaddi Hasan, Colin Scott, Arvind Krishnamurthy, Sylvia Ratnasamy, and Vyas Sekar. 2012. Making Middleboxes Someone else's Problem: Network Processing As a Cloud Service. In Proceedings of the 2012 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '12). ACM, 13--24.

Digital Library

[33]

Chen Sun, Jun Bi, Zhilong Zheng, Heng Yu, and Hongxin Hu. 2017. NFP: Enabling Network Function Parallelism in NFV. In Proceedings of the 2017 Conference of the ACM Special Interest Group on Data Communication (SIGCOMM '17). ACM, 43--56.

Digital Library

[34]

Dingming Wu, Ang Chen, T. S. Eugene Ng, Guohui Wang, and Haiyong Wang. 2019. Accelerated Service Chaining on a Single Switch ASIC. In Proceedings of the 18th ACM Workshop on Hot Topics in Networks (HotNets '19). ACM, 141--149.

Digital Library

[35]

Wei Zhang, Guyue Liu, Wenhui Zhang, Neel Shah, Phillip Lopreiato, Gregoire Todeschi, K.K. Ramakrishnan, and Timothy Wood. 2016. OpenNetVM: A Platform for High Performance Network Service Chains. In Proceedings of the 2016 Workshop on Hot Topics in Middleboxes and Network Function Virtualization (Hot-Middlebox '16). ACM, 26--31. http://doi.acm.org/2940147.2940155

Digital Library

[36]

Yang Zhang, Bilal Anwer, Vijay Gopalakrishnan, Bo Han, Joshua Reich, Aman Shaikh, and Zhi-Li Zhang. 2017. ParaBox: Exploiting Parallelism for Virtual Network Functions in Service Chaining. In Proceedings of the Symposium on SDN Research (SOSR '17). ACM, 143--149.

Digital Library

Cited By

Skiadopoulos AXie ZZhao MCai QAgarwal SAdelmann JAhern DContavalli CGoldflam MMayatskikh VRaja RWalton DAgarwal RMukherjee SKozyrakis CGavrilovska ATerry D(2024)High-throughput and flexible host networking for accelerated computingProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691960(405-423)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691960
Ghasemirahni HFarshin AScazzariello MChiesa MKostić D(2024)Deploying Stateful Network Functions Efficiently using Large Language ModelsProceedings of the 4th Workshop on Machine Learning and Systems10.1145/3642970.3655836(28-38)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642970.3655836
Ma ZLi TXu ZFonseca NZhu Z(2024)SFCache: Hybrid NF Synthesization in Runtime With Rule-Caching in Programmable SwitchesIEEE Transactions on Network and Service Management10.1109/TNSM.2024.339014021:4(4613-4624)Online publication date: Aug-2024
https://doi.org/10.1109/TNSM.2024.3390140
Show More Cited By

Index Terms

Parking packet payload with P4
1. Networks
  1. Network components
    1. Middle boxes / network appliances
  2. Network services
    1. Programmable networks

Recommendations

Masking Corruption Packet Losses in Datacenter Networks with Link-local Retransmission
ACM SIGCOMM '23: Proceedings of the ACM SIGCOMM 2023 Conference

Packet loss due to link corruption is a major problem in large warehouse-scale datacenters. The current state-of-the-art approach of disabling corrupting links is not adequate because, in practice, all the corrupting links cannot be disabled due to ...
LinkGuardian: Mitigating the impact of packet corruption loss with link-local retransmission
APNet '22: Proceedings of the 6th Asia-Pacific Workshop on Networking

Packet corruption loss is a serious problem in datacenter networks. A large-scale study by Microsoft reported that the number of packets lost due to corruption is comparable to those lost due to congestion. Previous attempts to mitigate the impact of ...
High-speed data-plane packet aggregation and disaggregation by P4 switches
Abstract
In this paper, we propose novel approaches that utilize the header manipulations of the P4 (Programming Protocol-Independent Packet Processor) switches to aggregate small IoT packets into a large one, transmit it over a network, and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '20: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies

November 2020

585 pages

ISBN:9781450379489

DOI:10.1145/3386367

Program Chairs:
Dongsu Han
KAIST, South Korea
,
Anja Feldmann
MPI, Germany

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

NSERC

Conference

CoNEXT '20

Sponsor:

SIGCOMM

CoNEXT '20: The 16th International Conference on emerging Networking EXperiments and Technologies

December 1 - 4, 2020

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
1,708
Total Downloads

Downloads (Last 12 months)229
Downloads (Last 6 weeks)46

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Skiadopoulos AXie ZZhao MCai QAgarwal SAdelmann JAhern DContavalli CGoldflam MMayatskikh VRaja RWalton DAgarwal RMukherjee SKozyrakis CGavrilovska ATerry D(2024)High-throughput and flexible host networking for accelerated computingProceedings of the 18th USENIX Conference on Operating Systems Design and Implementation10.5555/3691938.3691960(405-423)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.5555/3691938.3691960
Ghasemirahni HFarshin AScazzariello MChiesa MKostić D(2024)Deploying Stateful Network Functions Efficiently using Large Language ModelsProceedings of the 4th Workshop on Machine Learning and Systems10.1145/3642970.3655836(28-38)Online publication date: 22-Apr-2024
https://dl.acm.org/doi/10.1145/3642970.3655836
Ma ZLi TXu ZFonseca NZhu Z(2024)SFCache: Hybrid NF Synthesization in Runtime With Rule-Caching in Programmable SwitchesIEEE Transactions on Network and Service Management10.1109/TNSM.2024.339014021:4(4613-4624)Online publication date: Aug-2024
https://doi.org/10.1109/TNSM.2024.3390140
Bellavista PFogli MGiannelli CStefanelli C(2023)Application-Aware Network Traffic Management in MEC-Integrated Industrial EnvironmentsFuture Internet10.3390/fi1502004215:2(42)Online publication date: 22-Jan-2023
https://doi.org/10.3390/fi15020042
Kumazoe KShibata MTsuru M(2023)Experimental comparison of software switches for data plane programming language P4-BMv2 and T4P4S-Proceedings of the 2023 12th International Conference on Networks, Communication and Computing10.1145/3638837.3638871(210-217)Online publication date: 15-Dec-2023
https://dl.acm.org/doi/10.1145/3638837.3638871
Choi YYoon JMoon YPark K(2023)Is Large MTU Beneficial to Cellular Core Networks?Proceedings of the 7th Asia-Pacific Workshop on Networking10.1145/3600061.3600081(67-73)Online publication date: 29-Jun-2023
https://dl.acm.org/doi/10.1145/3600061.3600081
Wang SZhang MLi GLiu CWang ZLiu YXu M(2023)Bolt: Scalable and Cost-Efficient Multistring Pattern Matching With Programmable SwitchesIEEE/ACM Transactions on Networking10.1109/TNET.2022.320252331:2(846-861)Online publication date: Apr-2023
https://doi.org/10.1109/TNET.2022.3202523
FUKUDA RSHIBATA MTSURU M(2023)Optimal Scheduling of Multipath Multicast with In-network Cache for One-to-many Transfer2023 33rd International Telecommunication Networks and Applications Conference10.1109/ITNAC59571.2023.10368542(84-91)Online publication date: 29-Nov-2023
https://doi.org/10.1109/ITNAC59571.2023.10368542
Li JLei YDe Marchi FJoshi RChandrasekaran BXia Y(2022)Hop-On Hop-Off RoutingProceedings of the 6th Asia-Pacific Workshop on Networking10.1145/3542637.3542647(63-69)Online publication date: 1-Jul-2022
https://dl.acm.org/doi/10.1145/3542637.3542647
Pismenny BLiss LMorrison ATsafrir DFalsafi BFerdman MLu SWenisch T(2022)The benefits of general-purpose on-NIC memoryProceedings of the 27th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3503222.3507711(1130-1147)Online publication date: 28-Feb-2022
https://dl.acm.org/doi/10.1145/3503222.3507711
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents