short-paper

ZipLine: in-network compression at line speed

Authors:

Sébastien Vaucher,

Niloofar Yazdani,

Daniel E. Lucani,

Valerio SchiavoniAuthors Info & Claims

CoNEXT '20: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies

Pages 399 - 405

https://doi.org/10.1145/3386367.3431302

Published: 24 November 2020 Publication History

Abstract

Network appliances continue to offer novel opportunities to offload processing from computing nodes directly into the data plane. One popular concern of network operators and their customers is to move data increasingly faster. A common technique to increase data throughput is to compress it before its transmission. However, this requires compression of the data---a time and energy demanding preprocessing phase---and decompression upon reception---a similarly resource consuming operation. Moreover, if multiple nodes transfer similar data chunks across the network hop (e.g., a given pair of switches), each node effectively wastes resources by executing similar steps. This paper proposes ZipLine, an approach to design and implement (de)compression at line speed leveraging the Tofino hardware platform which is programmable using the P4₁₆ language. We report on lessons learned while building the system and show throughput, latency and compression measurements on synthetic and real-world traces, showcasing the benefits and trade-offs of our design.

Supplementary Material

MP4 File (3386367.3431302.mp4)

Presentation Video

Download
74.45 MB

References

[1]

2020. Aruba Compression on SD-WAN. https://www.arubanetworks.com/assets/ds/DS_SD-WAN.pdf

[2]

2020. Brocade 6520. https://www.dataswitchworks.com/datasheets/switches/6520-switch-ds.pdf

[3]

2020. XipLink. http://www.xiplink.com/media/XipLink-XA-Appliances-Overview.pdf

[4]

Barefoot Networks. 2020. Tofino product brief page. https://barefootnetworks.com/products/brief-tofino/

[5]

Barefoot Networks and P4.org Applications Working Group. 2018. Barefoot Deep Insight Monitoring System Enabled by DataPlane Telemetry. https://p4.org/assets/P4WS_2018/9_Daniel_Alvarez_DI.pdf

[6]

Theophilus A. Benson. 2019. In-Network Compute: Considered Armed and Dangerous. In Proceedings of the Workshop on Hot Topics in Operating Systems (Bertinoro, Italy) (HotOS '19). 216--224.

Digital Library

[7]

P. Benácek, V. Pu, and H. Kubátová. 2016. P4-to-VHDL: Automatic Generation of 100 Gbps Packet Parsers. In 2016 IEEE 24th Annual International Symposium on Field-Programmable Custom Computing Machines (FCCM). 148--155.

[8]

Richard E. Blahut. 2003. Algebraic Codes for Data Transmission. Cambridge University Press.

[9]

Pat Bosshart, Dan Daly, Glen Gibb, Martin Izzard, Nick McKeown, Jennifer Rexford, Cole Schlesinger, Dan Talayco, Amin Vahdat, George Varghese, et al. 2014. P4: Programming protocol-independent packet processors. ACM SIGCOMM Computer Communication Review 44, 3 (2014), 87--95.

Digital Library

[10]

Xiaoqi Chen. 2020. Implementing AES Encryption on Programmable Switches via Scrambled Lookup Tables. In ACM SIGCOMM 2020 Workshop on Secure Programmable Network Infrastructure (Virtual Event) (SPIN '20). Association for Computing Machinery, New York, NY, USA.

Digital Library

[11]

H. T. Dang, P. Bressana, H. Wang, K. S. Lee, N. Zilberman, H. Weatherspoon, M. Canini, F. Pedone, and R. Soulé. 2020. P4xos: Consensus as a Network Service. IEEE/ACM Transactions on Networking (2020), 1--13.

Digital Library

[12]

L. Peter Deutsch. 1996. DEFLATE Compressed Data Format Specification version 1.3. RFC 1951.

Digital Library

[13]

Edgecore networks. 2019. Wedge100BF-32X/65X Switch. https://www.edgecore.com/_upload/images/Wedge100BF-32X_65X_DS_R05_20191210.pdf

[14]

Lucas Freire, Miguel Neves, Lucas Leal, Kirill Levchenko, Alberto Schaeffer-Filho, and Marinho Barcellos. 2018. Uncovering Bugs in P4 Programs with Assertion-Based Verification. In Proceedings of the Symposium on SDN Research (Los Angeles, CA, USA) (SOSR '18). Article 4, 7 pages.

Digital Library

[15]

Christian Göttel, Lars Nielsen, Niloofar Yazdani, Pascal Felber, Daniel E. Lucani, and Valerio Schiavoni. 2020. Hermes: Enabling Energy-Efficient IoT Networks with Generalized Deduplication. In Proceedings of the 14th ACM International Conference on Distributed and Event-Based Systems (Montreal, Quebec, Canada) (DEBS '20). Association for Computing Machinery, New York, NY, USA, 133--136.

Digital Library

[16]

David Hancock and Jacobus van der Merwe. 2016. HyPer4: Using P4 to Virtualize the Programmable Data Plane. In Proceedings of the 12th International on Conference on Emerging Networking EXperiments and Technologies (Irvine, California, USA) (CoNEXT '16). Association for Computing Machinery, New York, NY, USA, 35--49.

Digital Library

[17]

Theo Jepsen, Masoud Moshref, Antonio Carzaniga, Nate Foster, and Robert Soulé. 2018. Life in the Fast Lane: A Line-Rate Linear Road. In Proceedings of the Symposium on SDN Research (Los Angeles, CA, USA) (SOSR '18). Article 10, 7 pages.

Digital Library

[18]

Alberto Lerner, Rana Hussein, and Philippe Cudré-Mauroux. 2019. The Case for Network Accelerated Query Processing. In 9th Biennial Conference on Innovative Data Systems Research (CIDR'19).

[19]

Craig Mustard, Fabian Ruffy, Anny Gakhokidze, Ivan Beschastnikh, and Alexandra Fedorova. 2019. Jumpgate: In-Network Processing as a Service for Data Analytics. In 11th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud 19). USENIX Association, Renton, WA.

[20]

Miguel Neves, Lucas Freire, Alberto Schaeffer-Filho, and Marinho Barcellos. 2018. Verification of P4 Programs in Feasible Time Using Assertions. In Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (Heraklion, Greece) (CoNEXT '18). Association for Computing Machinery, New York, NY, USA, 73--85.

Digital Library

[21]

L. Nielsen, R. Vestergaard, N. Yazdani, P. Talasila, D. E. Lucani, and M. Sipos. 2019. Alexandria: A Proof-of-Concept Implementation and Evaluation of Generalised Data Deduplication. In IEEE Globecom Workshops (GC Wkshps). 1--6.

[22]

Jithin Thomas Petr Lapukhov. 2016. Using INT to Build a Real-time Network Monitoring System Scale. In P4 Workshop.

[23]

Dan R. K. Ports and Jacob Nelson. 2019. When Should The Network Be The Computer?. In Proceedings of the Workshop on Hot Topics in Operating Systems (Bertinoro, Italy) (HotOS '19). Association for Computing Machinery, New York, NY, USA, 209--215.

Digital Library

[24]

Yi Qiao, Xiao Kong, Menghao Zhang, Yu Zhou, Mingwei Xu, and Jun Bi. 2020. Towards In-Network Acceleration of Erasure Coding. In Proceedings of the Symposium on SDN Research (San Jose, CA, USA) (SOSR '20). Association for Computing Machinery, New York, NY, USA, 41--47.

Digital Library

[25]

Irving S Reed and Gustave Solomon. 1960. Polynomial codes over certain finite fields. Journal of the society for industrial and applied mathematics 8, 2 (1960), 300--304.

[26]

E. Sakic, N. Deric, E. Goshi, and W. Kellerer. 2019. P4BFT: Hardware-Accelerated Byzantine-Resilient Network Control Plane. In 2019 IEEE Global Communications Conference (GLOBECOM). 1--7.

Digital Library

[27]

Davide Sanvito, Giuseppe Siracusano, and Roberto Bifulco. 2018. Can the Network Be the AI Accelerator?. In Proceedings of the 2018 Morning Workshop on In-Network Computing (Budapest, Hungary) (NetCompute '18). Association for Computing Machinery, New York, NY, USA, 20--25.

Digital Library

[28]

Amedeo Sapio, Ibrahim Abdelaziz, Abdulla Aldilaijan, Marco Canini, and Panos Kalnis. 2017. In-Network Computation is a Dumb Idea Whose Time Has Come. In Proceedings of the 16th ACM Workshop on Hot Topics in Networks (Palo Alto, CA, USA) (HotNets-XVI). Association for Computing Machinery, New York, NY, USA, 150--156.

Digital Library

[29]

Muhammad Shahbaz, Sean Choi, Ben Pfaff, Changhoon Kim, Nick Feamster, Nick McKeown, and Jennifer Rexford. 2016. Pisces: A programmable, protocol-independent software switch. In Proceedings of the 2016 ACM SIGCOMM Conference. 525--538.

Digital Library

[30]

Apoorv Shukla, Kevin Nico Hudemann, Artur Hecker, and Stefan Schmid. 2019. Runtime Verification of P4 Switches with Reinforcement Learning. In Proceedings of the 2019 Workshop on Network Meets AI & ML (Beijing, China) (NetAI'19). Association for Computing Machinery, New York, NY, USA, 1--7.

Digital Library

[31]

Manmeet Singh, Maninder Singh, and Sanmeet Kaur. 2019. 10 Days DNS Network Traffic from April-May, 2016.

[32]

P. Talasila and D. E. Lucani. 2019. Generalized Deduplication: Lossless Compression by Clustering Similar Data. In IEEE 8th International Conference on Cloud Networking (CloudNet). 1--4.

[33]

Tom Tofigh and Nic Viljoen. 2016. Dynamic Analytics for Programmable NICs Utilizing P4. In P4 Workshop.

[34]

Yuta Tokusashi, Huynh Tu Dang, Fernando Pedone, Robert Soulé, and Noa Zilberman. 2019. The Case For In-Network Computing On Demand. In Proceedings of the Fourteenth EuroSys Conference 2019 (Dresden, Germany) (EuroSys '19). Association for Computing Machinery, New York, NY, USA, Article 21, 16 pages.

Digital Library

[35]

R. Vestergaard, D. E. Lucani, and Q. Zhang. 2019. Generalized Deduplication: Lossless Compression for Large Amounts of Small IoT Data. In European Wireless 2019; 25th European Wireless Conference. 1--5.

[36]

R. Vestergaard, Q. Zhang, and D. E. Lucani. 2019. Generalized Deduplication: Bounds, Convergence, and Asymptotic Properties. In IEEE Global Communications Conference (GLOBECOM). 1--6.

Digital Library

[37]

R. Vestergaard, Q. Zhang, and D. E. Lucani. 2019. Lossless Compression of Time Series Data with Generalized Deduplication. In IEEE Global Communications Conference (GLOBECOM). 1--6.

Digital Library

[38]

Daryle Walker. 2020. Boost.CRC. https://www.boost.org/doc/libs/1_73_0/doc/html/crc.html

[39]

Shie-Yuan Wang, Jun-Yi Li, and Yi-Bing Lin. 2020. Aggregating and disaggregating packets with various sizes of payload in P4 switches at 100 Gbps line rate. Journal of Network and Computer Applications 165 (2020), 102676.

[40]

Shie-Yuan Wang, Chia-Ming Wu, Yi-Bing Lin, and Ching-Chun Huang. 2019. High-speed data-plane packet aggregation and disaggregation by P4 switches. Journal of Network and Computer Applications 142 (2019), 98--110.

[41]

Niloofar Yazdani and Daniel E Lucani. 2019. Protocols to Reduce CPS Sensor Traffic using Smart Indexing and Edge Computing Support. In 2019 IEEE Globecom Workshops (GC Wkshps). 1--6.

[42]

Niloofar Yazdani and Daniel E Lucani. 2020. Age of Information Analysis for Instantly Decompressible IoT Protocols. In ICC 2020 - 2020 IEEE International Conference on Communications (ICC). 1--6.

[43]

Niloofar Yazdani, Lars Nielsen, and Daniel E Lucani. 2020. Memory-aware Online Compression of CAN Bus Data for Future Vehicular Systems. 2020 IEEE Global Communications Conference (GLOBECOM) (2020).

[44]

Yu Zhou, Jun Bi, Yunsenxiao Lin, Yangyang Wang, Dai Zhang, Zhaowei Xi, Jiamin Cao, and Chen Sun. 2019. P4Tester: Efficient Runtime Rule Fault Detection for Programmable Data Planes. In Proceedings of the International Symposium on Quality of Service (Phoenix, Arizona) (IWQoS '19). Association for Computing Machinery, New York, NY, USA, Article 5, 10 pages.

Digital Library

Cited By

Segal RAvin CScalosub G(2024)SOAR: Minimizing Network Utilization Cost With Bounded In-Network ComputingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333606721:2(1832-1851)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3336067
Zheng CTang HZang MHong XFeng ATassiulas LZilberman N(2023)DINC: Toward Distributed In-Network ComputingProceedings of the ACM on Networking10.1145/36291361:CoNEXT3(1-25)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3629136
Wu HShen YXiao XNguyen GHecker AFitzek F(2023)Accelerating Industrial IoT Acoustic Data Separation With In-Network ComputingIEEE Internet of Things Journal10.1109/JIOT.2022.317697410:5(3901-3916)Online publication date: 1-Mar-2023
https://doi.org/10.1109/JIOT.2022.3176974
Show More Cited By

Index Terms

ZipLine: in-network compression at line speed
1. Networks
  1. Network performance evaluation
    1. Network experimentation
    2. Network measurement
  2. Network services
    1. In-network processing
    2. Programmable networks

Recommendations

Precise Time-synchronization in the Data-Plane using Programmable Switching ASICs
SOSR '19: Proceedings of the 2019 ACM Symposium on SDN Research

Current implementations of time synchronization protocols (e.g. PTP) in standard industry-grade switches handle the protocol stack in the slow-path (control-plane). With new use cases of in-network computing using programmable switching ASICs, global ...
FPGA bitstream compression and decompression using LZ and golomb coding (abstract only)
FPGA '13: Proceedings of the ACM/SIGDA international symposium on Field programmable gate arrays

In this paper we propose an optimized bitstream compression algorithm based on LZ and a novel architecture of decompressor, the proposed algorithm improves the Compression Ratio by fully utilizing the regularity of configuration bits of CLB (...
TREAT - Two wRongs makE A righT: efficient distributed storage and queries of IoT datasets with erasure coding and compression
DEBS '24: Proceedings of the 18th ACM International Conference on Distributed and Event-based Systems

Erasure coding in distributed multi-cloud data storage increases availability, durability and security, but it also makes data analytics inefficient since the whole dataset must be reconstructed to answer a query, even if the result set is a small ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '20: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies

November 2020

585 pages

ISBN:9781450379489

DOI:10.1145/3386367

Program Chairs:
Dongsu Han
KAIST, South Korea
,
Anja Feldmann
MPI, Germany

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Aarhus Universitets Forskningsfond
Université de Neuchâtel
Danmarks Frie Forskningsfond
Aarhus University Centre for Digitalisation, Big Data and Data Analytics

Conference

CoNEXT '20

Sponsor:

SIGCOMM

CoNEXT '20: The 16th International Conference on emerging Networking EXperiments and Technologies

December 1 - 4, 2020

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
606
Total Downloads

Downloads (Last 12 months)96
Downloads (Last 6 weeks)2

Reflects downloads up to 24 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Segal RAvin CScalosub G(2024)SOAR: Minimizing Network Utilization Cost With Bounded In-Network ComputingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333606721:2(1832-1851)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3336067
Zheng CTang HZang MHong XFeng ATassiulas LZilberman N(2023)DINC: Toward Distributed In-Network ComputingProceedings of the ACM on Networking10.1145/36291361:CoNEXT3(1-25)Online publication date: 28-Nov-2023
https://dl.acm.org/doi/10.1145/3629136
Wu HShen YXiao XNguyen GHecker AFitzek F(2023)Accelerating Industrial IoT Acoustic Data Separation With In-Network ComputingIEEE Internet of Things Journal10.1109/JIOT.2022.317697410:5(3901-3916)Online publication date: 1-Mar-2023
https://doi.org/10.1109/JIOT.2022.3176974
Tanwar DSingla PNag SKumar VSarangi S(2023)SmrtComp: Intelligent and Online CAN Data Compression2023 IEEE 26th International Conference on Intelligent Transportation Systems (ITSC)10.1109/ITSC57777.2023.10422163(1514-1521)Online publication date: 24-Sep-2023
https://doi.org/10.1109/ITSC57777.2023.10422163
Watanabe RKubota AKurihara J(2023)Application of Generalized Deduplication Techniques in Edge Computing EnvironmentsAdvanced Information Networking and Applications10.1007/978-3-031-28694-0_55(585-596)Online publication date: 15-Mar-2023
https://doi.org/10.1007/978-3-031-28694-0_55
Segal RAvin CScalosub G(2022)Constrained In-network Computing with Low Congestion in Datacenter NetworksIEEE INFOCOM 2022 - IEEE Conference on Computer Communications10.1109/INFOCOM48880.2022.9796980(1639-1648)Online publication date: 2-May-2022
https://doi.org/10.1109/INFOCOM48880.2022.9796980
Das AChakraborty SChakraborty S(2022)Where do all my smart home data go? Context-aware data generation and forwarding for edge-based microservices over shared IoT infrastructureFuture Generation Computer Systems10.1016/j.future.2022.03.027134(204-218)Online publication date: Sep-2022
https://doi.org/10.1016/j.future.2022.03.027
Segal RAvin CScalosub GCarle GOtt J(2021)SOARProceedings of the 17th International Conference on emerging Networking EXperiments and Technologies10.1145/3485983.3494853(16-29)Online publication date: 2-Dec-2021
https://dl.acm.org/doi/10.1145/3485983.3494853
Karlos GBal HWang L(2021)Don't You Worry 'Bout a PacketProceedings of the 20th ACM Workshop on Hot Topics in Networks10.1145/3484266.3487395(99-107)Online publication date: 10-Nov-2021
https://dl.acm.org/doi/10.1145/3484266.3487395
Kfoury ECrichigno JBou-Harb E(2021)An Exhaustive Survey on P4 Programmable Data Plane Switches: Taxonomy, Applications, Challenges, and Future TrendsIEEE Access10.1109/ACCESS.2021.30867049(87094-87155)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3086704

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents