research-article

Meeting SLOs in cross-platform NFV

Authors:

Sucha Supittayapornpong,

Marcos A. M. Vieira,

Ramesh Govindan,

Barath RaghavanAuthors Info & Claims

CoNEXT '20: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies

Pages 509 - 523

https://doi.org/10.1145/3386367.3431292

Published: 24 November 2020 Publication History

Abstract

Network Functions (NFs) perform on-path processing of network traffic. ISPs are deploying NF Virtualization (NFV) with software NFs run on commodity servers. ISPs aim to ensure that NF chains, directed acyclic graphs of NFs, do not violate Service Level Objectives (SLOs) promised by the ISP to its customers. To meet SLOs, NFV systems sometimes leverage on-path hardware (such as programmable switches and smart NICs) to accelerate NF execution.

Lemur places and executes NF chains across heterogeneous hardware while meeting SLOs. Lemur's novel placement algorithm yields an SLO-satisfying NF placement while weighing many constraints: hardware memory and processing stages, server cores, link capacity, NF profiles, and NF chain interactions. Lemur's metacompiler automatically generates code and rules (in P4, Python, eBPF, C++, and OpenFlow) to stitch cross-platform NF chain execution while also optimizing resource usage. Our experiments show that Lemur is alone among competing strategies in meeting SLOs for canonical NF chains while maximizing marginal throughput (the traffic rate in excess of the service-level objective).

Supplementary Material

MOV File (3386367.3431292.mov)

Presentation Video

Download
145.22 MB

References

[1]

Bhavish Aggarwal, Aditya Akella, Ashok Anand, Athula Balachandran, Pushkar Chitnis, Chitra Muthukrishnan, Ramachandran Ramjee, and George Varghese. EndRE: An End-system Redundancy Elimination Service for Enterprises. In Proceedings of USENIX/ACM NSDI, 2010.

[2]

Berkeley Extensible Software Switch. https://github.com/NetSys/bess, 2019.

[3]

Pat Bosshart, Dan Daly, Glen Gibb, Martin Izzard, Nick McKeown, Jennifer Rexford, Cole Schlesinger, Dan Talayco, Amin Vahdat, George Varghese, and David Walker. P4: Programming protocol-independent packet processors. SIGCOMM Comput. Commun. Rev., 44(3):87--95, July 2014.

Digital Library

[4]

Pat Bosshart, Glen Gibb, Hun-Seok Kim, George Varghese, Nick McKeown, Martin Izzard, Fernando Mujica, and Mark Horowitz. Forwarding metamorphosis: Fast programmable match-action processing in hardware for sdn. In ACM SIGCOMM Computer Communication Review, volume 43, pages 99--110. ACM, 2013.

Digital Library

[5]

Anat Bremler-Barr, Yotam Harchol, and David Hay. Openbox: A software-defined framework for developing, deploying, and managing network functions. In Proceedings of ACM SIGCOMM, 2016.

[6]

Adrian M Caulfield, Eric S Chung, Andrew Putnam, Hari Angepat, Jeremy Fowers, Michael Haselman, Stephen Heil, Matt Humphrey, Puneet Kaur, Joo-Young Kim, et al. A cloud-scale acceleration architecture. In 2016 49th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO), pages 1--13. IEEE, 2016.

Digital Library

[7]

Richard Cziva, Christos Anagnostopoulos, and Dimitrios P Pezaros. Dynamic, latency-optimal vnf placement at the network edge. In Ieee infocom 2018-ieee conference on computer communications, pages 693--701. IEEE, 2018.

[8]

J. Duato, A. J. Peña, F. Silla, R. Mayo, and E. S. Quintana-Ortí. rcuda: Reducing the number of gpu-based accelerators in high performance clusters. In 2010 International Conference on High Performance Computing Simulation, pages 224--231, June 2010.

[9]

Abdessalam Elhabbash, Assylbek Jumagaliyev, Gordon S Blair, and Yehia Elkhatib. Slo-ml: A language for service level objective modelling in multi-cloud applications. In Proceedings of the 12th IEEE/ACM International Conference on Utility and Cloud Computing, pages 241--250, 2019.

Digital Library

[10]

Daniel Firestone, Andrew Putnam, Sambhrama Mundkur, Derek Chiou, Alireza Dabagh, Mike Andrewartha, Hari Angepat, Vivek Bhanu, Adrian Caulfield, Eric Chung, et al. Azure accelerated networking: Smartnics in the public cloud. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18), pages 51--66, 2018.

[11]

Rohan Gandhi, Hongqiang Harry Liu, Y Charlie Hu, Guohan Lu, Jitendra Padhye, Lihua Yuan, and Ming Zhang. Duet: Cloud scale load balancing with hardware and software. ACM SIGCOMM Computer Communication Review, 44(4):27--38, 2015.

Digital Library

[12]

Aaron Gember-Jacobson, Raajay Viswanathan, Chaithan Prakash, Robert Grandl, Junaid Khalid, Sourav Das, and Aditya Akella. OpenNF: Enabling innovation in network function control. In Proceedings of ACM SIGCOMM, 2014.

[13]

Racha Gouareb, Vasilis Friderikos, and Abdol-Hamid Aghvami. Virtual network functions routing and placement for edge cloud latency minimization. IEEE Journal on Selected Areas in Communications, 36(10):2346--2357, 2018.

Digital Library

[14]

Arpit Gupta, Rob Harrison, Marco Canini, Nick Feamster, Jennifer Rexford, and Walter Willinger. Sonata: query-driven streaming network telemetry. In Proceedings of ACM SIGCOMM, 2018.

[15]

Mark Handley, Costin Raiciu, Alexandru Agache, Andrei Voinescu, Andrew W. Moore, Gianni Antichi, and Marcin Wójcik. Re-architecting datacenter networks and stacks for low latency and high performance. In Proceedings of ACM SIGCOMM, 2017.

Digital Library

[16]

Rishabh Iyer, Luis Pedrosa, Arseniy Zaostrovnykh, Solal Pirelli, Katerina Argyraki, and George Candea. Performance contracts for software network functions. In 16th USENIX Symposium on Networked Systems Design and Implementation (NSDI 19), pages 517--530, Boston, MA, February 2019. USENIX Association.

[17]

Lavanya Jose, Lisa Yan, George Varghese, and Nick McKeown. Compiling packet programs to reconfigurable switches. In Proceedings of USENIX/ACM NSDI, 2015.

[18]

Georgios P. Katsikas, Tom Barbette, Dejan Kostić, Rebecca Steinert, and Gerald Q. Maguire Jr. Metron: NFV service chains at the true speed of the underlying hardware. In Proceedings of USENIX/ACM NSDI, 2018.

[19]

Naga Katta, Mukesh Hira, Changhoon Kim, Anirudh Sivaraman, and Jennifer Rexford. Hula: Scalable load balancing using programmable data planes. In Proceedings of the Symposium on SDN Research, 2016.

Digital Library

[20]

Joongi Kim, Keon Jang, Keunhong Lee, Sangwook Ma, Junhyun Shim, and Sue Moon. NBA (network balancing act): A high-performance packet processing framework for heterogeneous processors. In Proceedings of the Tenth European Conference on Computer Systems, 2015.

Digital Library

[21]

Surendra Kumar, Mudassir Tufail, Sumandra Majee, Claudiu Captari, and Shunsuke Homma. Service Function Chaining Use Cases In Data Centers. Internet-Draft draft-ietf-sfc-dc-use-cases-06, Internet Engineering Task Force, February 2017. Work in Progress.

[22]

Tung-Wei Kuo, Bang-Heng Liou, Kate Ching-Ju Lin, and Ming-Jer Tsai. Deploying chains of virtual network functions: On the relation between link and server usage. In Proceedings of IEEE INFOCOM, 2016.

Digital Library

[23]

Abdelquoddouss Laghrissi, Tarik Taleb, Miloud Bagaa, and Hannu Flinck. Towards edge slicing: Vnf placement algorithms for a dynamic & realistic edge cloud environment. In GLOBECOM 2017-2017 IEEE Global Communications Conference, pages 1--6. IEEE, 2017.

[24]

Yanfang Le, Hyunseok Chang, Sarit Mukherjee, Limin Wang, Aditya Akella, Michael M Swift, and TV Lakshman. UNO: unifying host and smart NIC offload for flexible packet processing. In Proceedings of ACM SoCC, 2017.

[25]

Bojie Li, Kun Tan, Layong Larry Luo, Yanqing Peng, Renqian Luo, Ningyi Xu, Yongqiang Xiong, Peng Cheng, and Enhong Chen. ClickNP: Highly flexible and high performance network processing with reconfigurable hardware. In Proceedings of ACM SIGCOMM, 2016.

[26]

John W Lockwood, Nick McKeown, Greg Watson, Glen Gibb, Paul Hartke, Jad Naous, Ramanan Raghuraman, and Jianying Luo. Netfpga-an open platform for gigabit-rate network switching and routing. In Microelectronic Systems Education, 2007. MSE'07. IEEE International Conference on, pages 160--161. IEEE, 2007.

Digital Library

[27]

Rui Miao, Hongyi Zeng, Changhoon Kim, Jeongkeun Lee, and Minlan Yu. SilkRoad: Making Stateful Layer-4 Load Balancing Fast and Cheap Using Switching ASICs. In Proceedings of ACM SIGCOMM, 2017.

[28]

Ali Mohammadkhan, Sheida Ghapani, Guyue Liu, Wei Zhang, KK Ramakrishnan, and Timothy Wood. Virtual function placement and traffic steering in flexible and dynamic software defined networks. In Local and Metropolitan Area Networks (LANMAN), 2015 IEEE International Workshop on, 2015.

[29]

Barefoot Networks. The world's fastest & most programmable networks. https://barefootnetworks.com/resources/worlds-fastest-most-programmable-networks/.

[30]

Yoav Nir and Adam Langley. ChaCha20 and Poly1305 for IETF Protocols. RFC 8439, June 2018.

[31]

Network Operators. Network functions virtualization, an introduction, benefits, enablers, challenges and call for action. In SDN and OpenFlow SDN and OpenFlow World Congress, 2012.

[32]

Shoumik Palkar, Chang Lan, Sangjin Han, Keon Jang, Aurojit Panda, Sylvia Ratnasamy, Luigi Rizzo, and Scott Shenker. E2: A framework for nfv applications. In Proceedings of ACM SOSP, 2015.

[33]

Aurojit Panda, Sangjin Han, Keon Jang, Melvin Walls, Sylvia Ratnasamy, and Scott Shenker. Netbricks: Taking the v out of NFV. In Proceedings of USENIX/ACM OSDI, 2016.

[34]

Chuan Pham, Nguyen H Tran, Shaolei Ren, Walid Saad, and Choong Seon Hong. Traffic-aware and energy-efficient vnf placement for service chaining: Joint sampling and matching approach. IEEE Transactions on Services Computing, 2017.

[35]

Paul Quinn, Uri Elzur, and Carlos Pignataro. Network Service Header (NSH). RFC 8300, January 2018.

[36]

T. Shimokawabe, T. Aoki, C. Muroi, J. Ishida, K. Kawano, T. Endo, A. Nukada, N. Maruyama, and S. Matsuoka. An 80-fold speedup, 15.0 tflops full gpu acceleration of non-hydrostatic weather model asuca production code. In SC '10: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, pages 1--11, Nov 2010.

Digital Library

[37]

Hardik Soni, Myriana Rifai, Praveen Kumar, Ryan Doenges, and Nate Foster. Composing dataplane programs with μp4. In Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the applications, technologies, architectures, and protocols for computer communication, pages 329--343, 2020.

Digital Library

[38]

Speeding up and strengthening HTTPS connections for Chrome on Android. https://security.googleblog.com/2014/04/speeding-up-and-strengthening-https.html, 2014.

[39]

Chen Sun, Jun Bi, Zili Meng, Xiao Zhang, and Hongxin Hu. Ofm: Optimized flow migration for nfv elasticity control. In 2018 IEEE/ACM 26th International Symposium on Quality of Service (IWQoS), pages 1--10. IEEE, 2018.

[40]

Chen Sun, Jun Bi, Zhilong Zheng, Heng Yu, and Hongxin Hu. Nfp: Enabling network function parallelism in nfv. In Proceedings of ACM SIGCOMM, 2017.

[41]

Amin Tootoonchian, Aurojit Panda, Chang Lan, Melvin Walls, Katerina Argyraki, Sylvia Ratnasamy, and Scott Shenker. Resq: Enabling slos in network function virtualization. In Proceedings of USENIX/ACM NSDI, 2018.

[42]

Marcos A. M. Vieira, Matheus S. Castanho, Racyus D. G. Pacífico, Elerson R. S. Santos, Eduardo P. M. Câmara Júnior, and Luiz F. M. Vieira. Fast packet processing with ebpf and xdp: Concepts, code, challenges, and applications. ACM Comput. Surv., 53(1), February 2020.

[43]

Shuhe Wang, Zili Meng, Chen Sun, Minhu Wang, Mingwei Xu, Jun Bi, Tong Yang, Qun Huang, and Hongxin Hu. Smartchain: Enabling high-performance service chain partition between smartnic and cpu. In ICC 2020-2020 IEEE International Conference on Communications (ICC), pages 1--7. IEEE, 2020.

[44]

Shinae Woo, Justine Sherry, Sangjin Han, Sue Moon, Sylvia Ratnasamy, and Scott Shenker. Elastic scaling of stateful network functions. In Proceedings of USENIX/ACM NSDI, 2018.

[45]

Kai Zhang, Bingsheng He, Jiayu Hu, Zeke Wang, Bei Hua, Jiayi Meng, and Lishan Yang. G-NET: Effective GPU Sharing in NFV Systems. In Proceedings of USENIX/ACM NSDI, 2018.

[46]

Peng Zheng, Arvind Narayanan, and Zhi-Li Zhang. A closer look at nfv execution models. In Proceedings of the 3rd Asia-Pacific Workshop on Networking 2019, pages 85--91, 2019.

Digital Library

[47]

Zhilong Zheng, Jun Bi, Haiping Wang, Chen Sun, Heng Yu, Hongxin Hu, Kai Gao, and Jianping Wu. Grus: Enabling latency slos for gpu-accelerated nfv systems. In 2018 IEEE 26th International Conference on Network Protocols (ICNP), pages 154--164. IEEE, 2018.

Cited By

Pacífico RDuarte LVieira LRaghavan BNacif JVieira M(2024)eBPFlow: A Hardware/Software Platform to Seamlessly Offload Network Functions Leveraging eBPFIEEE/ACM Transactions on Networking10.1109/TNET.2023.331825132:2(1319-1332)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1109/TNET.2023.3318251
Harkous HHosn BHe MJarschel MPries RKellerer W(2023)Performance-Aware Orchestration of P4-Based Heterogeneous Cloud EnvironmentsIEEE Transactions on Network and Service Management10.1109/TNSM.2023.326798320:4(4765-4778)Online publication date: Dec-2023
https://doi.org/10.1109/TNSM.2023.3267983
Li MLing PWen SChen XWen F(2023)Bubble-Wave-Mitigation Algorithm and Transformer-Based Neural Network Demodulator for Water-Air Optical Camera CommunicationsIEEE Photonics Journal10.1109/JPHOT.2023.330269015:5(1-10)Online publication date: Oct-2023
https://doi.org/10.1109/JPHOT.2023.3302690
Show More Cited By

Index Terms

Meeting SLOs in cross-platform NFV
1. Networks
  1. Network components
    1. Middle boxes / network appliances

Recommendations

NFP: Enabling Network Function Parallelism in NFV
SIGCOMM '17: Proceedings of the Conference of the ACM Special Interest Group on Data Communication

Software-based sequential service chains in Network Function Virtualization (NFV) could introduce significant performance overhead. Current acceleration efforts for NFV mainly target on optimizing each component of the sequential service chain. However, ...
A flexible and efficient container-based NFV platform for middlebox networking
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing

Network Function Virtualization (NFV) enables multiple network functions (NFs) to operate simultaneously on a commodity server. Internet Data Centers (IDCs) gain significant flexibility and agility through NFV's ability to dynamically deploy and ...
High-Performance vNIC Framework for Hypervisor-Based NFV with Userspace vSwitch
EWSDN '15: Proceedings of the 2015 Fourth European Workshop on Software Defined Networks

We propose a high-performance virtual network interface card framework for hypervisor-based NFV with user space virtual switch. We extend the virtio-net framework to achieve high-performance I/O and to provide DPDK-compatible APIs for a DPDK-enabled NFV ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '20: Proceedings of the 16th International Conference on emerging Networking EXperiments and Technologies

November 2020

585 pages

ISBN:9781450379489

DOI:10.1145/3386367

Program Chairs:
Dongsu Han
KAIST, South Korea
,
Anja Feldmann
MPI, Germany

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 November 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Author Tags

Qualifiers

Research-article

Funding Sources

National Science Foundation
Cisco Systems
VMware
Intel Corporation

Conference

CoNEXT '20

Sponsor:

SIGCOMM

CoNEXT '20: The 16th International Conference on emerging Networking EXperiments and Technologies

December 1 - 4, 2020

Barcelona, Spain

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
461
Total Downloads

Downloads (Last 12 months)40
Downloads (Last 6 weeks)2

Reflects downloads up to 30 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pacífico RDuarte LVieira LRaghavan BNacif JVieira M(2024)eBPFlow: A Hardware/Software Platform to Seamlessly Offload Network Functions Leveraging eBPFIEEE/ACM Transactions on Networking10.1109/TNET.2023.331825132:2(1319-1332)Online publication date: 1-Apr-2024
https://dl.acm.org/doi/10.1109/TNET.2023.3318251
Harkous HHosn BHe MJarschel MPries RKellerer W(2023)Performance-Aware Orchestration of P4-Based Heterogeneous Cloud EnvironmentsIEEE Transactions on Network and Service Management10.1109/TNSM.2023.326798320:4(4765-4778)Online publication date: Dec-2023
https://doi.org/10.1109/TNSM.2023.3267983
Li MLing PWen SChen XWen F(2023)Bubble-Wave-Mitigation Algorithm and Transformer-Based Neural Network Demodulator for Water-Air Optical Camera CommunicationsIEEE Photonics Journal10.1109/JPHOT.2023.330269015:5(1-10)Online publication date: Oct-2023
https://doi.org/10.1109/JPHOT.2023.3302690
Chen HZakeri AWen FBarkam HImani M(2023)HyperGRAF: Hyperdimensional Graph-Based Reasoning Acceleration on FPGA2023 33rd International Conference on Field-Programmable Logic and Applications (FPL)10.1109/FPL60245.2023.00013(34-41)Online publication date: 4-Sep-2023
https://doi.org/10.1109/FPL60245.2023.00013
Tange WWang CYao PWu RFu XFan GZhang C(2023)DCLINK: Bridging Data Constraint Changes and Implementations in FinTech Systems2023 38th IEEE/ACM International Conference on Automated Software Engineering (ASE)10.1109/ASE56229.2023.00170(914-925)Online publication date: 11-Sep-2023
https://doi.org/10.1109/ASE56229.2023.00170
Wang JLévai TLi ZVieira MGovindan RRaghavan BGavrilovska AAltınbüken DBinnig C(2022)QuadrantProceedings of the 13th Symposium on Cloud Computing10.1145/3542929.3563471(493-509)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3542929.3563471
Carvalho FFerreira RCunha IVieira MRamanathan M(2022)Dyssect: Dynamic Scaling of Stateful Network FunctionsIEEE INFOCOM 2022 - IEEE Conference on Computer Communications10.1109/INFOCOM48880.2022.9796848(1529-1538)Online publication date: 2-May-2022
https://doi.org/10.1109/INFOCOM48880.2022.9796848
Krude JRüth JSchemmel DRath FFolbort IWehrle KCarle GOtt J(2021)Determination of throughput guarantees for processor-based SmartNICsProceedings of the 17th International Conference on emerging Networking EXperiments and Technologies10.1145/3485983.3494842(267-281)Online publication date: 2-Dec-2021
https://dl.acm.org/doi/10.1145/3485983.3494842
Ni ZWei CWood TChoi N(2021)A SmartNIC-based Load Balancing and Auto Scaling Framework for Middlebox Edge Server2021 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN)10.1109/NFV-SDN53031.2021.9665167(21-27)Online publication date: 9-Nov-2021
https://doi.org/10.1109/NFV-SDN53031.2021.9665167

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents