research-article

Parallel Simulation and Virtual-Machine-Based Emulation of Software-Defined Networks

Authors:

David M. NicolAuthors Info & Claims

ACM Transactions on Modeling and Computer Simulation (TOMACS), Volume 26, Issue 1

Article No.: 8, Pages 1 - 27

https://doi.org/10.1145/2834116

Published: 28 December 2015 Publication History

Abstract

The emerging software-defined networking (SDN) technology decouples the control plane from the data plane in a computer network with open and standardized interfaces, and hence opens up the network designers’ options and ability to innovate. The wide adoption of SDN in industry has motivated the development of large-scale, high-fidelity testbeds for evaluation of systems that incorporate SDN. In this article, we develop a framework to support OpenFlow-based SDN simulation and distributed emulation, by leveraging our prior work on a hybrid network testbed with a parallel network simulator and a virtual-machine-based emulation system. We show how to exploit typical SDN controller behaviors to handle performance issues caused by the centralized controller in parallel discrete-event simulation. In particular, we develop an asynchronous synchronization algorithm for passive SDN controllers and design a two-level architecture for active SDN controllers. We evaluate the system performance, showing good scalability. Finally, we present a case study, using the testbed, to evaluate network verification applications in an SDN-based data center network.

References

[1]

Ehab Al-Shaer, Will Marrero, Adel El-Atawy, and Khalid ElBadawi. 2009. Network configuration in a box: Towards end-to-end verification of network reachability and security. In Proceedings of the 17th IEEE International Conference on Network Protocols (ICNP). 123--132.

Digital Library

[2]

George Apostolopoulos and Constantinos Hassapis. 2006. V-eM: A cluster of virtual machines for robust, detailed, and high-performance network emulation. In Proceedings of the Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS). IEEE, 117--126.

Digital Library

[3]

Rassul Ayani. 1988. A parallel simulation scheme based on distances between objects. Royal Institute of Technology, Department of Telecommunication Systems-Computer Systems (1988).

[4]

Craig Bergstrom, Srinidhi Varadarajan, and Godmar Back. 2006. The distributed open network emulator: Using relativistic time for distributed scalable simulation. In Proceedings of the 20th Workshop on Principles of Advanced and Distributed Simulation (PADS). IEEE, 19--28.

Digital Library

[5]

Pratik K. Biswas, Constantin Serban, Alex Poylisher, John Lee, Siun-Chuon Mau, Ritu Chadha, Cho-Yu J. Chiang, Robert Orlando, and Kimberly Jakubowski. 2009. An integrated testbed for virtual ad hoc networks. In Proceedings of the International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities. IEEE Computer Society, Los Alamitos, CA, 1--10.

[6]

K. Mani Chandy and Jayadev Misra. 1979. Distributed simulation: A case study in design and verification of distributed programs. IEEE Transactions on Software Engineering 5 (1979), 440--452.

Digital Library

[7]

Phillip M. Dickens, Philip Heidelberger, and David M. Nicol. 1994. A distributed memory LAPSE: Parallel simulation of message-passing programs. In Proceedings of the 8th Workshop on Parallel and Distributed Simulation (PADS’94). ACM, New York, NY, 32--38.

Digital Library

[8]

Miguel A. Erazo, Yue Li, and Jason Liu. 2009. SVEET! a scalable virtualized evaluation environment for TCP. In Proceedings of 5th International Conference on Testbeds and Research Infrastructures for the Development of Networks & Communities and Workshops (TridentCom). IEEE, 1--10.

[9]

Google. 2011. Inter-Datacenter WAN with centralized TE using SDN and OpenFlow. (2011). Retrieved from https://www.opennetworking.org/images/stories/downloads/misc/googlesdn.pdf.

[10]

Andreas Grau, Steffen Maier, Klaus Herrmann, and Kurt Rothermel. 2008. Time jails: A hybrid approach to scalable network emulation. In Proceedings of the 22nd Workshop on Principles of Advanced and Distributed Simulation (PADS). IEEE, 7--14.

Digital Library

[11]

Diwaker Gupta, Kashi V. Vishwanath, and Amin Vahdat. 2008. DieCast: Testing distributed systems with an accurate scale model. In Proceedings of the 5th USENIX Symposium on Networked Systems Design and Implementation (NSDI). USENIX Association, Berkeley, CA, 407--422.

Digital Library

[12]

Diwaker Gupta, Kenneth Yocum, Marvin McNett, Alex C. Snoeren, Amin Vahdat, and Geoffrey M. Voelker. 2005. To infinity and beyond: Time warped network emulation. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP’05). ACM, New York, NY, 1--2.

Digital Library

[13]

Nikhil Handigol, Brandon Heller, Vimalkumar Jeyakumar, Bob Lantz, and Nick McKeown. 2012. Reproducible network experiments using container-based emulation. In Proceedings of the 8th International Conference on Emerging Networking Experiments and Technologies. ACM, 253--264.

Digital Library

[14]

Brandon Heller. 2013. Reproducuble Network Research with High-Fidelity Emulation. Ph.D. Dissertation. Stanford University.

[15]

Dong Jin and David M. Nicol. 2010. Fast simulation of background traffic through fair queueing networks. In Proceedings of the 2010 Winter Simulation Conference (WSC’10). 2935--2946.

Digital Library

[16]

Dong Jin and David M. Nicol. 2013. Parallel simulation of software defined networks. In Proceedings of the 2013 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. ACM, 91--102.

Digital Library

[17]

Dong Jin, Yuhao Zheng, Huaiyu Zhu, David M. Nicol, and Lenhard Winterrowd. 2012. Virtual time integration of emulation and parallel simulation. In Proceedings of the 2012 Workshop on Principles of Advanced and Distributed Simulation (PADS’12). 120--130.

Digital Library

[18]

Peyman Kazemian, Michael Chang, Hongyi Zeng, George Varghese, Nick McKeown, and Scott Whyte. 2013. Real time network policy checking using header space analysis. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation (NSDI’13). USENIX Association, Berkeley, CA, 99--112.

Digital Library

[19]

Peyman Kazemian, George Varghese, and Nick McKeown. 2012. Header space analysis: Static checking for networks. In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI’12). USENIX Association, Berkeley, CA, 1.

Digital Library

[20]

Ahmed Khurshid, Xuan Zou, Wenxuan Zhou, Matthew Caesar, and P. Brighten Godfrey. 2013. VeriFlow: Verifying network-wide Invariants in real time. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation (NSDI’13).

Digital Library

[21]

Jereme Lamps, David M. Nicol, and Matthew Caesar. 2014. TimeKeeper: A lightweight virtual time system for linux. In Proceedings of the 2nd ACM SIGSIM Conference on Principles of Advanced Discrete Simulation. ACM, 179--186.

Digital Library

[22]

Bob Lantz, Brandon Heller, and Nick McKeown. 2010. A network in a laptop: Rapid prototyping for software-defined networks. In Proceedings of the 9th ACM SIGCOMM Workshop on Hot Topics in Networks.

Digital Library

[23]

Jason Liu, Raju Rangaswami, and Ming Zhao. 2010. Model-driven network emulation with virtual time machine. In Proceedings of the 2010 Winter Simulation Conference (WSC’10). IEEE, 688--696.

Digital Library

[24]

Boris D. Lubachevsky. 1989. Efficient distributed event-driven simulations of multiple-loop networks. Communications of the ACM 32, 1 (1989), 111--123.

Digital Library

[25]

LXC. 2013. Linux Containers. Retrieved from https://linuxcontainers.org.

[26]

Haohui Mai, Ahmed Khurshid, Rachit Agarwal, Matthew Caesar, P. Brighten Godfrey, and Samuel Talmadge King. 2011. Debugging the data plane with Anteater. In Proceedings of the ACM SIGCOMM Computer Communication Review (SIGCOMM’11). ACM, New York, NY, 290--301.

Digital Library

[27]

Steffen Maier, Andreas Grau, Harald Weinschrott, and Kurt Rothermel. 2007. Scalable network emulation: A comparison of virtual routing and virtual machines. In Proceedings of the 12th IEEE Symposium on Computers and Communications (ISCC’07). 395--402.

[28]

Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. 2008. OpenFlow: Enabling innovation in campus networks. ACM SIGCOMM Computer Communication Review 38, 2 (2008), 69--74.

Digital Library

[29]

David Nicol and Guanhua Yan. 2006. High-performance simulation of low-resolution network flows. Journal of Simulation 82, 1 (2006), 21--42.

Digital Library

[30]

David M. Nicol. 1993. The cost of conservative synchronization in parallel discrete event simulations. Journal of the ACM (JACM) 40, 2 (1993), 304--333.

Digital Library

[31]

David M. Nicol, D. Jin, and Y. Zheng. 2011. S3F: The scalable simulation framework revisited. In Proceedings of the 2011 Winter Simulation Conference. Phoenix, AZ.

Digital Library

[32]

David M. Nicol and Jason Liu. 2002. Composite synchronization in parallel discrete-event simulation. IEEE Transactions on Parallel and Distributed Systems 13, 5 (2002), 433--446.

Digital Library

[33]

ns-3. 2011. The ns-3 Project. Retrieved from http://www.nsnam.org.

[34]

ns-3. 2013. Link Modeling Using ns 3. Retrieved from https://github.com/mininet/mininet/wiki/Link-modeling-using-ns-3.

[35]

ns-3 OpenFlow Model. 2011. ns-3 OpenFlow Switch Support. Retrieved from http://www.nsnam.org/docs/release/3.13/models/html/openflow-switch.html.

[36]

OFTest. 2011. OFTest, a Python Based OpenFlow Switch Test Framework. Retrieved from http://www.openflow.org/wk/index.php/OFTestTutorial.

[37]

Open vSwitch. 2011. An Open Virtual Switch. Retrieved from http://openvswitch.org/.

[38]

OpenFlow. 2011. OpenFlow Switch Specification Version 1.1.0. Retrieved from http://www.openflow.org/documents/openflow-spec-v1.1.0.pdf.

[39]

OpenVZ. 2006. OpenVZ Linux Containers. Retrieved from http://wiki.openvz.org.

[40]

POX. 2011. Python OpenFlow Controller. Retrieved from http://www.noxrepo.org/pox/about-pox/.

[41]

QEMU. 2009. QEMU, Open Source Processor Emulator. Retrieved from http://wiki.qemu.org/.

[42]

Rob Sherwood. 2011. OFlops. Retrieved from http://www.openflow.org/wk/index.php/Oflops.

[43]

Rob Simmonds, Cameron Kiddle, and Brian Unger. 2002. Addressing blocking and scalability in critical channel traversing. In Proceedings of the 16th Workshop on Parallel and Distributed Simulation (PADS’02). IEEE Computer Society, Washington, DC, 17--24.

Digital Library

[44]

SSF. 1999. SSF: Scalable Simulation Framework. Retrieved from http://www.ssfnet.org/.

[45]

Stanford University. 2009. OpenFlow Switching Reference System. Retrieved from http://www.openflow.org/wp/downloads/.

[46]

Stanford University. 2012. Mininet: An Instant Virtual Network on Your Laptop (or Other PC). Retrieved from http://mininet.org/.

[47]

UML. 2006. The User-Mode Linux Kernel. Retrieved from http://user-mode-linux.sourceforge.net.

[48]

University of Illinois at Urbana-Champaign. 2013. Ocean Cluster for Experimental Architectures in Networks (OCEAN). Retrieved from http://ocean.cs.illinois.edu/.

[49]

University of Oregon. 2005. Route Views Project. Retrieved from http://www.routeviews.org/.

[50]

University of Washington. 2002. Rocketfuel: An ISP Topology Mapping Engine. Retrieved from http://www.cs.washington.edu/research/rocketfuel/.

[51]

Virtuozzo. 2012. Parallel Virtuozzo Containers. Retrieved from http://www.parallels.com/products/pvc46.

[52]

VMware. 1998. VMware virtualization software. (1998). Retrieved from http://www.vmware.com

[53]

Andrew Whitaker, Marianne Shaw, and Steven D. Gribble. 2002. Scale and performance in the Denali isolation kernel. In Proceedings of the 5th Symposium on Operating Systems Design and Implementation (OSDI'02), ACM Operating Systems Review, Winter 2002 Special Issue, 195--210, Boston, MA, USA.

Digital Library

[54]

Brian White, Jay Lepreau, Leigh Stoller, Robert Ricci, Shashi Guruprasad, Mac Newbold, Mike Hibler, Chad Barb, and Abhijeet Joglekar. 2002. An integrated experimental environment for distributed systems and networks. ACM SIGOPS Operating Systems Review 36, SI (2002), 255--270.

Digital Library

[55]

Xen. 2013. The Xen Project. Retrieved from http://www.xenproject.org.

[56]

Zhonge Xiao, Brian W. Unger, Rob Simmonds, and John Cleary. 1999. Scheduling critical channels in conservative parallel discrete event simulation. In Proceedings of the 13th Workshop on Parallel and Distributed Simulation. 20--28.

Digital Library

[57]

Srikanth B. Yoginath, Kalyan S. Perumalla, and Brian J. Henz. 2012. Taming wild horses: The need for virtual time-based scheduling of VMs in network simulations. In Proceedings of the 20th International Symposium on Modeling, Analysis & Simulation of Computer and Telecommunication Systems (MASCOTS). IEEE, 68--77.

Digital Library

[58]

Yuhao Zheng, Dong Jin, and David M. Nicol. 2013. Impacts of application lookahead on distributed network emulation. In Proceedings of the 2013 Winter Simulation Conference (WSC’13).

Digital Library

[59]

Yuhao Zheng, David M. Nicol, Dong Jin, and Naoki Tanaka. 2011. A virtual time system for virtualization-based network emulation and simulation. Journal of Simulation 6, 3, 205--213.

Cited By

Li JZhang Z(2023)A versatile dynamic noise control framework based on computer simulation and modelingNonlinear Engineering10.1515/nleng-2022-027212:1Online publication date: 7-Jun-2023
https://doi.org/10.1515/nleng-2022-0272
Babu VNicol D(2022)Temporally synchronized emulation of devices with simulation of networksProceedings of the 2022 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3518997.3531020(1-12)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3518997.3531020
Babu VNicol D(2022)Mechanisms for Precise Virtual Time Advancement in Network EmulationACM Transactions on Modeling and Computer Simulation10.1145/347886732:2(1-26)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3478867
Show More Cited By

Index Terms

Parallel Simulation and Virtual-Machine-Based Emulation of Software-Defined Networks
1. Computing methodologies
  1. Modeling and simulation
    1. Simulation support systems
      1. Simulation tools
2. Networks
  1. Network performance evaluation
    1. Network simulations

Recommendations

Parallel simulation of software defined networks
SIGSIM PADS '13: Proceedings of the 1st ACM SIGSIM Conference on Principles of Advanced Discrete Simulation

Existing network architectures fall short when handling networking trends, e.g., mobility, server virtualization, and cloud computing, as well as market requirements with rapid changes. Software-defined networking (SDN) is designed to transform network ...
High-fidelity switch models for software-defined network emulation
HotSDN '13: Proceedings of the second ACM SIGCOMM workshop on Hot topics in software defined networking

Software defined networks (SDNs) depart from traditional network architectures by explicitly allowing third-party software access to the network's control plane. Thus, SDN protocols such as OpenFlow give network operators the ability to innovate by ...
A survey on OpenFlow-based Software Defined Networks

Software-Defined Networking (SDN) has been proposed as an emerging network architecture, which consists of decoupling the control planes and data planes of a network. Due to its openness and standardization, SDN enables researchers to design and ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Modeling and Computer Simulation

ACM Transactions on Modeling and Computer Simulation Volume 26, Issue 1

Special Issue on PADS

December 2015

210 pages

ISSN:1049-3301

EISSN:1558-1195

DOI:10.1145/2798338

Editor:
Adelinde M. Uhrmacher
University of Rostock, Germany

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 December 2015

Accepted: 01 August 2015

Revised: 01 May 2015

Received: 01 January 2014

Published in TOMACS Volume 26, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Maryland Procurement Office
Air Force Office of Scientific Research (AFOSR)
Maryland Procurement Office and AFOSR

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
332
Total Downloads

Downloads (Last 12 months)47
Downloads (Last 6 weeks)2

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li JZhang Z(2023)A versatile dynamic noise control framework based on computer simulation and modelingNonlinear Engineering10.1515/nleng-2022-027212:1Online publication date: 7-Jun-2023
https://doi.org/10.1515/nleng-2022-0272
Babu VNicol D(2022)Temporally synchronized emulation of devices with simulation of networksProceedings of the 2022 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3518997.3531020(1-12)Online publication date: 8-Jun-2022
https://dl.acm.org/doi/10.1145/3518997.3531020
Babu VNicol D(2022)Mechanisms for Precise Virtual Time Advancement in Network EmulationACM Transactions on Modeling and Computer Simulation10.1145/347886732:2(1-26)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3478867
Darville JCuria JCelik N(2022)Microgrid Operational Planning using a Hybrid Neural Network with Resource-aware Scenario SelectionSimulation Modelling Practice and Theory10.1016/j.simpat.2022.102583119(102583)Online publication date: Sep-2022
https://doi.org/10.1016/j.simpat.2022.102583
Damgacioglu HBastani MCelik N(2021)A Dynamic Data-Driven Optimization Framework for Demand Side Management in MicrogridsHandbook of Dynamic Data Driven Applications Systems10.1007/978-3-030-74568-4_21(497-512)Online publication date: 12-Jun-2021
https://doi.org/10.1007/978-3-030-74568-4_21
Damgacioglu HCelik EYuan CCelik N(2021)Dynamic Data Driven Application Systems for Identification of Biomarkers in DNA MethylationHandbook of Dynamic Data Driven Applications Systems10.1007/978-3-030-74568-4_12(241-261)Online publication date: 12-Jun-2021
https://doi.org/10.1007/978-3-030-74568-4_12
Yavuz ADarville JCelik NXu JChen CLanghals BEngle R(2020)Advancing self-healing capabilities in interconnected microgrids via dynamic data driven applications system with relational database managementProceedings of the Winter Simulation Conference10.5555/3466184.3466414(2030-2041)Online publication date: 14-Dec-2020
https://dl.acm.org/doi/10.5555/3466184.3466414
Babu VNicol DLiu JGiabbanelli PCarothers C(2020)Precise Virtual Time Advancement for Network EmulationProceedings of the 2020 ACM SIGSIM Conference on Principles of Advanced Discrete Simulation10.1145/3384441.3395978(175-186)Online publication date: 15-Jun-2020
https://dl.acm.org/doi/10.1145/3384441.3395978
Yavuz ADarville JCelik NXu JChen CLanghals BEngle R(2020)Advancing Self-Healing Capabilities in Interconnected Microgrids via Dynamic Data Driven Applications System with Relational Database Management2020 Winter Simulation Conference (WSC)10.1109/WSC48552.2020.9384082(2030-2041)Online publication date: 14-Dec-2020
https://doi.org/10.1109/WSC48552.2020.9384082
Babu VNicol DJohansson BJain S(2018)On repeatable emulation in virtual testbedsProceedings of the 2018 Winter Simulation Conference10.5555/3320516.3320972(3813-3824)Online publication date: 9-Dec-2018
https://dl.acm.org/doi/10.5555/3320516.3320972
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents