research-article

Virtual network on demand: dedicating network resources to distributed scientific workflows

Authors:

Dimitrios Katramatos,

Sushant Sharma,

Dantong YuAuthors Info & Claims

DIDC '12: Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date

Pages 53 - 62

https://doi.org/10.1145/2286996.2287006

Published: 19 June 2012 Publication History

Abstract

The VNOD project aims to build an on-demand network virtualization infrastructure that can deliver the unprecedented networking performance and quality of service required by modern, distributed, data-intensive applications utilized by user communities. Recent networking technologies, already deployed in production and/or in experimental phases, offer the capability to dynamically provision network resources interconnecting multiple end sites hosting storage and computing resources. The VNOD infrastructure described in this paper leverages these technologies to provide an environment that facilitates the establishment and management of virtual network topologies. At the same time, VNOD also offers a platform for co-scheduling end-site resources with local and wide-area network resources through the use of various algorithms and optimization objectives.

References

[1]

D.G. Andersen, H. Balakrishnan, M. Kaashoek, and R. Morris, "Resilient overlay networks," In Proc. ACM SOSP, pp. 131--145, Banff, Canada, 2001.

Digital Library

[2]

ARCHSTONE: Advanced Resource Computation for Hybrid Service and TOpology NEtworkshttp://archstone.east.isi.edu

[3]

"AutoBAHN: AUTOmated Bandwidth Allocation across Heterogeneous Networks" http://www.geant2.net/server/show/ConWebDoc.2544

[4]

Berkeley Storage Manager (BeStMan):https://sdm.lbl.gov/bestman/

[5]

S. Blake, D. Black, M. Carlson, E. Davies, Z. Wang, and W. Weiss, "An architecture for differentiated service," RFC 2475,1998.

Digital Library

[6]

Y. Cheng, R. Farha, A. Tizghadam, M.S. Kim, M. Hashemi, and A.L. Garcia, "Virtual network approach to scalable IP service deployment and efficient resource management," IEEE Communications Magazine, pp.76--84, October 2005.

Digital Library

[7]

ESCPS: The End Site Control Plane Service project:https://plone3.fnal.gov/P0/ESCPS

[8]

"Energy sciences network,"http://www.es.net/

[9]

"ESnet Topology,"http://www.es.net/network/

[10]

"The GÈANT2 network,"http://www.geant2.net/

[11]

J. Gu, D. Katramatos, X. Liu, V. Natarajan, A. Shoshani, A. Sim,D. Yu, S. Bradley, and S. McKee,"StorNet: Co-scheduling of end-to-end bandwidth reservation on storage and networksystems for high-performance data transfers," in Proc. IEEE INFOCOM, Workshop on High-Speed Networks,Shanghai, China, April 10-15, 2011.

[12]

I. Houidi, W. Louati, W.B. Ameur, and D. Zeghlache,"Virtual network provisioning across multiple substrate networks," International Journal of Computer and Telecommunications Networking,vol. 55, no. 4, pp. 1011--1023, March 2011.

Digital Library

[13]

"Internet 2,"http://www.internet2.edu/

[14]

"Internet 2--Topology,"http://www.internet2.edu/o-bservatory/archive/datacollections.html\#topology

[15]

X. Jiang and D. Xu, "Violin: Virtual internetworking on overlay infrastructure," In Proc. International Symposium on Parallel and Distributed Processing and Applications,pp.937--946, LNCS 3358, Springer, 2004.

Digital Library

[16]

D. Katramatos, D. Yu, K. Shroff, S. McKee, and T. Robertazzi, "TeraPaths: End-to-end network resource scheduling in high-impact network domains," International Journal On Advances in Internet Technology,vol 3, no. 1--2, pp. 104--117, 2010.

[17]

D. Katramatos, D. Yu, B. Gibbard, S. McKee, "The TeraPaths testbed: Exploring end-to-end network QoS," In Proc. Testbeds and Research Infrastructure for the Development of Networks and Communities, TridentCom,pp. 1--7, May 21--23, 2007

[18]

M.S. Kim, A. Tizghadam, A. Leon-Garcia and J.W.-K. Hong, "Virtual network based autonomic network resource control and management system," In Proc. IEEE Globecom,pp. 1075--1079, 2005.

[19]

"MPLS traffic engineering," http://www.cisco.com/en/US/docs/ios/12$_$0s/feature/ guide/TE$_$1208S.html

[20]

N. McKeown, T. Anderson, H. Balakrishnan, G. Parulkar, L. Peterson, J. Rexford, S. Shenker, and J. Turner,"OpenFlow: enabling innovation in campus networks," ACM SIGCOMM Computer Communication Review,vol 38, no. 2, pp. 69--74, March 2008.

Digital Library

[21]

Network Weather Service and Performance E-Center:https://plone3.fnal.gov/P0/WAN/current-projects/e-center-project/

[22]

"OSCARS: On-Demand Secure Circuits and Advance Reservation System," http://code.google.co-m/p/oscars-idc/

[23]

PerfSONAR: PERFormance Service Oriented Network monitoring ARchitecture:http://www.perfsonar.net

[24]

P. Ruth, X. Jiang, D. Xu and S. Goasguen, "Virtual distributed environments in a shared infrastructure," Computer,vol. 38, issue 5, pp.63--69, May 2005.

Digital Library

[25]

G. Schaffrath, C. Werle, P. Papadimitriou, A. Feldmann, R. Bless, A. Greenhalgh, A. Wundsam, M. Kind, O. Maennel, and L. Mathy, "Network virtualization architecture: proposal and initial prototype," In Proc. 1st ACM workshop on Virtualized infrastructure systems and architectures (VISA),Barcelona, Spain, August 17 2009.

Digital Library

[26]

S. Sharma, D. Katramatos, and D. Yu,"End-to-end network QoS via scheduling of flexible resource reservation requests," In Proc. ACM/IEEE International Conference for High Performance Computing NetworkingStorage and Analysis (Supercomputing),Seattle, WA, November, 12--18, 2011.

Digital Library

[27]

S. Sharma, D. Katramatos, D. Yu, and L. Shi, "Design and implementation of an intelligent end-to-end network QoS system," Technical Report BNL-96957-2012-CP, Brookhaven National Laboratory,February, 27 2012.

Digital Library

[28]

R. Sherwood, G. Gibb, K. Yap, G. Appenzeller, M. Casado, N. McKeown, and G. Parulkar,"Can the production network be the testbed?," In Proc. USENIX OSDI,Vancouver, Canada, October 4--6, 2010.

Digital Library

[29]

A. Shoshani, A. Sim, and J. Gu, Storage resource managers: Essential components for the grid (Book Chapter),Grid Resource Management: State of the Art and Future Trends, Edited by J. Nabrzyski, J.M. Schopf, and J. Weglarz, Kluwer Academic Publishers, 2003.

Digital Library

[30]

StorNet: Co-scheduling Network and Storage with TeraPaths and SRM:https://sdm.lbl.gov/twiki/bin/view/Projects/StorNet /WebHome

[31]

A. Sundararaj and P. Dinda, "Towards virtual networks for virtual machine grid computing," In Proc. Usenix Virtual Machine Technology Symposium,pp. 177--190, 2004.

Digital Library

[32]

The TeraPaths Project:http://www.terapaths.org

[33]

VOMS: Virtual Organization Management Service:http://www.globus.org/grid$_$software/security/voms.php

[34]

J.B. Weissman and B.-D. Lee, "The virtual service grid: An architecture for delivering high-end network services," Concurrency and Computation: Practice and Experience, vol. 14, pp. 287--319, 2002.

Cited By

Barshan MMoens HVolckaert BDe Turck F(2016)A comparative analysis of flexible and fixed size timeslots for advance bandwidth reservations in media production networks2016 7th International Conference on the Network of the Future (NOF)10.1109/NOF.2016.7810118(1-6)Online publication date: Nov-2016
https://doi.org/10.1109/NOF.2016.7810118
Barshan MMoens HVolckaert B(2016)Dynamic adaptive advance bandwidth reservation in media production networks2016 IEEE NetSoft Conference and Workshops (NetSoft)10.1109/NETSOFT.2016.7502443(58-62)Online publication date: Jun-2016
https://doi.org/10.1109/NETSOFT.2016.7502443
Shi LSharma SKatramatos DYu D(2015)Optimizing circuit allocation for bandwidth reservations in dynamic virtual circuit networks2015 International Conference on Computing, Networking and Communications (ICNC)10.1109/ICCNC.2015.7069451(817-823)Online publication date: Feb-2015
https://doi.org/10.1109/ICCNC.2015.7069451
Show More Cited By

Index Terms

Virtual network on demand: dedicating network resources to distributed scientific workflows
1. Networks
  1. Network architectures

Recommendations

Virtio network paravirtualization driver

One of the techniques used to improve I/O performance of virtual machines is paravirtualization. Paravirtualized devices are intended to reduce the performance overhead on full virtualization where all hardware devices are emulated. The interface of a ...
Enabling Instantaneous Relocation of Virtual Machines with a Lightweight VMM Extension
CCGRID '10: Proceedings of the 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing

We are developing an efficient resource management system with aggressive virtual machine (VM) relocation among physical nodes in a data center. Existing live migration technology, however, requires a long time to change the execution host of a VM, it ...
Performance Analysis for Pareto-Optimal Green Consolidation Based on Virtual Machines Live Migration

Huge energy requirement of cloud data centers is prime concern. Dynamic Virtual Machine VM consolidation based on VM live migration to switched-off or put some of the under-loaded host Physical Machines PMs into a low power consumption mode can ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

DIDC '12: Proceedings of the fifth international workshop on Data-Intensive Distributed Computing Date

June 2012

68 pages

ISBN:9781450313414

DOI:10.1145/2286996

Program Chairs:
Tevfik Kosar
University at Buffalo, USA
,
Douglas Thain
University of Notre Dame, USA

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

University of Arizona: University of Arizona
SIGARCH: ACM Special Interest Group on Computer Architecture

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 June 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

HPDC'12

Sponsor:

University of Arizona
SIGARCH

HPDC'12: The 21st International Symposium on High-Performance Parallel and Distributed Computing

June 19, 2012

Delft, The Netherlands

Acceptance Rates

Overall Acceptance Rate 7 of 12 submissions, 58%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
264
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Barshan MMoens HVolckaert BDe Turck F(2016)A comparative analysis of flexible and fixed size timeslots for advance bandwidth reservations in media production networks2016 7th International Conference on the Network of the Future (NOF)10.1109/NOF.2016.7810118(1-6)Online publication date: Nov-2016
https://doi.org/10.1109/NOF.2016.7810118
Barshan MMoens HVolckaert B(2016)Dynamic adaptive advance bandwidth reservation in media production networks2016 IEEE NetSoft Conference and Workshops (NetSoft)10.1109/NETSOFT.2016.7502443(58-62)Online publication date: Jun-2016
https://doi.org/10.1109/NETSOFT.2016.7502443
Shi LSharma SKatramatos DYu D(2015)Optimizing circuit allocation for bandwidth reservations in dynamic virtual circuit networks2015 International Conference on Computing, Networking and Communications (ICNC)10.1109/ICCNC.2015.7069451(817-823)Online publication date: Feb-2015
https://doi.org/10.1109/ICCNC.2015.7069451
Klimentov AVaniachine ADe KWenaus TPanitkin SYu DZaruba GTitov M(2012)AbstractProceedings of the 2012 SC Companion: High Performance Computing, Networking Storage and Analysis10.1109/SC.Companion.2012.301(1521-1522)Online publication date: 10-Nov-2012
https://dl.acm.org/doi/10.1109/SC.Companion.2012.301

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents