research-article

Bandwidth on demand for inter-data center communication

Authors:

Robert Doverspike,

Emmanuil Mavrogiorgis,

Sheryl L. Woodward,

Jennifer YatesAuthors Info & Claims

HotNets-X: Proceedings of the 10th ACM Workshop on Hot Topics in Networks

Article No.: 24, Pages 1 - 6

https://doi.org/10.1145/2070562.2070586

Published: 14 November 2011 Publication History

Abstract

Cloud service providers use replication across geographically distributed data centers to improve end-to-end performance as well as to offer high reliability under failures. Content replication often involves the transfer of huge data sets over the wide area network and demands high backbone transport capacity. In this paper, we discuss how a Globally Reconfigurable Intelligent Photonic Network (GRIPhoN) between data centers could improve operational flexibility for cloud service providers. The proposed GRIPhoN architecture is an extension of earlier work [34] and can provide a bandwidth-on-demand service ranging from low data rates (e.g., 1 Gbps) to high data rates (e.g., 10-40 Gbps). The inter-data center communication network which is currently statically provisioned could be dynamically configured based on demand. Today's backbone optical networks can take several weeks to provision a customer's private line connection. GRIPhoN would enable cloud operators to dynamically set up and tear down their connections (sub-wavelength or wavelength rates) within a few minutes. GRIPhoN also offers cost-effective restoration capabilities at wavelength rates and automated bridge-and-roll of private line connections to minimize the impact of planned maintenance activities.

References

[1]

S. Agarwal, J. Dunagan, N. Jain, S. Saroiu, A. Wolman, and H. Bhogan. Volley: automated data placement for geo-distributed cloud services. In NSDI, 2010.

Digital Library

[2]

Apple icloud. http://www.apple.com/icloud/.

[3]

B. S. Arnaud, J. Wu, and B. Kalali. Customer-controlled and -managed optical networks. In Journal of Lightwave Technology, 2003.

[4]

Amazon Simple Storage Service, aws.amazon.com/s3/.

[5]

Windows azure. http://www.microsoft.com/windowsazure/.

[6]

Y. Chen, S. Jain, V. K. Adhikari, Z.-L. Zhang, and K. Xu. A first look at inter-data center traffic characteristics via yahoo! datasets. In IEEE INFOCOM. 2011.

[7]

A. L. Chiu, G. Choudhury, G. Clapp, R. Doverspike, J. W. Gannett, J. G. Klincewicz, G. Li, R. A. Skoog, J. Strand, A. von Lehmen, and D. Xu. Network design and architectures for highly dynamic next-generation ip-over-optical long distance networks. In Journal of Lightwave Technology, 2009.

[8]

M. Chowdhury, M. Zaharia, J. Ma, M. I. Jordan, and I. Stoica. Managing data transfers in computer clusters with Orchestra. In ACM SIGCOMM, 2011.

Digital Library

[9]

R. Doverspike. Practical aspects of bandwidth-on-demand in optical networks. In Panel on Emerging Networks, Service Provider Summit, OFC, 2007.

[10]

Facebook Statistics. www.facebook.com/press/info.php?statistics.

[11]

N. Farrington, G. Porter, S. Radhakrishnan, H. H. Bazzaz, V. Subramanya, Y. Fainman, G. Papen, and A. Vahdat. Helios: a hybrid electrical/optical switch architecture for modular data centers. In ACM SIGCOMM, 2010.

Digital Library

[12]

M. D. Feuer, D. C. Kilper, and S. L. Woodward, ROADMS and their system applications. In Optical Fiber Telecommunications VB. New York: Academic Press, 2008.

[13]

S. Figueira, S. Naiksata, H. Cohen, D. Cutrell, P. Daspit, D. Gutierrez, and D. B. Hoang. DWDM-RAM: Enabling grid services with dynamic optical networks. In IEEE International Symposium on Cluster Computing and the Grid, 2004.

Digital Library

[14]

Forrester research. http://info.infineta.com/1/5622/2011-01-27/Y26.

[15]

Google, http://www.google.com/corporate/datacenter/index.html.

[16]

A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel. The cost of a cloud: research problems in data center networks. In ACM SIGCOMM CCR, 2009.

Digital Library

[17]

A. Greenberg, J. R. Hamilton, N. Jain, S. Kandula, C. Kim, P. Lahiri, D. A. Maltz, P. Patel, and S. Sengupta. VL2: a scalable and tlexible data center network. In ACM SIGCOMM, 2009.

Digital Library

[18]

C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: a high performance, server-centric network architecture for modular data centers. In ACM SIGCOMM, 2009.

Digital Library

[19]

C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu, DCell: a scalable and fault-tolerant network structure for data centers. In ACM SIGCOMM, 2008.

Digital Library

[20]

Perspectives - James Hamilton's Blog, Inter-Datacenter replication & geo-redundancy. http://perspectives.mvdirona.com/2010/05/10/InterDatacenterReplicationGeoRedundancy.aspx.

[21]

Ibm smart cloud. http://www.ibm.com/cloud-computing/us/en/.

[22]

N. Laoutaris, M. Sirivianos, X. Yang, and P. Rodriguez, Inter-datacenter bulk transfers with NetStitcher. In ACM SIGCOMM, 2011.

Digital Library

[23]

N. Laoutaris, G. Smaragdakis, P. Rodriguez, and R. Sundaraam. Delay tolerant bulk data transfers on the internet. In ACM SIGMETRICS, 2009.

Digital Library

[24]

T. Lehman, J. Sobieski, and B. Jabbari. DRAGON: a framework for service provisioning in heterogeneous grid networks. In IEEE Communications Magazine, 2006.

Digital Library

[25]

R. Niranjan Mysore, A. Pamboris, N. Farrington, N. Huang, P. Miri, S. Radhakrishnan, V. Subramanya, and A. Vahdat. Portland: a scalable fault-tolerant layer 2 data center network fabric. In ACM SIGCOMM, 2009.

Digital Library

[26]

K. Oikonomou and R. Sinha. Network design and cost analysis of optical vpns. In OFC, 2006.

[27]

Optical mesh service (OMS). http://http://www.business.att.com/wholesale/Service/data-networking-wholesale/long-haul-access-wholesale/optical-mesh-service-wholesale/.

[28]

A. Singla, A. Singh, K. Ramachandran, L. Xu, and Y. Zhang. Proteus: A topology malleable data center network. In ACM HotNets, 2010.

Digital Library

[29]

G. Wang, D. G. Andersen, M. Kaminsky, M. Kozuch, T. S. E. Ng, K. Papagiannaki, and M. Ryan. c-Through: Part-time optics in data centers. In ACM SIGCOMM, 2010.

Digital Library

[30]

S. L. Woodward, M. D. Feuer, J. L. Jackel, and A. Agarwal. Massively-scaleable highly-dynamic optical node design. In OFC/NFOEC, 2010.

[31]

H. Wu, G. Lu, D. Li, C. Guo, and Y. Zhang. MDCube: a high performance network structure for modular data center interconnection. In ACM CoNEXT, 2009.

Digital Library

[32]

Yahoo! http://www.yahoo.com/.

[33]

O. Yu, A. Li, Y. Cao, L. Yin, M. Liao, and H. Xu. Multi-domain lambda grid data portal for collaborative grid applications. Future Gener. Comput, Syst., 2006.

Digital Library

[34]

X. J. Zhang, M. Birk, A. Chiu, R. Doverspike, M. D. Feuer, P. Magill, E. Mavrogiorgis, J. Pastor, S. L. Woodward, and J. Yates. Bridge-and-roll demonstration in griphon (globally reconfigurable intelligent photonic network). In OFC, 2010.

[35]

X. Zheng, M. Veeraraghavan, N. S. V. Rao, Q. Wu, and M. Zhu, CHEETAH: Circuit-switched high-speed end-to-end transport architecture testbed. In IEEE Communications Magazine, 2005.

Digital Library

[36]

D. Ziegler. Distributed peta-scale data transfer. http://www.cs.huji.ac.il/~dhay/IND2011.html.

Cited By

Nance-Hall MBarford PFoerster KDurairajan R(2024)Improving Scalability in Traffic Engineering via Optical Topology ProgrammingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333589821:2(1581-1600)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3335898
R.Sudhakar V.Ramkumar S.Santhosh J.Suganth D.Thirunavukkarasu (2023)ONE PASS PACKET STEERING IN SOFTWARE DEFINED DATA CENTERSinternational journal of engineering technology and management sciences10.46647/ijetms.2023.v07i02.0577:2(494-501)Online publication date: 2023
https://doi.org/10.46647/ijetms.2023.v07i02.057
Rahmani RMoser ICricenti A(2022)Inter-continental Data Centre Power Load Balancing for Renewable Energy MaximisationElectronics10.3390/electronics1110156411:10(1564)Online publication date: 13-May-2022
https://doi.org/10.3390/electronics11101564
Show More Cited By

Index Terms

Bandwidth on demand for inter-data center communication
1. Networks
  1. Network protocols

Recommendations

Stackable ROADMs for minimizing lightpath interference during upgrade of in-service WDM networks

Bidirectional stackable ROADMs (BS-ROADMs) with 3-port optical add/drop multiplexers (OADMs) have been presented for minimizing the lightpath interference during reconfiguration of the ROADMs. The BS-ROADM is constructed by connecting some modules with ...
Uniform waveband assignment in optical mesh networks

The cost of an optical network in wavelength division multiplexing (WDM) networks can be reduced using optical reconfigurable optical add/drop multiplexers (ROADMs), which allow traffic to pass through without the need for an expensive optical-electro-...
Optical Grooming Capable Wavelength Division Multiplexing node architecture for beyond 100 Gbps transport
Abstract
Mixed-line-rate wavelength division multiplexing (WDM) networks with discrete channel spacing generalize the fixed grid WDM networks and can support mixed-electronic-optical grooming efficiently. For optical transport networks with ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

HotNets-X: Proceedings of the 10th ACM Workshop on Hot Topics in Networks

November 2011

148 pages

ISBN:9781450310598

DOI:10.1145/2070562

General Chairs:
Hari Balakrishnan
MIT
,
Dina Katabi
MIT
,
Program Chairs:
Aditya Akella
University of Wisconsin-Madison
,
Ion Stoica
UC Berkeley

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Conference

HOTNETS-X

Sponsor:

SIGCOMM

HOTNETS-X: Tenth ACM Workshop on Hot Topics in Networks

November 14 - 15, 2011

Massachusetts, Cambridge

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

79
Total Citations
View Citations
786
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)2

Reflects downloads up to 20 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nance-Hall MBarford PFoerster KDurairajan R(2024)Improving Scalability in Traffic Engineering via Optical Topology ProgrammingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333589821:2(1581-1600)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3335898
R.Sudhakar V.Ramkumar S.Santhosh J.Suganth D.Thirunavukkarasu (2023)ONE PASS PACKET STEERING IN SOFTWARE DEFINED DATA CENTERSinternational journal of engineering technology and management sciences10.46647/ijetms.2023.v07i02.0577:2(494-501)Online publication date: 2023
https://doi.org/10.46647/ijetms.2023.v07i02.057
Rahmani RMoser ICricenti A(2022)Inter-continental Data Centre Power Load Balancing for Renewable Energy MaximisationElectronics10.3390/electronics1110156411:10(1564)Online publication date: 13-May-2022
https://doi.org/10.3390/electronics11101564
Liu PSun YHuang KHuang GYu Z(2022)Reducing Video Transmission Cost of the Cloud Service Provider with QoS-GuaranteedData Science10.1007/978-981-19-5194-7_29(387-402)Online publication date: 10-Aug-2022
https://doi.org/10.1007/978-981-19-5194-7_29
Liu PHuang KHuang G(2021)Minimize the Cost of Video Transmission Among Cloud Data Center and Edge Cloud CDN NodesCommunications and Networking10.1007/978-3-030-67720-6_32(459-473)Online publication date: 2-Feb-2021
https://doi.org/10.1007/978-3-030-67720-6_32
Antonenko VChupakhin AKolosov ASmeliansky RStepanov E(2021)On HPC and Cloud Environments IntegrationPerformance Evaluation Models for Distributed Service Networks10.1007/978-3-030-67063-4_8(159-185)Online publication date: 16-Mar-2021
https://doi.org/10.1007/978-3-030-67063-4_8
Yassine AShirehjini AShirmohammadi S(2020)Bandwidth On-Demand for Multimedia Big Data Transfer Across Geo-Distributed Cloud Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2016.26173698:4(1189-1198)Online publication date: 1-Oct-2020
https://doi.org/10.1109/TCC.2016.2617369
Gandhi SViniotis Y(2020)Guarantees for Mix-flows in Inter-Datacenter WANs in Single and Federated Clouds2020 IEEE 45th Conference on Local Computer Networks (LCN)10.1109/LCN48667.2020.9314789(244-255)Online publication date: 16-Nov-2020
https://doi.org/10.1109/LCN48667.2020.9314789
Han XYang MDjordjevic IYue YWang QQu ZAnderson J(2019)Joint Probabilistic-Nyquist Pulse Shaping for an LDPC-Coded 8-PAM Signal in DWDM Data Center CommunicationsApplied Sciences10.3390/app92349969:23(4996)Online publication date: 20-Nov-2019
https://doi.org/10.3390/app9234996
Bogle JBhatia NGhobadi MMenache IBjørner NValadarsky ASchapira MWu JHall W(2019)TEAVARProceedings of the ACM Special Interest Group on Data Communication10.1145/3341302.3342069(29-43)Online publication date: 19-Aug-2019
https://dl.acm.org/doi/10.1145/3341302.3342069
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents