research-article

MDCube: a high performance network structure for modular data center interconnection

Authors:

Chuanxiong Guo,

Yongguang ZhangAuthors Info & Claims

CoNEXT '09: Proceedings of the 5th international conference on Emerging networking experiments and technologies

Pages 25 - 36

https://doi.org/10.1145/1658939.1658943

Published: 01 December 2009 Publication History

Abstract

Shipping-container-based data centers have been introduced as building blocks for constructing mega-data centers. However, it is a challenge on how to interconnect those containers together with reasonable cost and cabling complexity, due to the fact that a mega-data center can have hundreds or even thousands of containers and the aggregate bandwidth among containers can easily reach tera-bit per second. As a new inner-container server-centric network architecture, BCube [9] interconnects thousands of servers inside a container and provides high bandwidth support for typical traffic patterns. It naturally serves as a building block for mega-data center.

In this paper, we propose MDCube, a high performance interconnection structure to scale BCube-based containers to mega-data centers. MDCube uses the high-speed uplink interfaces of the commodity switches in BCube containers to build the inter-container structure, reducing the cabling complexity greatly. MDCube puts its inter- and inner-container routing intelligences solely into servers to handle load-balance and fault-tolerance, thus directly leverages commodity instead of high-end switches to scale. Through analysis, we prove that MDCube has low diameter and high capacity. Both simulations and experiments in our testbed demonstrate the fault-tolerance and high network capacity of MDCube.

References

[1]

M. Al-Fares, A. Loukissas, and A. Vahdat. A Scalable, Commodity Data Center Network Architecture. In Proc. SIGCOMM, 2008.

Digital Library

[2]

L. Barroso, J. Dean, and U. Hölzle. Web Search for a Planet: The Google Cluster Architecture. IEEE Micro, March-April 2003.

Digital Library

[3]

L. Bhuyan and D. Agrawal. Generalized Hypercube and Hyperbus Structures for a Computer Network. IEEE trans. Computers, April 1984.

Digital Library

[4]

D. Borthakur. The Hadoop Distributed File System: Architecture and Design. http://hadoop.apache.org/core/docs/current/hdfs design.pdf.

[5]

CloudStore. Higher Performance Scalable Storage. http://kosmosfs.sourceforge.net/.

[6]

J. Dean and S. Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. In OSDI'04, 2004.

Digital Library

[7]

S. Ghemawat, H. Gobioff, and S. Leung. The Google File System. In ACM SOSP'03, 2003.

Digital Library

[8]

A. Greenberg, N. Jain, S. Kandula, C. Kim, P. Lahiri, D.A. Maltz, P. Patel, and S. Sengupta. VL2: A Scalable and Flexible Data Center Network. In Proc. SIGCOMM, 2009.

Digital Library

[9]

C. Guo, G. Lu, D. Li, H. Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. BCube: A High Performance, Server-centric Network Architecture for Modular Data Centers. In Proc. SIGCOMM, 2009.

Digital Library

[10]

C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu. DCell: A Scalable and Fault Tolerant Network Structure for Data Centers. In Proc. SIGCOMM, 2008.

Digital Library

[11]

IBM. Scalable Modular Data Center. http://www-935.ibm.com/services/us/its/pdf/smdc-eb-sfe03001-usen-00-022708.pdf.

[12]

M. Isard, M. Budiu, and Y. Yu. Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. In ACM EuroSys, 2007.

Digital Library

[13]

Randy H. Katz. Tech Titans Building Boom, Feb. 2009.

[14]

F. Leighton. Introduction to Parallel Algorithms and Architectures: Arrays. Trees. Hypercubes. Morgan Kaufmann, 1992.

Digital Library

[15]

Rackable Systems. Rackable Systems ICE Cube™ Modular Data Center. http://www.rackable.com/products/icecube.aspx.

[16]

Verari Systems. The Verari FOREST Container Solution: The Answer to Consolidation. http://www.verari.com/forest spec.asp.

[17]

M. Waldrop. Data Center in a Box. Scientific American, July 2007.

Cited By

Adraa MAssi CAlmekhlafi MKhabbaz MPelekhaty VFrankel M(2024)Comprehensive Performance and Robustness Analysis of Expander-Based Data CentersIEEE Transactions on Network and Service Management10.1109/TNSM.2023.330697121:1(670-683)Online publication date: Feb-2024
https://doi.org/10.1109/TNSM.2023.3306971
Wang GZhang YYu JMa MHu CFan JZhang L(2024)HS-DCell: A Highly Scalable DCell-Based Server-Centric Topology for Data Center NetworksIEEE/ACM Transactions on Networking10.1109/TNET.2024.339862832:5(3808-3823)Online publication date: Oct-2024
https://doi.org/10.1109/TNET.2024.3398628
Wang GYu JZou YFan JCheng W(2024)A New Measure of Fault-Tolerance for Network Reliability: Double-Structure ConnectivityIEEE/ACM Transactions on Networking10.1109/TNET.2023.330561132:1(874-889)Online publication date: Feb-2024
https://doi.org/10.1109/TNET.2023.3305611
Show More Cited By

Index Terms

MDCube: a high performance network structure for modular data center interconnection
1. Networks
  1. Network properties
    1. Network structure
  2. Network types
    1. Packet-switching networks

Recommendations

BCube: a high performance, server-centric network architecture for modular data centers
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication

This paper presents BCube, a new network architecture specifically designed for shipping-container based, modular data centers. At the core of the BCube architecture is its server-centric network structure, where servers with multiple network ports ...
VL2: a scalable and flexible data center network
SIGCOMM '09: Proceedings of the ACM SIGCOMM 2009 conference on Data communication

To be agile and cost effective, data centers should allow dynamic resource allocation across large server pools. In particular, the data center network should enable any server to be assigned to any service. To meet these goals, we present VL2, a ...
BCube: a high performance, server-centric network architecture for modular data centers
SIGCOMM '09

This paper presents BCube, a new network architecture specifically designed for shipping-container based, modular data centers. At the core of the BCube architecture is its server-centric network structure, where servers with multiple network ports ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CoNEXT '09: Proceedings of the 5th international conference on Emerging networking experiments and technologies

December 2009

362 pages

ISBN:9781605586366

DOI:10.1145/1658939

General Chairs:
Jörg Liebeherr
University of Toronto, Canada
,
Giorgio Ventre
University of Napoli, Italy
,
Program Chairs:
Ernst Biersack
Eurecom, France
,
S. Keshav
University of Waterloo, Canada

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 December 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

Co-NEXT '09

Sponsor:

SIGCOMM

Co-NEXT '09: Conference on emerging Networking EXperiments and Technologies

December 1 - 4, 2009

Rome, Italy

Acceptance Rates

Overall Acceptance Rate 198 of 789 submissions, 25%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

129
Total Citations
View Citations
706
Total Downloads

Downloads (Last 12 months)37
Downloads (Last 6 weeks)5

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Adraa MAssi CAlmekhlafi MKhabbaz MPelekhaty VFrankel M(2024)Comprehensive Performance and Robustness Analysis of Expander-Based Data CentersIEEE Transactions on Network and Service Management10.1109/TNSM.2023.330697121:1(670-683)Online publication date: Feb-2024
https://doi.org/10.1109/TNSM.2023.3306971
Wang GZhang YYu JMa MHu CFan JZhang L(2024)HS-DCell: A Highly Scalable DCell-Based Server-Centric Topology for Data Center NetworksIEEE/ACM Transactions on Networking10.1109/TNET.2024.339862832:5(3808-3823)Online publication date: Oct-2024
https://doi.org/10.1109/TNET.2024.3398628
Wang GYu JZou YFan JCheng W(2024)A New Measure of Fault-Tolerance for Network Reliability: Double-Structure ConnectivityIEEE/ACM Transactions on Networking10.1109/TNET.2023.330561132:1(874-889)Online publication date: Feb-2024
https://doi.org/10.1109/TNET.2023.3305611
Chen LJia Z(2024)On Optimum Entanglement Purification Scheduling in Quantum NetworksIEEE Journal on Selected Areas in Communications10.1109/JSAC.2024.338008042:7(1779-1792)Online publication date: Jul-2024
https://doi.org/10.1109/JSAC.2024.3380080
Oh JYoo SNam HMin CWon YNaor DGoel A(2023)CJFSProceedings of the 21st USENIX Conference on File and Storage Technologies10.5555/3585938.3585949(167-181)Online publication date: 21-Feb-2023
https://dl.acm.org/doi/10.5555/3585938.3585949
Bienkowski MFuchssteiner DSchmid SMohror KArnold DBadia R(2023)Optimizing Reconfigurable Optical Datacenters: The Power of RandomizationProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3581784.3607057(1-11)Online publication date: 12-Nov-2023
https://dl.acm.org/doi/10.1145/3581784.3607057
Chung WLi YKe CHsieh SZomaya ABuyya R(2023)Dynamic Parallel Flow Algorithms With Centralized Scheduling for Load Balancing in Cloud Data Center NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2021.312976811:1(1050-1064)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3129768
Peres BSouza OGoussevskaia OAvin CSchmid S(2023)Distributed Self-Adjusting Tree NetworksIEEE Transactions on Cloud Computing10.1109/TCC.2021.311206711:1(716-729)Online publication date: 1-Jan-2023
https://doi.org/10.1109/TCC.2021.3112067
Caldeira Cde O. Souza OGoussevskaia OSchmid S(2023)OpticNet: Self-Adjusting Networks for ToR-Matching-ToR Optical Switching ArchitecturesIEEE INFOCOM 2023 - IEEE Conference on Computer Communications10.1109/INFOCOM53939.2023.10228883(1-10)Online publication date: 17-May-2023
https://doi.org/10.1109/INFOCOM53939.2023.10228883
Souza OCaldeira CGoussevskaia O(2023)Randomized distributed self-adjusting tree networksComputer Networks10.1016/j.comnet.2023.109941235(109941)Online publication date: Nov-2023
https://doi.org/10.1016/j.comnet.2023.109941
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents