research-article

ExCCC-DCN: A Highly Scalable, Cost-Effective and Energy-Efficient Data Center Structure

Authors:

Shuqiang HuangAuthors Info & Claims

IEEE Transactions on Parallel and Distributed Systems, Volume 28, Issue 4

Pages 1046 - 1060

https://doi.org/10.1109/TPDS.2016.2609428

Published: 01 April 2017 Publication History

Abstract

Over the past decade, many data centers have been constructed around the world due to the explosive growth of data volume and type. The cost and energy consumption have become the most important challenges of building those data centers. Data centers today use commodity computers and switches instead of high-end servers and interconnections for cost-effectiveness. In this paper, we propose a new type of interconnection networks called Exchanged Cube-Connected Cycles (ExCCC). The ExCCC network is an extension of Exchanged Hypercube (EH) network by replacing each node with a cycle. The EH network is based on link removal from a Hypercube network, which makes the EH network more cost-effective as it scales up. After analyzing the topological properties of ExCCC, we employ commodity switches to construct a new class of data center network models, namely ExCCC-DCN, by leveraging the advantages of the ExCCC architecture. The analysis and experimental results demonstrate that the proposed ExCCC-DCN models significantly outperform four state-of-the-art data center network models in terms of the total cost, power consumption, scalability, and other static characteristics. It achieves the goals of low cost, low energy consumption, high network throughput, and high scalability simultaneously.

References

[1]

T. Hoff, “Google architecture,” 2007. {Online}. Available: http://highscalability.com/google-architecture

[2]

L. Rabbe, Powering the Yahoo! network, 2006.

[3]

Y. Zhang and N. Ansari, “On architecture design, congestion notification, TCP incast and power consumption in data centers,” IEEE Commun. Surveys Tutorials, vol. Volume 15, no. Issue 1, pp. 39–64, -Mar. 2013.

[4]

A. Carter, “Do it green: Media interview with michael manos,” 2007. {Online}. Available: http://edge. technet. com/Media/Doing-ITGreen

[5]

S. Ghemawat, H. Gobioff, and S.-T. Leung, “The Google file system,” ACM SIGOPS Operating Syst. Rev., vol. Volume 37, no. Issue 5, pp. 29–43, 2003.

Digital Library

[6]

J. Dean and S. Ghemawat, “MapReduce: simplified data processing on large clusters,” Commun. ACM, vol. Volume 51, no. Issue 1, pp. 107–113, 2008.

Digital Library

[7]

M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly, “Dryad: Distributed data-parallel programs from sequential building blocks,” ACM SIGOPS Operating Syst. Rev., vol. Volume 41, no. Issue 3, pp. 59–72, 2007.

Digital Library

[8]

M. Al-Fares, A. Loukissas, and A. Vahdat, “A scalable, commodity data center network architecture,” ACM SIGCOMM Comput. Commun. Rev., vol. Volume 38, no. Issue 4, pp. 63–74, 2008.

Digital Library

[9]

C. Guo, H. Wu, K. Tan, L. Shi, Y. Zhang, and S. Lu, “Dcell: A scalable and fault-tolerant network structure for data centers,” ACM SIGCOMM Comput. Commun. Rev., vol. Volume 38, no. Issue 4, pp. 75–86, 2008.

Digital Library

[10]

C. Guo, et al., “Bcube: A high performance, server-centric network architecture for modular data centers,” ACM SIGCOMM Comput. Commun. Rev., vol. Volume 39, no. Issue 4, pp. 63–74, 2009.

Digital Library

[11]

D. Li, C. Guo, H. Wu, K. Tan, Y. Zhang, and S. Lu, “Ficonn: Using backup port for server interconnection in data centers,” in Proc. IEEE INFOCOM, 2009, pp. 2276–2285.

[12]

A. Greenberg, J. Hamilton, D. A. Maltz, and P. Patel, “The cost of a cloud: Research problems in data center networks,” ACM SIGCOMM Comput. Commun. Rev., vol. Volume 39, no. Issue 1, pp. 68–73, 2008.

Digital Library

[13]

K. Wu, J. Xiao, and L. M. Ni, “Rethinking the architecture design of data center networks,” Frontiers Comput. Sci., vol. Volume 6, no. Issue 5, pp. 596–603, 2012.

[14]

H. Xu, C. Feng, and B. Li, “Temperature aware workload managementin geo-distributed data centers,” IEEE Trans. Parallel Distrib. Syst., vol. Volume 26, no. Issue 6, pp. 1743–1753, Jun. 2015.

[15]

L. Yu, T. Jiang, and Y. Cao, “Energy cost minimization for distributed internet data centers in smart Microgrids considering power outages,” IEEE Trans. Parallel Distrib. Syst., vol. Volume 26, no. Issue 1, pp. 120–130, 2015.

[16]

A. M. Al-Qawasmeh, S. Pasricha, A. A. Maciejewski, and H. J. Siegel, “Power and thermal-aware workload allocation in heterogeneous data centers,” IEEE Trans. Comput., vol. Volume 64, no. Issue 2, pp. 477–491, 2015.

[17]

L. N. Bhuyan and D. P. Agrawal, “Generalized hypercube and hyperbus structures for a computer network,” IEEE Trans. Comput., vol. Volume 100, no. Issue 4, pp. 323–333, 1984.

Digital Library

[18]

A. H. Esfahanian, L. M. Ni, and B. E. Sagan, “The twisted N-cube with application to multiprocessing,” IEEE Trans. Comput., vol. Volume 40, no. Issue 1, pp. 88–93, 1991.

Digital Library

[19]

K. Efe, “The crossed cube architecture for parallel computation,” IEEE Trans. Parallel Distrib. Syst., vol. Volume 3, no. Issue 5, pp. 513–524, 1992.

Digital Library

[20]

A. El-Amawy and S. Latifi, “Properties and performance of folded hypercubes,” IEEE Trans. Parallel Distrib. Syst., vol. Volume 2, no. Issue 1, pp. 31–42, 1991.

Digital Library

[21]

P. K. Loh, W. J. Hsu, and Y. Pan, “The exchanged hypercube,” IEEE Trans. Parallel Distrib. Syst., vol. Volume 16, no. Issue 9, pp. 866–874, 2005.

Digital Library

[22]

F. P. Preparata and J. Vuillemin, “The cube-connected cycles: A versatile network for parallel computation,” Commun. ACM, vol. Volume 24, no. Issue 5, pp. 300–309, 1981.

Digital Library

[23]

M. Sebastian, P. N. Rao, and L. Jenkins, “Properties and performance of folded cube-connected cycles,” J. Syst. Archit., vol. Volume 44, no. Issue 5, pp. 359–374, 1998.

Digital Library

[24]

R. A. Ayoubi, Q. M. Malluhi, and M. A. Bayoumi, “The extended cube connected cycles: An efficient interconnection for massively parallel systems,” IEEE Trans. Comput., vol. Volume 45, no. Issue 5, pp. 609–614, 1996.

Digital Library

[25]

A. Singh, et al., “Jupiter rising: A decade of clos topologies and centralized control in Google's datacenter network,” ACM SIGCOMM Comput. Commun. Rev., vol. Volume 45, no. Issue 5, pp. 183–197, 2015.

Digital Library

[26]

Inside microsoft's $550 million mega data centers, 2009. {Online}. Available: http://www.informationweek.com/news/hardware/data_centers/showArticle.jhtml?articleID=208403723

[27]

B. Canney, “Ibm portable modular data center overview,” 2009. {Online}. Available: http://www-05.ibm.com/se/news/events/datacenter/pdf/PMDC_Introducion_-_Brian_Canney.pdf

[28]

HP, “Hp performance optimized datacenter,” 2016. {Online}. Available: ftp://ftp.hp.com/pub/c-products/servers/pod/north_america_pod_datasheet_041509.pdf

[29]

SGI, “Sgi ice cube,” 2016. {Online}. Available: http://www.sgi.com/pdfs/4160.pdf

[30]

O. Sun, “Sun modular datacenter,” 2016. {Online}. Available: http://www.sun.com/service/sunmd

[31]

I. Friš, I. Havel, and P. Liebl, “The diameter of the cube-connected cycles,” Inf. Process. Lett., vol. Volume 61, no. Issue 3, pp. 157–160, 1997.

Digital Library

[32]

ZOL, “Online,” 2016. {Online}. Available: http://www.zol.com.cn

[33]

M. Al-Fares, S. Radhakrishnan, B. Raghavan, N. Huang, and A. Vahdat, “Hedera: Dynamic flow scheduling for data center networks,” in Proc. 7th USENIX Conf. Netw. Syst. Des. Implementation, 2010, pp. 19–19.

Digital Library

[34]

J. Xie and Y. Deng, “mtcloudsim: A flow-level network simulator for multi-tenant cloud,” in Proc. 22th IEEE Int. Conf. Parallel Distrib. Syst., 2016.

[35]

M. Alizadeh, et al., “Data center TCP (DCTCP),” ACM SIGCOMM Comput. Commun. Rev., vol. Volume 41, no. Issue 4, pp. 63–74, 2011.

Digital Library

[36]

T. Benson, A. Akella, and D. A. Maltz, “Network traffic characteristics of data centers in the wild,” in Proc. 10th ACM SIGCOMM Conf. Internet Measurement, 2010, pp. 267–280.

Digital Library

Cited By

Zeng ZShen H(2022)Light-BCube:A Scalable and High Performance Network Structure for Modular Data CenterProceedings of the 7th International Conference on Big Data and Computing10.1145/3545801.3545805(20-28)Online publication date: 27-May-2022
https://dl.acm.org/doi/10.1145/3545801.3545805
Wu ZDeng YFeng HZhou YMin GZhang Z(2022)Blender: A Container Placement Strategy by Leveraging Zipf-Like Distribution Within Containerized Data CentersIEEE Transactions on Network and Service Management10.1109/TNSM.2021.313526819:2(1382-1398)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1109/TNSM.2021.3135268
Fan WFan JHan ZLi PZhang YWang R(2021)Fault-tolerant hamiltonian cycles and paths embedding into locally exchanged twisted cubesFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-020-9387-315:3Online publication date: 11-Feb-2021
https://dl.acm.org/doi/10.1007/s11704-020-9387-3
Show More Cited By

ExCCC-DCN: A Highly Scalable, Cost-Effective and Energy-Efficient Data Center Structure

Recommendations

Energy Efficient and Enhanced-Type Data-Centric Network (E3-DCN)
SNPD '12: Proceedings of the 2012 13th ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing

This paper presents a concept of the Energy Efficient and Enhanced-type Data-centric Network (E3-DCN). For future network technology, the Contents-centric Network (CCN) is widely studied. DCN is an extended version of CCN. M2M communication and mobility ...
Challenges and opportunities on network resource management in DCN with SDN
BIG DATA '15: Proceedings of the 2015 IEEE International Conference on Big Data (Big Data)

With the explosive growth of applications and application traffic, data centers networks are challenged in network utilization and network performance, which is crucial to guarantee the efficiency of computing and storage resources of data center ...
Topology-independent Software-Defined Edge Control for Scalable Ethernet DCN
HPCC-CSS-ICESS '15: Proceedings of the 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conf on Embedded Software and Systems

Although Layer-2 networking meets the requirement of datacenter operators, it can not scale in the existing Ethernet Datacenter Network (DCN). In this paper, motivated by the backwards compatibility of OpenFlow with current commodity switches, we ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Parallel and Distributed Systems

IEEE Transactions on Parallel and Distributed Systems Volume 28, Issue 4

April 2017

310 pages

ISSN:1045-9219

Issue’s Table of Contents

Copyright © 2017.

Publisher

IEEE Press

Publication History

Published: 01 April 2017

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zeng ZShen H(2022)Light-BCube:A Scalable and High Performance Network Structure for Modular Data CenterProceedings of the 7th International Conference on Big Data and Computing10.1145/3545801.3545805(20-28)Online publication date: 27-May-2022
https://dl.acm.org/doi/10.1145/3545801.3545805
Wu ZDeng YFeng HZhou YMin GZhang Z(2022)Blender: A Container Placement Strategy by Leveraging Zipf-Like Distribution Within Containerized Data CentersIEEE Transactions on Network and Service Management10.1109/TNSM.2021.313526819:2(1382-1398)Online publication date: 1-Jun-2022
https://dl.acm.org/doi/10.1109/TNSM.2021.3135268
Fan WFan JHan ZLi PZhang YWang R(2021)Fault-tolerant hamiltonian cycles and paths embedding into locally exchanged twisted cubesFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-020-9387-315:3Online publication date: 11-Feb-2021
https://dl.acm.org/doi/10.1007/s11704-020-9387-3
Du XZhao ZHan ZWang B(2020)Data center network acquisition symptom algorithm based on Hamiltonian CycleProceedings of the 2020 International Conference on Cyberspace Innovation of Advanced Technologies10.1145/3444370.3444549(65-69)Online publication date: 4-Dec-2020
https://dl.acm.org/doi/10.1145/3444370.3444549
Fan WFan JLin CWang GCheng BWang R(2019)An efficient algorithm for embedding exchanged hypercubes into gridsThe Journal of Supercomputing10.1007/s11227-018-2612-275:2(783-807)Online publication date: 1-Feb-2019
https://dl.acm.org/doi/10.1007/s11227-018-2612-2
Son JBuyya R(2018)A Taxonomy of Software-Defined Networking (SDN)-Enabled Cloud ComputingACM Computing Surveys10.1145/319061751:3(1-36)Online publication date: 23-May-2018
https://dl.acm.org/doi/10.1145/3190617

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents