Nothing Special   »   [go: up one dir, main page]

skip to main content
article

Data center evolution

Published: 01 December 2009 Publication History

Abstract

Data centers form a key part of the infrastructure upon which a variety of information technology services are built. As data centers continue to grow in size and complexity, it is desirable to understand aspects of their design that are worthy of carrying forward, as well as existing or upcoming shortcomings and challenges that would have to be addressed. We envision the data center evolving from owned physical entities to potentially outsourced, virtualized and geographically distributed infrastructures that still attempt to provide the same level of control and isolation that owned infrastructures do. We define a layered model for such data centers and provide a detailed treatment of state of the art and emerging challenges in storage, networking, management and power/thermal aspects.

References

[1]
Belady, C. and Center, In the Data, Power and Cooling Costs More Than The IT Equipment it Supports. ElectronicsCooling. v13 i1.
[2]
J. Zhen, Five Key Challenges of Enterprise Cloud Computing, <cloudcomputing.sys-con.com/node/659288>.
[3]
Alfaro, F.J., Sanchez, J.L. and Duato, J., QoS in InfiniBand Subnetworks. IEEE trans. on parallel&amp;distributed systems. v15 i9.
[4]
D. Awduche, L. Berger, et al., RSVP-TE: Extensions to RSVP for LSP Tunnels, <http://www.ietf.org/rfc/rfc3209.txt>.
[5]
P. Balaji, P. Shivam, P. Wyckoff, D. Panda, High performance user level sockets over Gigabit Ethernet, in: Proc. of IEEE Int. Conf. on Cluster Computing, September 2002 179-186.
[6]
P. Balaji, H.V. Shah, D.K. Panda, Sockets vs RDMA interface over 10-Gigabit networks: an in-depth analysis of the memory traffic bottleneck", Proc. of RAIT Workshop, September 2004.
[7]
D. Bergamasco, Ethernet Congestion Manager (ECM), See au-bergamasco-ethernet-congestion-manager-070313.pdf at <www.ieee802.org/1/files/public/docs2007>.
[8]
A.L. Caro, J.R. Iyengar, et al., SCTP : A proposed standard for robust Internet data transport, IEEE Computer 36 (11) (2203) 20-27.
[9]
M. Casado, M. Freedman, J. Pettit, et al., Ethane: Taking control of the enterprise, in: Proc. of SIGCOMM, August, 2007.
[10]
S. Cho, R. Bettati, Aggregated aggressiveness control on groups of TCP flows, in: Proc. of Networking, 2005.
[11]
P.J. Crowcroft, P. Oechslin, Differentiated end to end internet services using a weighted proportional fair sharing, Proc. of 1998 ACM SIGCOMM.
[12]
P. Desnoyers, Empirical evaluation of NAND flash memory performance, in: Proc. of HotStorage, Big Sky, Montana, 2009.
[13]
Dunning, D. and Regnier, G., The virtual interface architecture. IEEE Micro. v18 i2. 66-76.
[14]
H. Dwivedi, Securing Storage: A Practical Guide to SAN and NAS Security, Addison-Wesley, 2005.
[15]
M. Al-Fares, A. Loukissas, A. Vahdat, A scalable, commodity data center network architecture, in: Proc. of 2008 ACM SIGCOMM.
[16]
Feng, W. and Balaji, P., Performance characterization of a 10-gigabit ethernet TOE. Proc. of HPCA. 58-63.
[17]
F. Le Faucheur (Ed.), Multiprotocol label Switching (MPLS) Support of Differentiated Services, http://www.ietf.org/rfc/rfc3270.txt.
[18]
R. Greenwald, R. Stakowiak, J. Stern, Oracle Essentials, fourth ed., O'Reilly, 2007.
[19]
W. Huang, Q. Gao, J. Liu, D.K. Panda, High performance virtual machine migration with RDMA over modern interconnects, in: IEEE Intl. Conf. on Cluster Computing (Cluster'07), Austin, TX, September, 2007.
[20]
G. Ibanex, A. Garcia, A. Azcorra, Alternative multiple spanning tree protocol (AMSTP) for optical ethernet backbones, in: Proc. of 29th IEEE Conference on Local Networks, 2004.
[21]
H.-W. Jin, P. Balaji, et al., Exploiting NIC architectural support for enhancing IP based protocols on high performance networks, J. Parallel Distributed Comput., in press.
[22]
K. Kant, TCP offload performance for front-end servers, in: Proc. of Globecom, 2003, San Francisco, CA.
[23]
K. Kant, Towards a virtualized data center transport protocol, in: Proceedings of 2008 INFOCOM Workshop on High Speed Networks, Phoenix, AZ, April, 2008.
[24]
K. Kant, Application centric autonomic BW control in utility computing, in: Sixth IEEE/ACM Workshop on Grid Computing, Seattle, WA, November, 2005.
[25]
K. Kant, N. Jani, SCTP performance in data center environments, in: Proceedings of SPECTS, July 2005, Philadelphia, PA.
[26]
K. Kant, Virtual link: an enabler of enterprise utility computing, in: Proceedings of International Symposium on Parallel Processing&amp;Applications (ISPA), Sorrento, Italy, December, 2006.
[27]
Leiserson, C.E., Fat-trees: universal networks for hardware-efficient supercomputing. IEEE Transactions on Computers. v34 i10. 892-901.
[28]
Liu, J., Wu, J. and Panda, D.K., High performance RDMA-based MPI implementation over infiniband. International Journal of Parallel Programming. v32 i3.
[29]
Martin, J., Nilsson, A. and Rhee, I., Delay based congestion avoidance in TCP. IEEE/ACM Transactions on Networking. v11 i3. 356-369.
[30]
QoS Support in MPLS networks, MPLS/Frame Relay alliance whitepaper, May, 2003.
[31]
J. McDonough, Moving Standards to 100 GbE and beyond, IEEE applications and practice, November, 2007.
[32]
R.N. Mysore, A. Pamboris, N. Farrington, et al., PortLand: a scalable fault-tolerant layer 2 data center network fabric, in: Proc. of 2009 ACM SIGCOMM.
[33]
R. Noronha, X. Ouyang, D.K. Panda, Designing a high-performance clustered NAS: a case study with pNFS over RDMA on InfiniBand, in: Intl. Conf. on High Performance Computing (HiPC 08), December, 2008.
[34]
C.B. Reardon, A.D. George, C.T. Cole, I. Ammasso, Comparative performance analysis of RDMA-enhanced Ethernet, in: Workshop on High-Performance Interconnects for Distributed Computing, 2005.
[35]
G. Regnier, S. Makineni, et al., TCP onloading for data center servers, in: IEEE Computer, Special Issue on Internet Data Centers, November, 2004.
[36]
S-A. Reinemo, T. Skeie, et al., An overview of QoS capabilities in InfiniBand, advanced switching interconnect, and ethernet, in: IEEE Communications Magazine, July, 2006, pp. 32-38.
[37]
T. Shanley, InfiniBand Network Architecture, Mindshare Inc., 2002.
[38]
Y. Tien, K. Xu, N. Ansari, TCP in wireless environments: problems and solutions, in: IEEE Radio Communications, March, 2005, pp. 27-32.
[39]
J.P.G. Sterbenz, G.M. Parulkar, Axon: a high speed communication architecture for distributed applications, in: Proc. of IEEE INFOCOM, June, 1990, pp. 415-425.
[40]
M. Wadekar, G. Hegde, et al., Proposal for Traffic Differentiation in Ethernet Networks, See new-wadekar-virtual%20-links-0305.pdf at <www.ieee802.org/1/files/public/docs2005>.
[41]
J. Wang, K. Wright, K. Gopalan, XenLoop: a transparent high performance inter-vm network loopback, in: Proc. of 17th International Symposium on High Performance Distributed Computing, Boston, MA, June, 2008.
[42]
M.A. Bender, M.F. Colton, B.C. Kuszmaul, Cache-oblivious string B-trees, in: Proceedings of PODS, 2006, pp. 233-224.
[43]
P. Cappelletti, An overview of Flash Memories, <www.mdm.infm.it/Versatile/Essderc2007/9-00.pdf>.
[44]
F. Chen, D. Koufaty, X. Zhang, Understanding intrinsic characteristics and system implications of flash memory based solid state drives, in: Proceedings of ACM Sigmetrics 2009, Seattle, June, 2009, pp. 181-192.
[45]
R. Desikan, S. Keckler, D. Burger, Assessment of MRAM Technology Characteristics and Architectures, TR CS Dept., University of Texas at Austin, 2002.
[46]
Gal, E. and Toledo, S., Algorithms and data structures for flash memories. ACM Computing Survey. v37 i2. 138-163.
[47]
S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, H. Franke, DRPM: dynamic speed control for power management in server class disks, in: Proceedings of ISCA 2003, pp. 169-179.
[48]
Intel X25-E SATA Solid State Drive Product Manual, <http://download.intel.com/design/flash/nand/extreme/319984.pdf>.
[49]
K. Kant, Role of Compression in Multi-level Memory Systems, <www.kkant.net/download.html>.
[50]
Kohlstedt, H. and Mustafa, Y., Current status and challenges of ferroelectric memory devices. Microelectronic Engineering. v80. 296-304.
[51]
B.C. Lee, E. Ipek, O. Mutlu, D. Burger, Architecting phase change memory as a scalable DRAM alternative. Proc. of ISCA-2009.
[52]
S. Lee and B. Moon, Design of Flash-based DBMS: An In-Page Logging Approach, Proc. of ACM SIGMOD, August, 2007, pp 55-66.
[53]
Leventhal, A., Flash Storage Memory. Communications of the ACM. 47-51.
[54]
Muller, G. and Happ, T., Status and outlook of emerging nonvolatile memory technologies. IEEE Intl. Electron Devices Meeting. 567-570.
[55]
D. Narayanan, E. Thereska, A. Donnelly, et al., Migrating server storage to SSDs: analysis of tradeoffs, in: Proc. of 4th European conference on Computer systems (EuroSys 2009), Nuremberg, Germany, pp. 145-158.
[56]
E. Pinheiro, R. Bianchini, C. Dubnicki, Exploiting redundancy to conserve energy in storage systems, in: Proc. of ACM SIGMETRICS, 2006, pp. 15-26.
[57]
Wu, C.H., Kuo, T.W. and Chang, L.P., An efficient B-tree layer implementation for flash-memory storage systems. ACM Trans. Embedded Computing Syst. v6 i3.
[58]
Q. Zhu, Z. Chen, L. Tan, et al., Hibernator: helping disk arrays sleep through the winter, in: Proc. of SOSP, 2005, pp. 177-190.
[59]
P. Zhou, Bo Zhao, et al., A durable and energy efficient main memory using phase change memory technology, in: Proceedings of ISCA-2009.
[60]
R. Bitirgen, E. Ipek, J.F. Martinez, Coordinated management of multiple interacting resources in chip multiprocessors: a machine learning approach, in: Proceedings of 41st IEEE/ACM International Symposium on Microarchitecture, 2008, pp. 318-329.
[61]
Brignone, C., Real time asset tracking in the data center. Distributed Parallel Databases. v21. 145-165.
[62]
Common Information Model. <www.wbemsolutions.com/tutorials/CIM/cim-specification.html>.
[63]
Gelene, E., Xiaowen, M. and Onvural, R., Bandwidth allocation and call admission control in high speed networks. IEEE Commun. Mag. 122-129.
[64]
Kallahalla, M., Uysal, M. and Swaminathan, R., SoftUDC: a software-based data center for utility computing. IEEE Computer. v37 i11. 38-46.
[65]
Kant, K., Udar, N. and Viswanathan, R., Enabling location based services in data centers. IEEE Network Mag. v22 i6. 20-25.
[66]
P. Padala, K. Shin, X. Zhu, et al., Adaptive control of virtualized resources in utility computing environments, in: Proceedings of 2007 ACM SIGOPS/EuroSys Conference Lisbon, Portugal, pp. 289-302.
[67]
J. Rao, C.-Z. Xu, CoSL: a coordinated statistical learning approach to measuring the capacity of multi-tier websites, in: Proceedings of International Conference on Parallel and Distributed Processing, April 2008, pp 1-12.
[68]
N. Udar, K. Kant, R. Viswanathan, Asset localization in data center using WUSB radios, in: Proceedings of IFIP Networking, May 2008, pp. 756-767.
[69]
KJ. Xu, M. Zhao, J. Fortes, et al., On the use of fuzzy modeling in virtualized data center management, in: Proceedings of International Conference on Autonomic Computing, June 2007, pp. 25-35.
[70]
N. AbouGhazleh, D. Mosse, B.R. Childers, R. Melhem, Collaborative operating system and compiler power management for real-time applications, ACM Trans. Embedded Systems 5(1) 82-115.
[71]
C.E. Bash, C.D. Patel, R.K. Sharma, Dynamic thermal management of air cooled data centers, in: Proceedings of 10th Conference on Thermal and Thermomechanical Phenomenon in Electronic Systems, June 2006, pp 452-459.
[72]
F. Blanquicet, K. Christensen, An initial performance evaluation of rapid PHY Selection (RPS) for energy efficient ethernet, in: IEEE Conference on Local Computer Networks October 2007, pp. 223-225.
[73]
Barroso, L.A. and Holzle, U., The case for energy-proportional computing. IEEE Computer. v40 i12. 33-37.
[74]
J. Choi, S. Govindan, B. Urgaonkar, et al., Profiling, prediction, and capping of power consumption in consolidated environments, in: Proceedings of MASCOTS, 2008, pp. 3-12.
[75]
J. Choi, Y. Kim, A. Sivasubramanium, et al., Modeling and managing thermal profiles of rack-mounted servers with thermostat, in: Proceedings of HPCA, 2007, pp. 205-215.
[76]
X. Fan, W.-D. Weber, L.A. Barroso, Power provisioning for a warehouse-sized computer, in: Proceedings of 34th International Symposium on Computer Architecture (ISCA), 2007.
[77]
S. Govindan, J. Choi, B. Urgaonkar, et al, Statistical profiling-based techniques for effective power provisioning in data centers, in: Proceedings of 4th European Conference on Computer systems (EuroSys 2009), Nuremberg, Germany, pp. 317-330.
[78]
S. Graupner, V. Kotov, H. Trinks, Resource-sharing and service deployment in virtual data centers, in: Proceedings of ICDCS Workshop, July 2002, pp. 666-671.
[79]
M. Gupta, S. Singh, Dynamic link shutdown for power conservation on ethernet links, in: Proceedings of IEEE International Conference on Communications, June 2007.
[80]
Gurumurthi, S., Kim, Y. and Sivasubramanium, A., Using STEAM for thermal simulation of storage systems. IEEE Micro. v26 i4. 43-51.
[81]
IEEE task group 802.3.az, Energy Efficienct Ethernet. <www.ieee802.org/3/az/public/nov07/hays_1_1107.pdf>.
[82]
S. Harizopoulos, M.A. Shah, J. Meza, P. Ranganathan, Energy efficiency: the new holy grail of data management systems research, in: Conference on Innovative Data Systems Research, January 4-7, 2009.
[83]
T. Heath, E. Pinheiro, et al., Application Transformations for Energy and Performance-Aware Device Management, in: Proceedings of 11th International Conference on Parallel Architectures and Compilation, 2002.
[84]
<http://www.itbusinessedge.com/cm/community/news/inf/blog/intel-tests-free-cooling-in-the-data-center/?cs=20341>.
[85]
C. Isci, A. Buyuktosunoglu, C.-Y. Cher, et. al., An analysis of efficient multi-core global power management policies: maximizing performance for a given power budget, in: Proceedings of IEEE Micro Conference, 2006.
[86]
K. Kant, J. Alexander, Proactive vs. reactive idle power control, August 2008, <www.kkant.net/download.html>.
[87]
K. Kant, Power control of high speed network interconnects in data centers, in: Proceedings of High Speed Networks Symposium at INFOCOM, 2009.
[88]
Kant, K., Towards a science of power management. IEEE Computer. v42 i9. 99-101.
[89]
K. Kant, A control scheme for batching DRAM requests to improve power efficiency. <www.kkant.net/download.html>.
[90]
C. Lefurgy, X. Wang, M. Ware, Server-level power control, in: Proceedings of International Conference on Autonomic Computing, 2007.
[91]
Bob Mammano, Improving Power Supply Efficiency The Global Perspective, Texas Instruments report available at focus.ti.com/download/trng/docs/seminar/Topic1BM.pdf.
[92]
D. Meisner, B.T. Gold, T.F. Wenisch, PowerNap: eliminating server idle power, in: Proc. of ASPLOS, 2009.
[93]
J. Moore, J. Chase, P. Ranganathan, R. Sharma, Making scheduling cool: temperature-aware workload placement in data centers, in: Proc. of Usenix Annual Technical Conf., April, 2005.
[94]
R. Nathuji, A. Somani, K. Schwan, Y. Joshi, CoolIT: Coordinating Facility and IT Management for Efficient Datacenters, HotPower, 2008.
[95]
R. Nathuji, K. Schwan, VirtualPower: coordinated power management in virtualized enterprise systems, in: Proc. of SOSP 2007.
[96]
A. Papathanasiou, M. Scott, Energy efficiency through burstiness, in: Proc of the 5th IEEE Workshop on Mobile Computing Systems and Applications (WMCSA'03), October, 2003, pp. 44-53.
[97]
R. Raghavendra, P. Ranganathan, et al., No power struggles: coordinated multi-level power management for the data center, in: Proc. of 13th ASPLOS, March, 2008.
[98]
V. Raghunathan, M.B. Srivastava, R.K. Gupta, A survey of techniques for energy efficient on-chip communication, in: Proc. the 40th Conference on Design Automation, 2003.
[99]
L. Ramos, R. Bianchini, Predictive thermal management for data centers, in: Proc. of HPCA, 2008.
[100]
P. Ranganathan, P. Leech, D. Irwin, J. Chase, Ensemble-level power management for dense blade servers, in: Proc. of ISCA 2006, pp. 66-77.
[101]
T.D. Richardson, Y. Xie, Evaluation of thermal-aware design techniques for microprocessors, in: Proc. of Int. Conf. on ASICs, 2005, pp. 62-65.
[102]
Sharma, R.K., Bash, C.E. and Patel, C.D., Balance of power: dynamic thermal management for internet data centers. IEEE Internet Computing. v9 i1. 42-49.
[103]
Tan, T.K., Raghunathan, A. and Jha, N.K., Software architectural transformations: a new approach to low energy embedded software. In: Jerraya, A. (Ed.), Book Chapter in Embedded Software for SOC, Kluwer Academic Publishers. pp. 467-484.
[104]
Q. Tang, S.K. Gupta, D. Stanzione, P. Cayton, Thermal-aware task scheduling to minimize energy usage of blade server based datacenters, in: Proc. of Second IEEE Symp. on Autonomic and Secure Computing, October, 2006, pp. 195-202.
[105]
N. Tolia, Z. Wang, M. Marwah, et al., Delivering energy proportionality with non energy-proportional systems - optimizing the ensemble, in: Proc. of HotPower, 2008.
[106]
Venkatachalam, V. and Franz, M., Power reduction techniques for microprocessors. ACM computing surveys. v37 i3. 195-237.
[107]
Y. Wang, K. Ma, X. Wang, Temperature-constrained power control for chip multiprocessors with online model estimation, in: Proc. of ISCA, 2009.
[108]
X. Wang, and Y. Wang, Co-Con: Coordinated control of power and application performance for virtualized server clusters, Proc. of 17th IEEE Intl. workshop on QoS, Charleston, SC, July 2009.
[109]
Q. Wu, M. Martonosi, et al., A dynamic compilation framework for controlling microprocessor energy and performance, in: Proc. of Int. Symp. on Microarhcitecture, Barcelona, 2005, pp. 271-282.

Cited By

View all
  • (2024)The Intersection of Compliance, Databases, and IT OperationsProceedings of the 36th International Conference on Scientific and Statistical Database Management10.1145/3676288.3676297(1-10)Online publication date: 10-Jul-2024
  • (2024)Greedy centroid initialization for federated K-meansKnowledge and Information Systems10.1007/s10115-024-02066-x66:6(3393-3425)Online publication date: 1-Jun-2024
  • (2023)Exploration and Evaluation of Congestion Control Algorithms for Data Center NetworksSN Computer Science10.1007/s42979-023-02016-44:5Online publication date: 30-Jun-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Computer Networks: The International Journal of Computer and Telecommunications Networking
Computer Networks: The International Journal of Computer and Telecommunications Networking  Volume 53, Issue 17
December, 2009
96 pages

Publisher

Elsevier North-Holland, Inc.

United States

Publication History

Published: 01 December 2009

Author Tags

  1. Data center
  2. Ethernet
  3. InfiniBand
  4. Power management
  5. Solid state storage
  6. Virtualization

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 25 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)The Intersection of Compliance, Databases, and IT OperationsProceedings of the 36th International Conference on Scientific and Statistical Database Management10.1145/3676288.3676297(1-10)Online publication date: 10-Jul-2024
  • (2024)Greedy centroid initialization for federated K-meansKnowledge and Information Systems10.1007/s10115-024-02066-x66:6(3393-3425)Online publication date: 1-Jun-2024
  • (2023)Exploration and Evaluation of Congestion Control Algorithms for Data Center NetworksSN Computer Science10.1007/s42979-023-02016-44:5Online publication date: 30-Jun-2023
  • (2022)Energy-Aware Cloud Task Scheduling algorithm in heterogeneous multi-cloud environmentIntelligent Decision Technologies10.3233/IDT-21004816:2(279-284)Online publication date: 1-Jan-2022
  • (2022)Open Source Augmented Reality in Data Center Infrastructure MaintenanceProceedings of the 24th Symposium on Virtual and Augmented Reality10.1145/3604479.3604527(151-156)Online publication date: 24-Oct-2022
  • (2022)Smart DC: An AI and Digital Twin-based Energy-Saving Solution for Data CentersNOMS 2022-2022 IEEE/IFIP Network Operations and Management Symposium10.1109/NOMS54207.2022.9789853(1-6)Online publication date: 25-Apr-2022
  • (2020)Green Information Systems Refraction for Corporate Ecological Responsibility Reflection in ICT Based FirmsJournal of Cases on Information Technology10.4018/JCIT.202001010222:1(14-37)Online publication date: 1-Jan-2020
  • (2019)Comparative study between exact and metaheuristic approaches for virtual machine placement process as knapsack problemThe Journal of Supercomputing10.1007/s11227-019-02847-075:10(6239-6259)Online publication date: 1-Oct-2019
  • (2018)Energy efficient temporal load aware resource allocation in cloud computing datacentersJournal of Cloud Computing: Advances, Systems and Applications10.1186/s13677-017-0103-27:1(1-24)Online publication date: 1-Dec-2018
  • (2018)Improving Lawful Interception in Virtual DatacentersProceedings of the Central European Cybersecurity Conference 201810.1145/3277570.3277578(1-6)Online publication date: 15-Nov-2018
  • Show More Cited By

View Options

View options

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media