research-article

Statistical profiling-based techniques for effective power provisioning in data centers

Authors:

Sriram Govindan,

Jeonghwan Choi,

Bhuvan Urgaonkar,

Anand Sivasubramaniam,

Andrea BaldiniAuthors Info & Claims

EuroSys '09: Proceedings of the 4th ACM European conference on Computer systems

Pages 317 - 330

https://doi.org/10.1145/1519065.1519099

Published: 01 April 2009 Publication History

Abstract

Current capacity planning practices based on heavy over-provisioning of power infrastructure hurt (i) the operational costs of data centers as well as (ii) the computational work they can support. We explore a combination of statistical multiplexing techniques to improve the utilization of the power hierarchy within a data center. At the highest level of the power hierarchy, we employ controlled underprovisioning and over-booking of power needs of hosted workloads. At the lower levels, we introduce the novel notion of soft fuses to flexibly distribute provisioned power among hosted workloads based on their needs. Our techniques are built upon a measurement-driven profiling and prediction framework to characterize key statistical properties of the power needs of hosted workloads and their aggregates. We characterize the gains in terms of the amount of computational work (CPU cycles) per provisioned unit of power Computation per Provisioned Watt (CPW). Our technique is able to double the CPWoffered by a Power Distribution Unit (PDU) running the e-commerce benchmark TPC-W compared to conventional provisioning practices. Over-booking the PDU by 10% based on tails of power profiles yields a further improvement of 20%. Reactive techniques implemented on our Xen VMM-based servers dynamically modulate CPU DVFS states to ensure power draw below the limits imposed by soft fuses. Finally, information captured in our profiles also provide ways of controlling application performance degradation despite overbooking. The 95th percentile of TPC-W session response time only grew from 1.59 sec to 1.78 sec--a degradation of 12%.

References

[1]

Murali Annavaram, Ed Grochowski, and John Shen. Mitigating Amdahl's Law through EPI Throttling. In Proceedings of the International Symposium on Computer Architecture (ISCA), 2005.

Digital Library

[2]

Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, and Andrew Warfield. Xen and the art of virtualization. In SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles, New York, NY, USA, 2003. ACM.

Digital Library

[3]

R. Boorstyn, A. Burchard, J. Liebeherr, and C. Oottamakorn. Statistical Service Assurances for Traffic Scheduling Algorithms. In IEEE Journal on Selected Areas in Communications, 18:12, pages 2651--2664, December 2000.

Digital Library

[4]

Shiva Chaitanya, Bhuvan Urgaonkar, and Anand Sivasubramaniam. QDSL: QoS-aware Systems with Differential Service Levels. In Proceedings of the ACM Conference on Measurement and Modeling of Computer Systems (SIGMETRICS), Annapolis, MD, June 2008.

Digital Library

[5]

J. Choi, S. Govindan, B. Urgaonkar, and A. Sivasubramaniam. Profiling, Prediction, and Capping of Power Consumption in Consolidated Environments. In IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, 2008.

[6]

C. Clark, K. Fraser, Steven Hand, J. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In Proceedings of the 2nd Symposium on Networked Systems Design and Implementation (NSDI'05), May 2005.

Digital Library

[7]

D. Clark. Power Hungry Computers Put Data Centers in Bind. The Wall Street Journal (Online), November 2005. http://hightech.lbl.gov/DCTraining/docs/wsjon-data-ctr-power.pdf.

[8]

Commercial Circuit Breakers. http://circuit--breakers.carlingtech.com/all circuits.asp.

[9]

Dell Power Calculator, May 2008. http://www.dell.com/content/topics/topic.aspx/global/products/pedge/topics/en/configcalculator?c=us\&cs=555\&l=en\&s=biz.

[10]

Dell SC1425, Dec 2005. http://www.dell.com/downloads/global/products/pedge/en/sc1425/specs.pdf.

[11]

X. Fan, W.-D. Weber, and L. A. Barroso. Power Provisioning for a Warehouse-Sized Computer. In Proceedings of the Thirty Fourth Annual International Symposium on Computer Architecture, 2007.

Digital Library

[12]

W. Felter, K. Rajamani, C. Rusu, and T. Keller. A Performance-Conserving Approach for Reducing Peak Power Consumption in Server Systems. In 19th Annual International conference on Supercomputing (ICS), June 2005.

Digital Library

[13]

Gartner 2007. http://www.globalactionplan.org.uk/upload/resource/Full-report.pdf.

[14]

S. Heins. Divorcing Electricity Sales from Profits Creates Win-Win for Utilities and Customers, Energy Pulse, Sept. 2006. http://www.energypulse.net/centers/article/article display.cfm?a id=1342.

[15]

J. Hellerstein, F. Zhang, and P. Shahabuddin. A Statistical Approach to Predictive Detection. Computer Networks, January 2000.

Digital Library

[16]

HP Power Manager. http://h18013.www1.hp.com/products/servers/management/ilo/power-regulator.html.

[17]

IBM Energy Manager. http://www-03.ibm.com/press/us/en/pressrelease/22551.wss.

[18]

IBM Workload Estimator. http://www-304.ibm.com/systems/support/tools/estimator/index.html.

[19]

R. Iyer, V. Tewari, and K. Kant. Overload Control Mechanisms for Web Servers. In Workshop on Performance and QoS of Next Generation Networks, 2000.

[20]

Marianne Lavelle. Conservation Can Mean Profits for Utilities: States are changing the rules of the game so that it pays power companies not to expand, USNews and World Report, May 2008. http://www.usnews.com/.

[21]

C. Lefurgy, X. Wang, and M. Ware. Server-Level Power Control. In ICAC '07: Proceedings of the Fourth International Conference on Autonomic Computing, Washington, DC, USA, 2007. IEEE Computer Society.

Digital Library

[22]

R. Nathuji and K. Schwan. Virtualpower: Coordinated power management in virtualized enterprise systems. In 21st ACM Symposium on Operating Systems Principles (SOSP'07), 2007.

Digital Library

[23]

New York Times Article. Hiding in plain sight, Google Seek More Power, June 2006. http://www.nytimes.com/2006/06/14/technology/14search.html?pagewanted=2.

[24]

K. Park and W. Willinger. Self-Similar Network Traffic and Performance Evaluation. Wiley-Interscience, John Wiley and Sons, Inc., 2000.

Digital Library

[25]

R. Raghavendra, P. Ranganathan, V. Talwar, Z. Wang, and X. Zhu. No Power Struggles: Coordinated multi-level power management for the data center. In 13th International Conference on Architectural Support for Programming Languages and Operating Systems, March 2008.

Digital Library

[26]

L. Ramos and R. Bianchini. C-Oracle: Predictive thermal management for data centers. In Proceedings of the Fourteenth International Symposium on High-Performance Computer Architecture (HPCA'08), February 2008.

[27]

P. Ranganathan, P. Leech, D. Irwin, and Jeff Chase. Ensemble-level Power Management for Dense Blade Servers. In Proceedings of the International Symposium on Computer Architecture (ISCA), June 2006.

Digital Library

[28]

Raritan Inc. 20Amp PDU Model, May 2008. http://www.raritan.com/products/power-management/Dominion-PX/DPCR20-20/.

[29]

Neil Rasmussen. Electrical Efficiency Modeling for Data Centers. In APC White Paper #113, 2007.

[30]

B. C. Smith, J. F. Leimkuhler, and R. M. Darrow. Yield Management at American Airlines. In Interfaces, 22:1, pages 8--31, Jan 1992.

[31]

W. Smith. TPC-W: Benchmarking An Ecommerce Solution. http://www.tpc.org/information/other/techarticles.asp.

[32]

SPEC POWER. http://www.spec.org/specpower/.

[33]

SPECCPU. http://www.spec.org/cpu2000/.

[34]

SPECJBB. http://www.spec.org/jbb2005/.

[35]

J. Stoess, C. Lang, and F. Bellosa. Energy Management for Hypervisor-Based Virtual Machines. In Proceedings of the 2007 USENIX Technical Conference (USENIX'07), June 2007.

Digital Library

[36]

B. Urgaonkar, P. Shenoy, and T. Roscoe. Resource Overbooking and Application Profiling in Shared Hosting Platforms. In Proceedings of the 5th USENIX Symposium on Operating Systems Design and Implementation (OSDI), Boston, Dec 2002.

Digital Library

[37]

C. Waldspurger. Memory Resource Management in VMWare ESX Server. In Proceedings of the Fifth Symposium on Operating System Design and Implementation (OSDI'02), December 2002.

Digital Library

[38]

X. Wang and M. Chen. Cluster-level feedback power control for performance optimization. In Proceedings of the Fourteenth International Symposium on High-Performance Computer Architecture (HPCA'08), February 2008.

[39]

Andreas Weisel and Frank Bellosa. Process cruise control-event-driven clock scaling for dynamic power management. In Proceedings of the International Conference on Compilers, Architecture and Synthesis for Embedded Systems, October 2002.

Digital Library

[40]

H. Zeng, X. Fan, C. Ellis, A. Lebeck, and A. Vahdat. ECOSystem: Managing Energy as a First Class Operating System Resource. In Proceedings of the Architectural Support for Programming Languages and Operating Systems, Oct 2002.

Digital Library

[41]

Server and Data Center Energy Efficiency -- EPA, August 2007. http://www.energystar.gov/ia/partners/prod development/downloads/EPA Datacenter Report Congress Final1.pdf.

Cited By

Piga LNarayanan ISundarrajan ASkach MDeng QMaity BChakkaravarthy MHuang ADhanotia AMalani PTsafrir DMUSUVATHI MGupta RAbu-Ghazaleh N(2024)Expanding Datacenter Capacity with DVFS Boosting: A safe and scalable deployment experienceProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 110.1145/3617232.3624853(150-165)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3617232.3624853
Stojkovic JMisra PGoiri ÍWhitlock SChoukse EDas MBansal CLee JSun ZQiu HZimmermann RSamal SWarrier BRaniwala ABianchini R(2024)SmartOClock: Workload- and Risk-Aware Overclocking in the Cloud2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA59077.2024.00040(437-451)Online publication date: 29-Jun-2024
https://doi.org/10.1109/ISCA59077.2024.00040
Wu SChen YWang XJin HLiu FChen HYan C(2021)Precise Power Capping for Latency-Sensitive Applications in DatacenterIEEE Transactions on Sustainable Computing10.1109/TSUSC.2018.28818936:3(469-480)Online publication date: 1-Jul-2021
https://doi.org/10.1109/TSUSC.2018.2881893
Show More Cited By

Index Terms

Statistical profiling-based techniques for effective power provisioning in data centers
1. General and reference
  1. Cross-computing tools and techniques

Recommendations

How much power oversubscription is safe and allowed in data centers
ICAC '11: Proceedings of the 8th ACM international conference on Autonomic computing

Data centers attempt to maximize return on investment by achieving high levels of utilization. This means deploying the maximum number of servers possible within existing power supply capabilities. Therefore, a key problem is determining how many ...
Towards Economical Live Migration in Data Centers
Economics of Grids, Clouds, Systems, and Services
Abstract
Live migration of virtual machines (VMs) enables maintenance, load balancing, and power management in data centers. The cost of live migration on several key metrics combined with strict service-level objectives (SLOs), however, typically limits ...
A survey on virtual machine migration and server consolidation frameworks for cloud data centers

Modern Cloud Data Centers exploit virtualization for efficient resource management to reduce cloud computational cost and energy budget. Virtualization empowered by virtual machine (VM) migration meets the ever increasing demands of dynamic workload by ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

EuroSys '09: Proceedings of the 4th ACM European conference on Computer systems

April 2009

342 pages

ISBN:9781605584829

DOI:10.1145/1519065

General Chair:
Wolfgang Schröder-Preikschat
FAU Erlangen-Nuremberg, Germany
,
Program Chairs:
John Wilkes
Google, Inc., USA
,
Rebecca Isaacs
Microsoft Research, Cambridge, UK

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 April 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

EuroSys '09

Sponsor:

SIGOPS

EuroSys '09: Fourth EuroSys Conference 2009

April 1 - 3, 2009

Nuremberg, Germany

Acceptance Rates

Overall Acceptance Rate 241 of 1,308 submissions, 18%

Upcoming Conference

EuroSys '25

Sponsor:
sigops

Twentieth European Conference on Computer Systems

March 30 - April 3, 2025

Rotterdam , Netherlands

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

122
Total Citations
View Citations
877
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Piga LNarayanan ISundarrajan ASkach MDeng QMaity BChakkaravarthy MHuang ADhanotia AMalani PTsafrir DMUSUVATHI MGupta RAbu-Ghazaleh N(2024)Expanding Datacenter Capacity with DVFS Boosting: A safe and scalable deployment experienceProceedings of the 29th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 110.1145/3617232.3624853(150-165)Online publication date: 27-Apr-2024
https://dl.acm.org/doi/10.1145/3617232.3624853
Stojkovic JMisra PGoiri ÍWhitlock SChoukse EDas MBansal CLee JSun ZQiu HZimmermann RSamal SWarrier BRaniwala ABianchini R(2024)SmartOClock: Workload- and Risk-Aware Overclocking in the Cloud2024 ACM/IEEE 51st Annual International Symposium on Computer Architecture (ISCA)10.1109/ISCA59077.2024.00040(437-451)Online publication date: 29-Jun-2024
https://doi.org/10.1109/ISCA59077.2024.00040
Wu SChen YWang XJin HLiu FChen HYan C(2021)Precise Power Capping for Latency-Sensitive Applications in DatacenterIEEE Transactions on Sustainable Computing10.1109/TSUSC.2018.28818936:3(469-480)Online publication date: 1-Jul-2021
https://doi.org/10.1109/TSUSC.2018.2881893
Pang PChen QZeng DGuo M(2021)Adaptive Preference-Aware Co-Location for Improving Resource Utilization of Power Constrained DatacentersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.302399732:2(441-456)Online publication date: 1-Feb-2021
https://doi.org/10.1109/TPDS.2020.3023997
Zhang CKumbhare AManousakis IZhang DMisra PAssis RWoolcock KMahalingam NWarrier BGauthier DKunnath LSolomon SMorales OFontoura MBianchini RMartínez JDuato JJohn L(2021)FlexProceedings of the 48th Annual International Symposium on Computer Architecture10.1109/ISCA52012.2021.00033(319-332)Online publication date: 14-Jun-2021
https://dl.acm.org/doi/10.1109/ISCA52012.2021.00033
Ahmed MAhmed W(2021)State-of-the-Art Power Management TechniquesProceedings of Second Doctoral Symposium on Computational Intelligence10.1007/978-981-16-3346-1_18(223-236)Online publication date: 20-Sep-2021
https://doi.org/10.1007/978-981-16-3346-1_18
Kumbhare NMarathe AAkoglu ASiegel HAbdulla GHariri S(2020)A Value-Oriented Job Scheduling Approach for Power-Constrained and Oversubscribed HPC SystemsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2020.296737331:6(1419-1433)Online publication date: 1-Jun-2020
https://doi.org/10.1109/TPDS.2020.2967373
Yin YWu JZhou XEeckhout LQouneh ALi TYu Z(2020)COPA: Highly Cost-Effective Power Back-Up for Green DatacentersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2019.294833631:4(967-980)Online publication date: 1-Apr-2020
https://doi.org/10.1109/TPDS.2019.2948336
Sun QRen SWu C(2020)Fair Online Power Capping for Emergency Handling in Multi-Tenant Cloud Data CentersIEEE Transactions on Cloud Computing10.1109/TCC.2017.27623118:1(152-166)Online publication date: 1-Jan-2020
https://doi.org/10.1109/TCC.2017.2762311
Narayanan ISivasubramaniam A(2020)Mediating Power Struggles on a Shared Server2020 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)10.1109/ISPASS48437.2020.00030(149-159)Online publication date: Aug-2020
https://doi.org/10.1109/ISPASS48437.2020.00030
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents