research-article

Aggressive Datacenter Power Provisioning with Batteries

Authors:

Sriram Govindan,

Anand Sivasubramaniam,

Bhuvan UrgaonkarAuthors Info & Claims

ACM Transactions on Computer Systems (TOCS), Volume 31, Issue 1

Article No.: 2, Pages 1 - 31

https://doi.org/10.1145/2427631.2427633

Published: 01 February 2013 Publication History

Abstract

Datacenters spend $10--25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively underprovision infrastructure assuming that simultaneous peak draw across all equipment will happen rarely. The resulting nonzero probability of emergency events where power needs exceed provisioned capacity, however small, mandates graceful reaction mechanisms to cap the power draw instead of leaving it to disruptive circuit breakers/fuses. Existing strategies for power capping use temporal knobs local to a server that throttle the rate of execution (using power modes), and/or spatial knobs that redirect/migrate excess load to regions of the datacenter with more power headroom. We show these mechanisms to have performance degrading ramifications, and propose an entirely orthogonal solution that leverages existing UPS batteries to temporarily augment the utility supply during emergencies. We build an experimental prototype to demonstrate such power capping on a cluster of 8 servers, each with an individual battery, and implement several online heuristics in the context of different datacenter workloads to evaluate their effectiveness in handling power emergencies. We show that our battery-based solution can: (i) handle emergencies of short durations on its own, (ii) supplement existing reaction mechanisms to enhance their efficacy for longer emergencies, and (iii) create more slack for shifting applications temporarily to nonpeak durations.

References

[1]

Ahmad, F. and Vijaykumar, T. N. 2010. Joint optimization of idle and cooling power in data centers while maintaining response time. In Proceedings of the 15th Edition of ASPLOS on Architectural Support for Programming Languages and Operating Systems (ASPLOS’10). ACM, New York, 243--256.

Digital Library

[2]

Amur, H., Cipar, J., Gupta, V., Ganger, G. R., Kozuch, M., and Schwan, K. 2010. Robust and flexible power-proportional storage. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC’10). ACM, New York, 217--228.

Digital Library

[3]

Ardakanian, O., Rosenberg, C., and Keshav, S. 2012. On the impact of storage in residential power distribution systems. In Proceedings of the Greenmetrics Workshop.

[4]

Bar-Noy, A., Feng, Y., Johnson, M. P., and Liu, O. 2008. When to reap and when to sow: Lowering peak usage With realistic batteries. In Proceedings of the Workshop on Experimental Algorithms (WEA).

Digital Library

[5]

Barker, S., Mishra, A., Irwin, D., Shenoy, P., Kurose, J., and Albrecht, J. 2012. SmartCap: Flattening peak electricity demand in smart homes. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom).

[6]

Barroso, L. A. and Holzle, U. 2007. The case for energy-proportional computing. J. Comput. 40, 12, 33--37.

Digital Library

[7]

Barroso, L. A. and Holzle, U. 2009. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan and Claypool Publishers.

Digital Library

[8]

Bhandarkar, D. Server design summit, 2010. Watt matters in energy efficiency. Keynote speech.

[9]

Bhattacharya, A. A., Culler, D., Kansal, A., Govindan, S., and Sankar, S. 2012. The need for speed and stability in data center power capping. In Proceedings of the Green Computing Conference (IGCC).

Digital Library

[10]

Chase, J., Anderson, D., Thakur, P., and Vahdat, A. 2001. Managing energy and server resources in hosting centers. In Proceedings of the Symposium on Operating Systems Principles (SOSP).

Digital Library

[11]

Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., and Zhao, F. 2008. Energy-Aware server provisioning and load dispatching for connection-intensive internet services. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[12]

Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., and Gautam, N. 2005. Managing server energy and operational costs in hosting centers. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS).

Digital Library

[13]

Clark, C., Fraser, K., Hand, S., Hansen, J., Jul, E., Limpach, C., Pratt, I., and Warfield, A. 2005. Live migration of virtual machines. In Proceedings of the Symposium on Networked Systems Design and Implementation (NSDI).

Digital Library

[14]

Commercial Circuit Breakers. 2008. Commercial Circuit Breakers. (2008). http://circuit-breakers.carlingtech.com/allcircuits.asp

[15]

Deng, Q., Meisner, D., Ramos, L., Wenisch, T. F. and Bianchini, R. 2011. MemScale: Active lowpower modes for main memory. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).

Digital Library

[16]

Facebook Server-level UPS batteries. 2009. Facebook Server-level UPS batteries. http://www.datacenterknowledge.com/archives/2009/11/27/facebook-follows-google-to-data-center-savings/

[17]

Fan, X., Weber, W. -D., and Barroso, L. A. 2007. Power provisioning for a warehouse-sized computer. In Proceedings of the International Symposium on Computer Architecture (ISCA).

Digital Library

[18]

Felter, W., Rajamani, K., Rusu, C., and Keller, T. 2005. A Performance-Conserving approach for reducing peak power consumption in server systems. In Proceedings of the International Conference on Supercomputing (ICS).

Digital Library

[19]

Femal, M. E. and Freeh, V. W. 2004. Safe overprovisioning: Using power limits to increase aggregate throughput. In Proceedings of the Workshop on Power-Aware Computer Systems (PACS).

Digital Library

[20]

Flinn, J. and Satyanarayanan, M. 2004. Managing battery lifetime with energy-aware adaptation. Trans. Comput. Syst. 22, 2, 137--179.

Digital Library

[21]

Gandhi, A., Harchol-Balter, M., Das, R., and Lefurgy, C. 2009. Optimal power allocation in server farms. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS).

Digital Library

[22]

Ganesh, L., Liu, J., Nath, S., Reeves, G., and Zhao, F. 2009. Unleash stranded power in data centers with rackpacker. In Proceedings of the Workshop on Energy-Effcient Design (WEED).

[23]

Gast, N. G., Tomozei, D. -C., and Le Boudec, J. -Y. 2012. Optimal storage policies with wind forecast uncertainties. In Proceedings of the Greenmetrics Workshop.

Digital Library

[24]

Goiri, I., Le, K., Nguyen, T. D., Guitart, J., Torres, J., Bianchini, R. D. 2012. GreenHadoop: Leveraging green energy in data-processing frameworks. In Proceedings of the ACM European Conference on Computer Systems (EUROSYS).

Digital Library

[25]

Google Server-level UPS batteries. 2009. Google Server-level UPS batteries. http://news.cnet.com/8301-10013-10209580-92.html

[26]

Govindan, S., Choi, J., Urgaonkar, B., Sivasubramaniam, B., and Baldini, A. 2009. Statistical profiling-based techniques for effective power provisioning in data centers. In Proceedings of the International European Conference on Computer Systems (EUROSYS).

Digital Library

[27]

Govindan, S., Sivasubramaniam, A., and Urgaonkar, B. 2011a. Benefits and limitations of tapping into stored energy for datacenters. In Proceedings of the International Symposium of Computer Architecture (ISCA).

Digital Library

[28]

Govindan, S., Wang, D., Chen, L., Sivasubramaniam, A., and Urgaonkar, B. 2011b. Towards realizing a low cost and highly available datacenter power infrastructure. In Proceedings of the Workshop on Power Aware Computing and Systems (HotPower).

Digital Library

[29]

Hadoop Map Reduce. 2007. Hadoop map reduce. http://hadoop.apache.org/mapreduce/

[30]

Hamilton, J. 2009. ISCA keynote 2009. Internet-Scale service infrastructure effciency. In Proceedings of the Annual International Symposium on Computer Architecture (ISCA).

Digital Library

[31]

Kontorinis, V., Zhang, L. E., Aksanli, B., Sampson, J., Homayoun, H., Petis, E., Tullsen, D. M. and Rosing, T. S. 2012. Managing distributed UPS energy for effective power capping in data centers. In Proceedings of the International Symposium on Computer Architecture (ISCA).

Digital Library

[32]

Le, K., Bianchini, R., Martonosi, M., and Nguyen, T. 2009. Cost- and energy-aware load distribution across data centers. In Proceedings of the Workshop on Power-Aware Computing and Systems (HOTPOWER).

[33]

Le, K., Bianchini, R., Nguyen, T. D., Bilgir, O., and Martonosi, M. 2010. Capping the brown energy consumption of Internet services at low cost. In Proceedings of the Green Computing Conference (IGCC).

Digital Library

[34]

Lead-acid battery cost. 2010. Lead-acid battery cost. http://energy.sandia.gov/wp/wp-content/gallery/uploads/093669c.pdf

[35]

Lefurgy, C., Wang, X., and Ware, M. 2007. Server-Level power control. In Proceedings of International Conference on Autonomic Computing (ICAC).

Digital Library

[36]

Lim, H., Kansal, A., and Liu, J. 2011. Power budgeting for virtualized data centers. In Proceedings of the USENIX Conference on USENIX Annual Technical Conference.

Digital Library

[37]

Lin, M., Wierman, A., Andrew, L. L. H., and Thereska, E. 2011. Dynamic right-sizing for power-proportional data centers. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM).

[38]

Linden, D. and Reddy, T. B. 2002. Handbook of Batteries. McGraw Hill.

[39]

Linux AVG Anti Virus. 2012. Linux AVG anti virus. http://free.avg.com/

[40]

Ma, K., Li, X., Chen, M., and Wang, X. 2011. Scalable power control for many-core architectures running multithreaded applications. In Proceedings of the International Symposium on Computer Architecture (ISCA).

Digital Library

[41]

McCluer, S. 2005. APC white paper 30 (Revision 11): Battery technology for data centers and network rooms: Lead-Acid battery options. Whitepaper.

[42]

Meisner, D., Sadler, C. M., Barroso, L. A., Weber, W., and Wenisch, T. F. 2011. Power management of online data-intensive services. In Proceedings of the International Symposium on Computer Architecture (ISCA).

Digital Library

[43]

Microsoft Rack-level UPS batteries. 2011. Microsoft Rack-level UPS batteries. http://www.datacenterknowledge.com/archives/2011/04/25/microsoft-reveals-its-speciality-servers-racks/

[44]

Mishra, A., Irwin, D., Shenoy, P., Kurose, J., and Zhu, T. 2012. SmartCharge: Cutting the electricity bill in smart homes with energy storage. In Proceedings of the International Conference on Future Energy Systems: Where Energy, Computing and Communication Meet (e-Energy).

Digital Library

[45]

Moore, J., Chase, J., Ranganathan P., and Sharma, R. 2005. Making scheduling cool: Temperature-Aware workload placement in data centers. In Proceedings of the Usenix Annual Technical Conference.

Digital Library

[46]

Pelley, S., Meisner, D., Zandevakili, P., Wenisch, T. F. and Underwood, J. 2010. Power routing: Dynamic power provisioning in the data center. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).

Digital Library

[47]

Pinheiro, E., Bianchini, R., Carrera, E., and Heath, T. 2001. Load balancing and unbalancing for power and performance in cluster-based systems. In Proceedings of the Workshop on Compilers and Operating Systems for Low Power (COLP).

[48]

Qureshi, A., Weber, R., Balakrishnan, H., Guttag, J., and Maggs, B. 2009. Cutting the electric bill for internet-scale systems. In Proceedings of the ACM SIGCOMM Conference on Data Communication (SIGCOMM).

Digital Library

[49]

Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., and Zhu, X. 2008. No power struggles: Coordinated multi-level power management for the data center. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).

Digital Library

[50]

Ramos, L. and Bianchini, R. 2008. C-Oracle: Predictive thermal management for data centers. In Proceedings of the International Symposium on High-Performance Computer Architecture (HPCA).

[51]

Ranganathan, P., Leech, P., Irwin, D., and Chase, J. 2006. Ensemble-Level power management for dense blade servers. In Proceedings of International Symposium on Computer Architecture (ISCA).

Digital Library

[52]

Rao, L., Liu, X., and Liu, W. 2010a. Minimizing electricity cost: Optimization of distributed internet data centers in a multi-electricity-market environment. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOMM).

Digital Library

[53]

Rao, L., Liu, X., Ilic, M., and Liu, J. 2010b. MEC-IDC: Joint load balancing and power control for distributed Internet data centers. In Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS).

Digital Library

[54]

Ren, J., Wang, D., Urgaonkar, B., and Sivasubramaniam, A. 2012. Carbon-Aware energy capacity planning for datacenters. In Proceedings of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS).

Digital Library

[55]

Sharma, N., Barker, S., Irwin, D., and Shenoy, P. 2011. Blink: Managing server clusters on intermittent power. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).

Digital Library

[56]

Smith, B. C., Leimkuhler, J. F., and Darrow, R. M. 1992. Yield management at american airlines. Interfaces 22, 1, 8--31.

Digital Library

[57]

Smith, W. 2000. TPC-W: Benchmarking an ecommerce solution. http://www.tpc.org/information/other/techarticles.asp.

[58]

SPECjbb. 2005. SPEC JBB2005: Java business benchmark. http://www.spec.org/jbb2005/

[59]

Urgaonkar, B., Shenoy, P., and Roscoe, T. 2002. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI).

Digital Library

[60]

Urgaonkar, R., Urgaonkar, B., Neely, M. J., and Sivasubramaniam, A., 2011. Optimal power cost management using stored energy in data centers. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS).

Digital Library

[61]

Vasan, A., Sivasubramaniam, A., Shimpi, V., Sivabalan, T., and Subbiah, R. 2010. Worth their watts? - an empirical study of data center servers. In Proceedings of the International Symposium on High Performance Computer Architecture (HPCA).

[62]

Ven, P., Hegde, N., Massoulie, L., and Salonidis, T. 2011. Optimal control of residential energy storage under price fluctuations. In Proceedings of the International Conference on Smart Grids, Green Communications and IT Energy-Aware Technologies.

[63]

Verma, A., De, P., Mann, V., Nayak, T., Purohit, A., Dasgupta, G., and Kothari, R. 2010. BrownMap: Enforcing power budget in shared data centers. In Proceedings of the Conference on Middleware (MIDDLEWARE).

Digital Library

[64]

Waldspurger, C. 2002. Memory resource management in VMWare ESX server. In Proceedings of the Symposium on Operating System Design and Implementation (OSDI).

Digital Library

[65]

Wang, D., Ren, C., Sivasubramaniam, A., Urgaonkar, B., and Fathy, H. 2012. Energy storage in datacenters: What, where, and how much? In Proceedings of the ACM SIGMETRICS/PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS).

Digital Library

[66]

Wang, X. and Chen, M. 2008. Cluster-Level feedback power control for performance optimization. In Proceedings of the International Symposium on High-Performance Computer Architecture (HPCA).

[67]

Wang, X., Chen, M., and Lefurgy, C. 2011. How much power oversubscription is safe and allowed in data centers? In Proceedings of the International Conference on Autonomic Computing (ICAC).

Digital Library

[68]

Weisel, A. and Bellosa, F. 2002. Process cruise control-event-driven clock scaling for dynamic power management. In Proceedings of the International Conference on Compilers, Architecture and Synthesis for Embedded Systems (CASES).

Digital Library

[69]

Zeng, H., Fan, X., Ellis, C., Lebeck, A., and Vahdat, A. 2002. ECOSystem: Managing energy as a first class operating system resource. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS).

Digital Library

[70]

Zhang, F., Shi, Z., and Wolf, W. 2009. A dynamic battery model for co-design in cyber-physical systems. In Proceedings of the International Conference on Distributed Computing Systems Workshops (ICDCSW).

Digital Library

[71]

Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., and Wilkes, J. 2005. Hibernator: Helping diskarrays sleep through the winter. In Proceedings of the Symposium on Operating Systems Principles (SOSP).

Digital Library

Cited By

Haghshenas KTaheri SGoudarzi MMohammadi S(2022)Infrastructure Aware Heterogeneous-Workloads Scheduling for Data Center Energy Cost MinimizationIEEE Transactions on Cloud Computing10.1109/TCC.2020.297704010:2(972-983)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TCC.2020.2977040
Shao ZIslam MRen S(2021)Heat Behind the Meter: A Hidden Threat of Thermal Attacks in Edge Colocation Data Centers2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA)10.1109/HPCA51647.2021.00035(318-331)Online publication date: Feb-2021
https://doi.org/10.1109/HPCA51647.2021.00035
Yang LHajiesmaili MSitaraman RWierman AMallada EWong W(2020)Online Linear Optimization with Inventory Management ConstraintsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/33794824:1(1-29)Online publication date: 5-Jun-2020
https://dl.acm.org/doi/10.1145/3379482
Show More Cited By

Index Terms

Aggressive Datacenter Power Provisioning with Batteries
1. Computer systems organization

Recommendations

Virtualizing power distribution in datacenters
ISCA '13: Proceedings of the 40th Annual International Symposium on Computer Architecture

Power infrastructure contributes to a significant portion of datacenter expenditures. Overbooking this infrastructure for a high percentile of the needs is becoming more attractive than for occasional peaks. There exist several computing knobs to cap ...
Leveraging stored energy for handling power emergencies in aggressively provisioned datacenters
ASPLOS '12

Datacenters spend $10-25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively under-...
Leveraging stored energy for handling power emergencies in aggressively provisioned datacenters
ASPLOS '12

Datacenters spend $10-25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively under-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer Systems

ACM Transactions on Computer Systems Volume 31, Issue 1

February 2013

96 pages

ISSN:0734-2071

EISSN:1557-7333

DOI:10.1145/2427631

Issue’s Table of Contents

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 February 2013

Accepted: 01 November 2012

Received: 01 August 2012

Published in TOCS Volume 31, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
790
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)2

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Haghshenas KTaheri SGoudarzi MMohammadi S(2022)Infrastructure Aware Heterogeneous-Workloads Scheduling for Data Center Energy Cost MinimizationIEEE Transactions on Cloud Computing10.1109/TCC.2020.297704010:2(972-983)Online publication date: 1-Apr-2022
https://doi.org/10.1109/TCC.2020.2977040
Shao ZIslam MRen S(2021)Heat Behind the Meter: A Hidden Threat of Thermal Attacks in Edge Colocation Data Centers2021 IEEE International Symposium on High-Performance Computer Architecture (HPCA)10.1109/HPCA51647.2021.00035(318-331)Online publication date: Feb-2021
https://doi.org/10.1109/HPCA51647.2021.00035
Yang LHajiesmaili MSitaraman RWierman AMallada EWong W(2020)Online Linear Optimization with Inventory Management ConstraintsProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/33794824:1(1-29)Online publication date: 5-Jun-2020
https://dl.acm.org/doi/10.1145/3379482
Jiang YHuang ZTsang D(2020)On Power-Peak-Aware Scheduling for Large-Scale Shared ClustersIEEE Transactions on Big Data10.1109/TBDATA.2018.28746636:2(412-426)Online publication date: 1-Jun-2020
https://doi.org/10.1109/TBDATA.2018.2874663
Malla SDeng QEbrahimzadeh ZGasperetti JJain SKondety POrtiz TVieira D(2020)Coordinated Priority-aware Charging of Distributed Batteries in Oversubscribed Data Centers2020 53rd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO)10.1109/MICRO50266.2020.00073(839-851)Online publication date: Oct-2020
https://doi.org/10.1109/MICRO50266.2020.00073
Ahmad SRosenthal AHajiesmaili MSitaraman R(2019)Learning from OptimalProceedings of the Tenth ACM International Conference on Future Energy Systems10.1145/3307772.3328308(326-330)Online publication date: 15-Jun-2019
https://dl.acm.org/doi/10.1145/3307772.3328308
Jiang WJia ZFeng SLiu FJin HManne SHunter HAltman E(2019)Fine-grained warm water cooling for improving datacenter economyProceedings of the 46th International Symposium on Computer Architecture10.1145/3307650.3322236(474-486)Online publication date: 22-Jun-2019
https://dl.acm.org/doi/10.1145/3307650.3322236
Muhammad SRafique MLi SShao ZWang QLiu X(2019)Reconfigurable Battery SystemsACM Transactions on Design Automation of Electronic Systems10.1145/330130124:2(1-27)Online publication date: 7-Mar-2019
https://dl.acm.org/doi/10.1145/3301301
Dabbagh MHamdaoui BRayes AGuizani M(2019)Shaving Data Center Power Demand Peaks Through Energy Storage and Workload Shifting ControlIEEE Transactions on Cloud Computing10.1109/TCC.2017.27446237:4(1095-1108)Online publication date: 1-Oct-2019
https://doi.org/10.1109/TCC.2017.2744623
Skach MArora MTullsen DTang LMars J(2018)Virtual melting temperatureProceedings of the 45th Annual International Symposium on Computer Architecture10.1109/ISCA.2018.00013(15-28)Online publication date: 2-Jun-2018
https://dl.acm.org/doi/10.1109/ISCA.2018.00013
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents