research-article

Stochastic approximation control of power and tardiness in a three-tier web-hosting cluster

Authors:

Julius C.B. Leite,

Luciano BertiniAuthors Info & Claims

ICAC '10: Proceedings of the 7th international conference on Autonomic computing

Pages 41 - 50

https://doi.org/10.1145/1809049.1809056

Published: 07 June 2010 Publication History

Abstract

Large-scale web-hosting and data centers are increasingly challenged to reduce power consumption while maintaining a minimum quality of service. Dynamic voltage and frequency scaling provides one technique to curb power consumption by limiting the power supply and/or frequency of the CPU at the expense of lower execution speed. Model-based approaches often require tedious offline profiling, and generating an accurate model under all conditions may be infeasible. This paper develops a stochastic feedback-control algorithm, and couples it with a method of stochastic optimization to minimize power consumption while maintaining tardiness in a three-tier system. Our approach assumes nothing about the system and the application, treating each as a 'black box.' The scheme is effective under limited dynamic workload conditions that can alter the response times and power consumption to be approximated. With little overhead, the control scheme is able to maintain a specified quantile of tardiness under a desired threshold, while suppressing power consumption to within 1% of its theoretical minima.

References

[1]

H. Robbins and S. Monro, "A stochastic approximation method," The Annals of Mathematical Stats., vol. 22, no. 3, pp. 400--407, Sep. 1951.

[2]

L. Bertini, J. C. B. Leite, and D. Mossé, "Generalized tardiness quantile metric: Distributed dvs for soft real-time web clusters," in Euromicro Conf. on Real-time Sys., Jul. 2009, pp. 227--236.

Digital Library

[3]

J. Kiefer and J. Wolfowitz, "Stochastic estimation of the maximum of a regression function," The Annals of Mathematical Stats., vol. 23, no. 3, pp. 462--466, Sep. 1952.

[4]

L. Bertini, J. C. B. Leite, and D. Mossé, "Statistical qos guarantee and energy-efficiency in web server systems," in Euromicro Conf. on Real-time Sys., Jul. 2007, pp. 83--92.

Digital Library

[5]

P. Ranganathan, P. Leech, D. Irwin, and J. Chase, "Ensemble-level power management for dense blade servers," in Proc. of the IEEE Sym. on Computer Architecture, Jun. 2006, pp. 66--77.

Digital Library

[6]

C. Lefurgy, X. Wang, and M. Ware, "Server-level power control," in IEEE Int'l. Conf. on Autonomic Computing, Jun. 2007, pp. 4--13.

Digital Library

[7]

E. Pinheiro, R. Bianchini, and T. Heath, Dynamic Cluster Reconfiguration for Power and Performance. Kluwer Academic Publishers, 2003.

[8]

V. Sharma, A. Thomas, T. Abdelzaher, K. Skadron, and Z. Lu, "Power-aware qos management in web servers," in IEEE Int'l. Real-time Sys. Sym., Dec. 2003, pp. 63--72.

Digital Library

[9]

M. Elnozahy, M. Kistler, and R. Rajamony, "Energy-efficient server clusters," in Wrkshp. on Power-Aware Computing Sys., Feb. 2002, pp. 126--37.

Digital Library

[10]

D. Kusic, J. Kephart, J. Hanson, N. Kandasamy, and G. Jiang, "Power and performance management of virtualized computing environments via lookahead control," in IEEE Intl. Conf. on Autonomic Computing, Jun. 2008, pp. 3--12.

Digital Library

[11]

D. Kusic and N. Kandasamy, "Risk-aware limited lookahead control for dynamic resource provisioning in enterprise computing systems," in IEEE Intl. Conf. on Autonomic Computing, Jun. 2006, pp. 74--83.

Digital Library

[12]

Z. Lu, J. Hein, M. Humphrey, M. Stan, J. Lach, and K. Skadron, "Control-theoretic dynamic frequency and voltage scaling for multimedia workloads," in Int'l. Conf. on Compilers, Arch., and Synthesis for Embedded Sys., Oct. 2002, pp. 156--163.

Digital Library

[13]

J. Kephart, H. Chan, D. Levine, G. Tesauro, F. Rawson, and C. Lefurgy, "Coordinating multiple autonomic managers to achieve specified power-performance tradeoffs," in IEEE Intl. Conf. on Autonomic Computing, Jun. 2007, pp. 145--154.

Digital Library

[14]

T. Horvath, T. Abdelzaher, K. Skadron, and X. Liu, "Dynamic voltage scaling in multitier web servers with end-to-end delay control," IEEE Trans. on Computers, vol. 56, no. 4, pp. 444--458, Apr. 2007.

Digital Library

[15]

M. Bennani and D. Menascé, "Resource allocation for autonomic data centers using analytic performance models," in IEEE Intl. Conf. on Autonomic Computing. IEEE, June 2005, pp. 229--240.

Digital Library

[16]

J. Heo, D. Henriksson, X. Liu, and T. Abdelzaher, "Integrating adaptive components: An emerging challenge in performance-adaptive systems and a server farm case--study," in IEEE Int'l. Real-Time Sys. Sym., Dec. 2007, pp. 227--238.

Digital Library

[17]

C. Tsai, K. Shin, J. Reumann, and S. Singhal, "Online web cluster capacity estimation and its application to energy conservation," IEEE Trans. on Parallel and Dist. Sys., vol. 18, no. 7, pp. 932--945, Jul. 2007.

Digital Library

[18]

L. Bertini, J. C. B. Leite, and D. Mossé, "Optimal dynamic configuration in web server clusters," J. of Sys. and Software, vol. 83, no. 4, pp. 585--598, Apr. 2010.

Digital Library

[19]

T. Ishihara and H. Yasuura, "Voltage scheduling problem for dynamically variable voltage processors," in IEEE Int'l. Sym. on Low Power Electronics and Design, Aug. 1998, pp. 197--202.

Digital Library

[20]

D. Zhu, R. Melhem, and B. Childers, "Scheduling with dynamic voltage/speed adjustment using slack reclamation in multiprocessor real-time systems," IEEE Trans. on Parallel and Dist. Sys., vol. 14, no. 7, pp. 686--700, Jul. 2003.

Digital Library

[21]

M. Femal and V. Freeh, "Feedback control architecture and design methodology for service delay guarantees in web servers," Lecture Notes in Computer Science, vol. 3471, no. 1, pp. 150--164, Dec. 2005.

Digital Library

[22]

Y. Diao, J. Hellerstein, G. Kaiser, S. Parekh, and D. Phung, "Self-managing systems: A control theory foundation," IBM T.J. Watson Labs, Tech. Rep., Oct. 2004.

[23]

J. Hellerstein, Y. Diao, S. Parekh, and D. Tilbury, Feedback Control of Computing Systems. Wiley-Interscience, 2004.

Digital Library

[24]

J. Xu, M. Zhao, J. Fortes, R. Carpenter, and M. Yousif, "On the use of fuzzy modeling in virtualized data center management," in IEEE Intl. Conf. on Autonomic Computing, Jun. 2007, pp. 25--35.

Digital Library

[25]

Y. Zhang, A. Bestavros, M. Guirguis, I. Matta, and R. West, "Friendly virtual machines: leveraging a feedback-control model for application adaptation," in ACM/USENIX Int'l. Conf. on Virtual Execution Envs., Jun. 2005, pp. 2--12.

Digital Library

[26]

C. Lu, Y. Lu, T. Abdelzaher, J. Stankovic, and S. Son, "Feedback control architecture and design methodology for service delay guarantees in web servers," IEEE Trans. on Parallel and Dist. Sys., vol. 17, no. 9, pp. 1014--1027, Sep. 2006.

Digital Library

[27]

T. F. Abdelzaher, K. G., Shin, and N. Bhatti, "Performance guarantees for web server end-systems: a control-theoretical approach," IEEE Trans. on Parallel and Dist. Sys., vol. 13, no. 1, pp. 80--96, Jan. 2002.

Digital Library

[28]

C.-H. Hsu and W.-C. Feng, "A power-aware run-time system for high-performance computing," in ACM/IEEE Conf. on Supercomputing, Nov. 2005, pp. 1--9.

Digital Library

[29]

W. Wasan, Stochastic Approximation. Cambridge University Press, 1969.

Cited By

Henrichs ELesch VStraesser MKounev SKrupitzer C(2022)A literature review on optimization techniques for adaptation planning in adaptive systemsInformation and Software Technology10.1016/j.infsof.2022.106940149:COnline publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.infsof.2022.106940
Lama PGuo YJiang CZhou X(2016)Autonomic Performance and Power Control for Co-Located Web Applications in Virtualized DatacentersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2015.245397127:5(1289-1302)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1109/TPDS.2015.2453971
Shi XDong JDjouadi SFeng YMa XWang Y(2016)PAPMSCJournal of Grid Computing10.1007/s10723-015-9341-z14:1(171-191)Online publication date: 1-Mar-2016
https://dl.acm.org/doi/10.1007/s10723-015-9341-z
Show More Cited By

Index Terms

Stochastic approximation control of power and tardiness in a three-tier web-hosting cluster
1. Computing methodologies
  1. Modeling and simulation
    1. Model development and analysis
      1. Modeling methodologies
2. General and reference
  1. Cross-computing tools and techniques
    1. Design
    2. Performance

Recommendations

Power capping: a prelude to power shifting

We present a technique that controls the peak power consumption of a high-density server by implementing a feedback controller that uses precise, system-level power measurement to periodically select the highest performance state while keeping the ...
Managing power constraints in a single-core scenario through power tokens

Current microprocessors face constant thermal and power-related problems during their everyday use, usually solved by applying a power budget to the processor/core. Dynamic voltage and frequency scaling (DVFS) has been an effective technique that ...
Maximizing Performance Under a Power Cap: A Comparison of Hardware, Software, and Hybrid Techniques
ASPLOS '16: Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating Systems

Power and thermal dissipation constrain multicore performance scaling. Modern processors are built such that they could sustain damaging levels of power dissipation, creating a need for systems that can implement processor power caps. A particular ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICAC '10: Proceedings of the 7th international conference on Autonomic computing

June 2010

246 pages

ISBN:9781450300742

DOI:10.1145/1809049

General Chair:
Manish Parashar
Rutgers University, USA
,
Program Chairs:
Renato Figueiredo
University of Florida, USA
,
Emre Kıcıman
Microsoft Research, USA

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture

In-Cooperation

IEEE
University of Arizona: University of Arizona

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICAC '10

Sponsor:

SIGARCH

ICAC '10: 7th International Conference on Autonomic Computing

June 7 - 11, 2010

DC, Washington, USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
222
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 02 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Henrichs ELesch VStraesser MKounev SKrupitzer C(2022)A literature review on optimization techniques for adaptation planning in adaptive systemsInformation and Software Technology10.1016/j.infsof.2022.106940149:COnline publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1016/j.infsof.2022.106940
Lama PGuo YJiang CZhou X(2016)Autonomic Performance and Power Control for Co-Located Web Applications in Virtualized DatacentersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2015.245397127:5(1289-1302)Online publication date: 1-May-2016
https://dl.acm.org/doi/10.1109/TPDS.2015.2453971
Shi XDong JDjouadi SFeng YMa XWang Y(2016)PAPMSCJournal of Grid Computing10.1007/s10723-015-9341-z14:1(171-191)Online publication date: 1-Mar-2016
https://dl.acm.org/doi/10.1007/s10723-015-9341-z
Entrialgo JMedrano RGarcía DGarcía J(2016)Autonomic power management with self-healing in server clusters under QoS constraintsComputing10.1007/s00607-015-0477-298:9(871-894)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1007/s00607-015-0477-2
Lama PZhou X(2015)Coordinated Power and Performance Guarantee with Fuzzy MIMO Control in Virtualized Server ClustersIEEE Transactions on Computers10.1109/TC.2013.18464:1(97-111)Online publication date: Jan-2015
https://doi.org/10.1109/TC.2013.184
Xie JJin PWan SYue L(2015)Energy-Proportional Query Processing on Database ClustersWeb-Age Information Management10.1007/978-3-319-21042-1_26(324-336)Online publication date: 6-Jun-2015
https://doi.org/10.1007/978-3-319-21042-1_26
Omana Iglesias JPerry PMurphy LBuda TThorburn JLange KMurphy JBinder WMerseguer J(2014)An experimental methodology to evaluate energy efficiency and performance in an enterprise virtualized environmentProceedings of the 5th ACM/SPEC international conference on Performance engineering10.1145/2568088.2568099(51-62)Online publication date: 22-Mar-2014
https://dl.acm.org/doi/10.1145/2568088.2568099
Zhou XJiang C(2014)Autonomic Performance and Power Control on Virtualized Servers: Survey, Practices, and TrendsJournal of Computer Science and Technology10.1007/s11390-014-1455-429:4(631-645)Online publication date: 4-Jul-2014
https://doi.org/10.1007/s11390-014-1455-4
Lei MHuang ZWen QHu C(2013)A Secure Cloud Computing Scaling ModelApplied Mechanics and Materials10.4028/www.scientific.net/AMM.411-414.60411-414(60-66)Online publication date: Sep-2013
https://doi.org/10.4028/www.scientific.net/AMM.411-414.60
Kim JElnikety SHe YHwang SRen SHariri SSill A(2013)QACOProceedings of the 2013 ACM Cloud and Autonomic Computing Conference10.1145/2494621.2494636(1-10)Online publication date: 9-Aug-2013
https://dl.acm.org/doi/10.1145/2494621.2494636
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents