Article

Managing energy and server resources in hosting centers

Authors:

Jeffrey S. Chase,

Darrell C. Anderson,

Prachi N. Thakar,

Amin M. Vahdat,

Ronald P. DoyleAuthors Info & Claims

SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles

Pages 103 - 116

https://doi.org/10.1145/502034.502045

Published: 21 October 2001 Publication History

Abstract

Internet hosting centers serve multiple service sites from a common hardware base. This paper presents the design and implementation of an architecture for resource management in a hosting center operating system, with an emphasis on energy as a driving resource management issue for large server clusters. The goals are to provision server resources for co-hosted services in a way that automatically adapts to offered load, improve the energy efficiency of server clusters by dynamically resizing the active server set, and respond to power supply disruptions or thermal events by degrading service in accordance with negotiated Service Level Agreements (SLAs).Our system is based on an economic approach to managing shared server resources, in which services "bid" for resources as a function of delivered performance. The system continuously monitors load and plans resource allotments by estimating the value of their effects on service performance. A greedy resource allocation algorithm adjusts resource prices to balance supply and demand, allocating resources to their most efficient use. A reconfigurable server switching infrastructure directs request traffic to the servers assigned to each service. Experimental results from a prototype confirm that the system adapts to offered load and resource availability, and can reduce server energy usage by 29% or more for a typical Web workload.

Supplementary Material

TGZ File (muse-sosp.tgz)

Software for Managing energy and server resources in hosting centers

Download
54.89 KB

References

[1]

Tarek F. Abdelzaher and Chenyang Lu. Modeling and Performance Control of Interact Servers. In 39th IEEE Conference on Decision and Control, December 2000.]]

[2]

Tarek F. Abdelzaher, Kang G. Shin, and Nina Bhatti. Performance Guarantees for Web Server End-Systems: A Control-Theoreticni Approach. IEEE Transactions on Parallel and Distributed Systems, June 2001.]]

Digital Library

[3]

Jeffrey Aman, Catherine K. Eilert, David Emmes, Peter Yocom, and Donna Dillenberger. Adaptive AIgorithrus for Managing a Distrubuted Data Processing Workload. IBM Systems Journal, 36(2), 1997.]]

Digital Library

[4]

Darrell C. Anderson, Jeffrey S. Chase, and Amin M. Vahdat. Interposed Request Routing for Scalable Network Storage. In Proceedings of the Fourth Symposium on Operating System Design and Implementation ( OSD1), October 2000.]]

Digital Library

[5]

Karen Appleby, Sameh Fakhouri, Liana Fong, German Goldszmidt, Michael Kalantar, Srirama Krishnakumar, Donald Pazel, John Pershing, and Benny Rochwerger. Oceano - SLA Based Management of a Computing Utility. In Proceedings of the 7th IFIP/IEEE International Symposium on Integrated Network Management, May 2001.]]

[6]

Martin Arlitt and Tal Jin. Workload Characterization of the 1998 World Cup Web Site. Technical Report HPL-1999-35R1, HI" Laboratories, September 1999. The trace is available from the Internet Traffic Archive at ita.ee.lbl.gov.]]

[7]

Armando Fox and Steven D. Gribble and Yatin Chawathe and Eric A. Brewer and Paul Ganthier. Cluster-based scalable network services. In Proceedings of the Sixteenth ACM Symposium on Operating System Principles (SOSP), pages 78-91, October 1997.]]

Digital Library

[8]

Mohit Aron. Differentiated and Predictable Quality of Service in Web Server Systems. Phl) thesis, Department of Computer Science, Rice University, October 2000.]]

Digital Library

[9]

Mohit Aron, Peter Druschel, and Willy Zwaenepoel. Cluster Reserves: A Mechanism for Resource Management in Cluster-based Network Servers. In Proceedings of the Joint International Conference on Measurement and Modeling of Computer Systems (ACM SIGMETRICS 2000), pages 90-101, June 2000.]]

Digital Library

[10]

Gaurav Banga, Peter Druschel, and Jeffrey C. Mogul. Resource Containers: A New Facility for Resource Management in Server Systems. In Proceedings of the Third Symposium on Operating Systems Design and Implementation ( OSDI), February 1999.]]

Digital Library

[11]

Paul Bafford and Mark E. Crovella. Generating Representative Web Workloads for Network and Server Performance Evaluation. In Proceedings of the ACM Conference on Measurement and Modeling of Computer Systems ( SIGMETRICS "98), pages 151-160, June 1998.]]

Digital Library

[12]

Pat Bohrer, Elmootazbellah N. Elnozahy, Tom Keller, Michael Kistler, Charles Lefurgy, and Ray Rajamony. The Case for Power Management in Web Servers. In Power-Aware Computing (Robert Graybill and Rami Melhem, editors). Kluwer/Plenum series in Computer Science, to appear, January 2002.]]

Digital Library

[13]

David Brooks and Margaret Martonosi. Dynamic Thermal Management for High-Performance Microprocessors. In Proceedings of the Seventh International Symposium on High-Performance Computer Architecture (HPCA-7), January 2001.]]

Digital Library

[14]

Jeffrey S. Chase, Henry M. Levy, Michael J. Feeley, and Edward D. Lazowska. Sharing and Protection in a Single Address Space Operating System. ACM Transactions on Computer Systems, 12(4), November 1994.]]

Digital Library

[15]

Fred Douglis, P. Krishnan, and Brian Bershad. Adaptive Disk Spin-down Policies for Mobile Computers. In 2nd USENIX Symposium on Mobile and Location-Independent Computing, April 1995. Monterey CA.]]

Digital Library

[16]

Donald E Ferguson, Christos Nikolaou, Jakka Sairamesh, and Yechiam Yemidi. Economic Models for Allocating Resources in Computer Systems. In Market-Based Control: A Paradigm for Distributed Resource Allocation (Scott H. Clearwater, editor). World Scientific, 1996.]]

Digital Library

[17]

Jason Flinn and Mahadev Satyanarayanan. Energy-aware Adaptation for Mobile Applications. In Proceedings of the Seventeenth Symposium on Operating Systems Principles (SOSP), pages 48-63, December 1999.]]

Digital Library

[18]

Syam Gadde. The Proxycizer Web Proxy Tool Suite. http : //www. cs. duke. edu/ari/Proxycizer/.]]

[19]

Toshihide Ibaraki and Naoki Katoh, editors. Resource Allocation Problems: Algorithmic Approaches. MIT Press, Cambridge, MA, 1988.]]

Digital Library

[20]

Anm Iyengar, Jim Challenger, Daniel Dias, and Paul Dantzig. High-performance Web Site Design Techniques. IEEE Internet Computing, 4(2):17-26, March 2000.]]

Digital Library

[21]

Van Jacobsen. Congestion Avoidance and Control. ACM Computer Communication Review: Proceedings of the SIGCOMM Symposium, 18(4):314-329, August 1988.]]

Digital Library

[22]

Sugib Jamin, Peter B. Danzig, Scott J. Shanker, and Lixia Zhang. A Measurement-based Admission Control Algorithm for Integrated Services Packet Networks. IEEE,/ACM Transactions on Networking, 5(1):56-70, February 1997.]]

Digital Library

[23]

Sugih Jamin, Scott J. Shenker, and Peter B. Danzig. Comparison of Measurement-based Admission Control Algorithms for Controlled-Load Service. In Proceedings of lEEE lnfocom 1997, April 1997.]]

Digital Library

[24]

Michael B. Jones, Daniela Rosu, and Marcel-Catalin Rosu. CPU Reservations and Time Constraints: Efficient, Predictable Scheduling of Independent Activities. In Proceedings of the 16th ACM Symposium on Operating Systems Principles, pages 198-211, October 1997.]]

Digital Library

[25]

Minkyong Kim and Brian Noble. Mobile Network Estimation. In Proceedings of the Seventh Annual Conference on Mobile Computing and Networking, July 2001.]]

Digital Library

[26]

Alvin R. Lebeck, Xiaobo Fan, Heng Zeng, and Carla S. Ellis. Power-Aware Page Allocation. In Proceedings of the Ninth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS IX), 2000.]]

Digital Library

[27]

Kelvin Li and Sugih Jamin. A Meaanrement-Based Admission-Controlled Web Server. In Proceedings oflEEE lnfocom 2000, March 2000.]]

[28]

Lee W. McKnight and Joseph P. Bailey, editors, lnternet Economics. MIT Press, Cambridge, MA, 1997.]]

Digital Library

[29]

Jennifer D. Mitebell-Jacksun. Energy Needs in an Interuet Economy: A Closer Look at Data Centers. Master's thesis, Energy and Resources Group, University of California at Berkeley, July 2001.]]

[30]

Roll Neugebaner and Derek McAuley. Energy is Just Another Resource: Energy Accounting and Energy Pricing in the Nemesis OS. In Proceedings of the Eighth IEEE Workshop on Hot Topics in Operating Systems HerOS-VIII, pages 59--64, May 2001.]]

Digital Library

[31]

Brian D. Noble, M. Satyanarayanan, Dushyanth Narayanan, James Eric Tiltun, Jason Flinn, and Kevin R. Walker. Agile Application-Aware Adaptation for Mobility. In Proceedings of the Sixteenth ACM Symposium on Operating Systems Principles ( SOSP ), pages 276--287, Saint Male, France, October 1997.]]

Digital Library

[32]

Vivek S. Pal, Mohit Area, Gaurav Banga, Michael Svendsen, Peter Drnschel, Willy Zwaenopoel, and Erich Nahum. Locality-Aware Request Distribution in Clnster-based Network Servers. In Proceedings of the Eighth International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS VIII), October 1998.]]

Digital Library

[33]

Eduardo Pinheiro, Ricardo Bianchini, Eurique V. Carrera, and Taliver Heath. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. Technical Report DCS-TR-440, Department of Computer Science, Rutgers University, May 2001.]]

[34]

John Reumann, Ashish Mehra, Kang G. Shin, and Dilip Kandlur. Virtual Services: A New Abstraction for Server Consolidation. In Proceedings of the USENIX 2000 Technical Conference, June 2000.]]

Digital Library

[35]

Timothy Roscoe and Prashant Shenoy. New Resource Control Issues in Shared Clusters. In Proceedings of the Eight International Workshop on Interactive Distributed Multimedia Systems ( IDMS'01), September 2001.]]

Digital Library

[36]

Yasnshi Saito, Brian N. Bershad, and Henry M. Levy. Manageability, Availability and Performance in Porcupine: A Highly Scalable Cluster-Based Mail Service. In Proceedings of the 17th ACM Symposium on Operating Systems Principles (SOSP), pages 1-15, Kiawah Island, December 1999.]]

Digital Library

[37]

Barry C. Smith, John F. Leimkuhler, and Ross M. Darrow. Yield Management at American Airlines. Interfaces, 22(1), January 1992.]]

[38]

David C. Steere, Ashvin Goel, Joshua Gmenberg, Dylan McNamee, Calton Pu, and Jonathan Walpole. A Feedback-driven Proportion Allocator for Real-Rate Scheduling. In Proceedings of the Third Symposium on Operating Systems Design and Implementation (OSDI), pages 145-158, February 1999.]]

Digital Library

[39]

Michael Stonebraker, Paul M. Aoki, Witold Litwin, Avi Pfeffer, Adam Sah, Jeff Sidell, Carl Staelin, and Andrew Yu. Mariposa: A Wide-Area Distributed Database System. VLDB Journal: Very Large Data Bases, 5(1):48--63, 1996.]]

Digital Library

[40]

David G. Sullivan and Margo I. Seltzer. Isolation with Flexibility: A Resource Management Framework for Central Servers. In Proceedings of the 2000 USENIX Annual Technical Conference, pages 337-350, June 2000.]]

Digital Library

[41]

Kevin Thompson, Gregory J. Miller, and Rick Wilder. Wide-Area lnternet Traffic Patterns and Characteristics. In IEEENetwork, November 1997.]]

[42]

Amin Vahdat, Thomas Anderson, Michael Dahlia, Eshwar Belani, David Culler, Paul Eastham, and Chad Yoshikawa. WebOS: Operating System Services for Wide-Area Applications. In Proceedings of the Seventh IEEE Symposium on High Performance Distributed Computing (HPDC), Chicago, Illinois, July 1998.]]

Digital Library

[43]

Amin Vahdat, Alvin R. Lebeek, and Carla S. Ellis. Every Joule is Precious: The Case for Revisiting Operating System Design for Energy Efficiency. In Proceedings of the 9th ACM SIGOPS European Workshop, September 2000.]]

Digital Library

[44]

Ben Verghese, Anoop Gupta, and Mendel Rosenblum. Performance Isolation: Sharing and Isolation in Shared Memory Multiprocessors. In Proceedings of the 8th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), October 1998.]]

Digital Library

[45]

Carl A. Waldspurger, Tad Hogg, Bernardo A. Huberman, Jeffrey O. Kephart, and W. Scott Stornetta. Spawn: A Distributed Computational Economy. IEEE Transactions on Software Engineering, 18(2): 103-117, February 1992.]]

Digital Library

[46]

Carl A. Waldspurger and William E. Weihl. Lottery Scheduling: Flexible Proportional-Share Resource Management. In Proceedings of the First Symposium on Operating Systems Design and Implementation (OSDI), pages 1-11, November 1994.]]

Digital Library

[47]

Huiean Zhu, Hung Tang, and Tao Yang. Demand-driven Service Differentiation in Cluster-Based Network Servers. In Proceedings of IEEE Infocom 2001, April 2001.]]

Cited By

Eymer JDexter PRaskind JLiu Y(2024)A Runtime System for Interruptible Query Processing: When Incremental Computing Meets Fine-Grained ParallelismProceedings of the ACM on Programming Languages10.1145/36897728:OOPSLA2(1729-1756)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3689772
Chen HLiang JMa Y(2023)Balance Optimization Scheduling Algorithm for Standard Digital Management Cloud Platform Infrastructure2023 11th International Conference on Information Systems and Computing Technology (ISCTech)10.1109/ISCTech60480.2023.00037(164-169)Online publication date: 30-Jul-2023
https://doi.org/10.1109/ISCTech60480.2023.00037
Ge YZhang YHu QWang SQiu PZou BYu XHu R(2023)Optimal Bidding Strategy for Data Center Participation in Day-Ahead Electricity Market2023 IEEE International Conference on Energy Internet (ICEI)10.1109/ICEI60179.2023.00040(170-175)Online publication date: 20-Oct-2023
https://doi.org/10.1109/ICEI60179.2023.00040
Show More Cited By

Index Terms

Managing energy and server resources in hosting centers
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Distributed systems organizing principles

Recommendations

Managing server energy and operational costs in hosting centers
SIGMETRICS '05: Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems

The growing cost of tuning and managing computer systems is leading to out-sourcing of commercial services to hosting centers. These centers provision thousands of dense servers within a relatively small real-estate in order to host the applications/...
Managing energy and server resources in hosting centers

Internet hosting centers serve multiple service sites from a common hardware base. This paper presents the design and implementation of an architecture for resource management in a hosting center operating system, with an emphasis on energy as a driving ...
On Honey Bees and Dynamic Server Allocation in Internet Hosting Centers

Internet centers host services for e-banks, e-auctions and other clients. Hosting centers then must allocate servers among clients to maximize revenue. The limited number of servers, costs of reallocating servers, and unpredictability of requests make ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles

October 2001

254 pages

ISBN:1581133898

DOI:10.1145/502034

General Chair:
Keith Marzullo
University of California, San Diego
,
Program Chair:
M. Satyanarayanan
Carnegie Mellon University and Intel Research, Pittsburgh

ACM SIGOPS Operating Systems Review Volume 35, Issue 5
Dec. 2001
243 pages
ISSN:0163-5980
DOI:10.1145/502059
Issue’s Table of Contents

Copyright © 2001 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGOPS: ACM Special Interest Group on Operating Systems

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 October 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SOSP01

Sponsor:

SIGOPS

SOSP01: 18th Symposium on Operating System Principles

October 21 - 24, 2001

Alberta, Banff, Canada

Acceptance Rates

SOSP '01 Paper Acceptance Rate 17 of 85 submissions, 20%;

Overall Acceptance Rate 131 of 716 submissions, 18%

Upcoming Conference

SOSP '25

Sponsor:
sigops

ACM SIGOPS 31st Symposium on Operating Systems Principles

October 13 - 16, 2025

Seoul , Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1,084
Total Citations
View Citations
4,111
Total Downloads

Downloads (Last 12 months)91
Downloads (Last 6 weeks)8

Reflects downloads up to 03 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Eymer JDexter PRaskind JLiu Y(2024)A Runtime System for Interruptible Query Processing: When Incremental Computing Meets Fine-Grained ParallelismProceedings of the ACM on Programming Languages10.1145/36897728:OOPSLA2(1729-1756)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3689772
Chen HLiang JMa Y(2023)Balance Optimization Scheduling Algorithm for Standard Digital Management Cloud Platform Infrastructure2023 11th International Conference on Information Systems and Computing Technology (ISCTech)10.1109/ISCTech60480.2023.00037(164-169)Online publication date: 30-Jul-2023
https://doi.org/10.1109/ISCTech60480.2023.00037
Ge YZhang YHu QWang SQiu PZou BYu XHu R(2023)Optimal Bidding Strategy for Data Center Participation in Day-Ahead Electricity Market2023 IEEE International Conference on Energy Internet (ICEI)10.1109/ICEI60179.2023.00040(170-175)Online publication date: 20-Oct-2023
https://doi.org/10.1109/ICEI60179.2023.00040
Mishra PSivaram MArvindhan MDaniel ARanjan R(2022)Energy‐Efficient Cloud Computing Techniques for Next GenerationHybrid Intelligent Approaches for Smart Energy10.1002/9781119821878.ch3(49-66)Online publication date: 28-Sep-2022
https://doi.org/10.1002/9781119821878.ch3
Zhang YHua WZhou ZSuh GDelimitrou CSherwood TBerger EKozyrakis C(2021)Sinan: ML-based and QoS-aware resource management for cloud microservicesProceedings of the 26th ACM International Conference on Architectural Support for Programming Languages and Operating Systems10.1145/3445814.3446693(167-181)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3445814.3446693
Crotty AGalakatos ALuckett CCetintemel U(2021)The Case for In-Memory OLAP on "Wimpy" Nodes2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00069(732-743)Online publication date: Apr-2021
https://doi.org/10.1109/ICDE51399.2021.00069
Pushpalatha RRamesh B(2021)Amalgamation of Neural Network and Genetic Algorithm for Efficient Workload Prediction in Data CenterAdvances in VLSI, Signal Processing, Power Electronics, IoT, Communication and Embedded Systems10.1007/978-981-16-0443-0_6(69-84)Online publication date: 11-Apr-2021
https://doi.org/10.1007/978-981-16-0443-0_6
Patra SGoswami VMund G(2020)Performance Evaluation of Cloud Systems by Switching the Virtual Machines Power Mode Between the Sleep Mode and Active ModeHandbook of Research on Developments and Trends in Industrial and Materials Engineering10.4018/978-1-7998-1831-1.ch007(145-168)Online publication date: 2020
https://doi.org/10.4018/978-1-7998-1831-1.ch007
Narayanan ISivasubramaniam A(2020)Mediating Power Struggles on a Shared Server2020 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS)10.1109/ISPASS48437.2020.00030(149-159)Online publication date: Aug-2020
https://doi.org/10.1109/ISPASS48437.2020.00030
Divya RJayanthi V(2020)RETRACTED ARTICLE: Efficient optimal resource allocation for profit maximization in software defined network approach to improve quality of service in cloud environmentsJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-020-02192-812:6(6241-6250)Online publication date: 15-Jun-2020
https://doi.org/10.1007/s12652-020-02192-8
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents