research-article

Energy proportionality for disk storage using replication

Authors:

Doron RotemAuthors Info & Claims

EDBT/ICDT '11: Proceedings of the 14th International Conference on Extending Database Technology

Pages 81 - 92

https://doi.org/10.1145/1951365.1951378

Published: 21 March 2011 Publication History

Abstract

Saving energy for storage is of major importance as storage devices (and cooling them off) may contribute over 25 percent of the total energy consumed in a datacenter. Recent work introduced the concept of energy proportionality and argued that it is a more relevant metric than just energy saving as it takes into account the tradeoff between energy consumption and performance. In this paper, we present a novel approach, called FREP (Fractional Replication for Energy Proportionality), for energy management in large datacenters. FREP includes a replication strategy and basic functions to enable flexible energy management. Specifically, our method provides performance guarantees by adaptively controlling the power states of a group of disks based on observed and predicted workloads. Our experiments, using a set of real and synthetic traces, show that FREP dramatically reduces energy requirements with a minimal response time penalty.

References

[1]

H. Amur, J. Cipar, V. Gupta, G. R. Ganger, M. A. Kozuch, and K. Schwan. Robust and flexible power-proportional storage. In Proceedings of the 1st ACM symposium on Cloud computing, SoCC '10, pages 217--228, New York, NY, USA, 2010. ACM.

Digital Library

[2]

L. A. Barroso and U. Hölzle. The case for energy-proportional computing. IEEE Computer, 40(12):33--37, 2007.

Digital Library

[3]

L. Benini, A. Bogliolo, and G. De Micheli. A survey of design techniques for system-level dynamic power management. pages 231--248, 2002.

[4]

L. Breslau, P. Cao, L. Fan, G. Phillips, and S. Shenker. Web caching and zipf-like distributions: Evidence and implications. In Proceedings of INFOCOM (INFOCOM '99), pages 126--134, 1999.

[5]

Tools and traces, http://www.hpl.hp.com/research/ssp/software/.

[6]

J. S. Chase, D. C. Anderson, P. N. Thakar, A. M. Vahdat, and R. P. Doyle. Managing energy and server resources in hosting centers. In SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles, pages 103--116. ACM, 2001.

Digital Library

[7]

E.-Y. Chung, L. Benini, A. Bogliolo, Y.-H. Lu, and G. De Micheli. Dynamic power management for nonstationary service requests. IEEE Trans. Comput., 51(11):1345--1361, 2002.

Digital Library

[8]

G. Dhiman and T. S. Rosing. Dynamic power management using machine learning. In ICCAD '06: Proceedings of the 2006 IEEE/ACM international conference on Computer-aided design, pages 747--754, New York, NY, USA, 2006. ACM.

Digital Library

[9]

Disksim, http://www.pdl.cmu.edu/disksim/.

[10]

M. Elnozahy, M. Kistler, and R. Rajamony. Energy conservation policies for web servers. In USITS'03: Proceedings of the 4th conference on USENIX Symposium on Internet Technologies and Systems, pages 8--8. USENIX Association, 2003.

Digital Library

[11]

L. Ganesh, H. Weatherspoon, M. Balakrishnan, and K. Birman. Optimizing power consumption in large scale storage systems. In HotOS, 2007.

Digital Library

[12]

S. Ghemawat, H. Gobioff, and S.-T. Leung. The google file system. SIGOPS Oper. Syst. Rev., 37(5):29--43, 2003.

Digital Library

[13]

S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. DRPM: dynamic speed control for power management in server class disks. In ISCA '03: Proceedings of the 30th annual international symposium on Computer architecture, pages 169--181. ACM, 2003.

Digital Library

[14]

S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. Reducing disk power consumption in servers with DRPM. Computer, 36(12):59--66, 2003.

Digital Library

[15]

D. Borthakur. The Hadoop Distributed File System: Architecture and Design., http://hadoop.apache.org/core/docs/current/hdfs design.pdf.

[16]

D. P. Helmbold, D. D. E. Long, and B. Sherrod. A dynamic disk spin-down technique for mobile computing. In MobiCom '96: Proceedings of the 2nd annual international conference on Mobile computing and networking, pages 130--142. ACM, 1996.

Digital Library

[17]

S. Irani, G. Singh, S. K. Shukla, and R. K. Gupta. An overview of the competitive and adversarial approaches to designing dynamic power management strategies. IEEE Trans. VLSI Syst., 13(12):1349--1361, 2005.

Digital Library

[18]

J. Kim and D. Rotem. Energy proportionality for disk storage using replication. Technical Report LBNL-3936E, Lawrence Berkeley National Laboratory, September 2010.

[19]

W. Lang, J. M. Patel, and J. F. Naughton. On energy management, load balancing and replication. SIGMOD Rec., 38(4):35--42, 2009.

Digital Library

[20]

F. T. Leighton. Introduction to parallel algorithms and architectures: array, trees, hypercubes (Section 3). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1992.

Digital Library

[21]

D. Li and J. Wang. eRAID: a queueing model based energy saving policy. In MASCOTS '06: Proceedings of the 14th IEEE International Symposium on Modeling, Analysis, and Simulation, pages 77--86, Washington, DC, USA, 2006. IEEE Computer Society.

Digital Library

[22]

D. Narayanan, A. Donnelly, and A. Rowstron. Write off-loading: Practical power management for enterprise storage. Trans. Storage, 4(3):1--23, 2008.

Digital Library

[23]

V. N. Padmanabhan and L. Qiu. The content and access dynamics of a busy web site: findings and implications. SIGCOMM Comput. Commun. Rev., 30(4):111--123, 2000.

Digital Library

[24]

Umass Trace Repository: OLTP Application I/O, http://traces.cs.umass.edu/index.php/storage/storage.

[25]

A. Verma, R. Koller, L. Useche, and R. Rangaswami. SRCMap: energy proportional storage using dynamic consolidation. In FAST, pages 267--280, 2010.

Digital Library

[26]

C. Weddle, M. Oldham, J. Qian, A.-I. A. Wang, P. Reiher, and G. Kuenning. PARAID: A gear-shifting power-aware RAID. Trans. Storage, 3(3):13, 2007.

Digital Library

[27]

T. Xie. SEA: a striping-based energy-aware strategy for data placement in RAID-structured storage systems. IEEE Trans. Comput., 57(6):748--761, 2008.

Digital Library

[28]

Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes. Hibernator: helping disk arrays sleep through the winter. In SOSP '05: Proceedings of the twentieth ACM symposium on Operating systems principles, pages 177--190. ACM, 2005.

Digital Library

Cited By

You XLv XZhao ZHan JRen X(2020)A Survey and Taxonomy on Energy-Aware Data Management Strategies in Cloud EnvironmentIEEE Access10.1109/ACCESS.2020.29927488(94279-94293)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2992748
Park CJo YLee DKang K(2019)Change Your Cluster to Cold: Gradually Applicable and Serviceable Cold Storage DesignIEEE Access10.1109/ACCESS.2019.29341697(110216-110226)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2934169
Hikida SLe HYokota H(2019)Energy Efficient Data Placement and Buffer Management for Multiple ReplicationDatabase and Expert Systems Applications10.1007/978-3-030-27618-8_2(19-29)Online publication date: 6-Aug-2019
https://doi.org/10.1007/978-3-030-27618-8_2
Show More Cited By

Index Terms

Energy proportionality for disk storage using replication
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks
2. General and reference
  1. Cross-computing tools and techniques
    1. Reliability

Recommendations

FREP: Energy proportionality for disk storage using replication

Energy saving has become a crucial concern in datacenters as several reports predict that the anticipated energy costs over a three year period will exceed hardware acquisition. In particular, saving energy for storage is of major importance as storage ...
Exploiting redundancy to conserve energy in storage systems
SIGMETRICS '06/Performance '06: Proceedings of the joint international conference on Measurement and modeling of computer systems

This paper makes two main contributions. First, it introduces Diverted Accesses, a technique that leverages the redundancy in storage systems to conserve disk energy. Second, it evaluates the previous (redundancy-oblivious) energy conservation ...
Revisiting Server Energy Proportionality
ICPP '13: Proceedings of the 2013 42nd International Conference on Parallel Processing

Server energy proportionality refers to a proposed ideal that a server consumes energy proportional to its utilization level. Since its introduction in 2007, the ideal has been adopted by the server industry as a design goal to further optimize the ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

EDBT/ICDT '11: Proceedings of the 14th International Conference on Extending Database Technology

March 2011

587 pages

ISBN:9781450305280

DOI:10.1145/1951365

Editors:
Anastasia Ailamaki
EPFL, Switzerland
,
Sihem Amer-Yahia
Yahoo! Research
,
Jignesh Pate
University of Wisconsin-Madison
,
Tore Risch
Uppsala University, Sweden
,
Pierre Senellart
Télécom ParisTech, France
,
Julia Stoyanovich
University of Pennsylvania

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Microsoft Research: Microsoft Research

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 March 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

U.S. Department of Energy

Conference

EDBT/ICDT '11

Sponsor:

Microsoft Research

EDBT/ICDT '11: EDBT/ICDT '11 joint conference

March 21 - 24, 2011

Uppsala, Sweden

Acceptance Rates

Overall Acceptance Rate 7 of 10 submissions, 70%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
318
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

You XLv XZhao ZHan JRen X(2020)A Survey and Taxonomy on Energy-Aware Data Management Strategies in Cloud EnvironmentIEEE Access10.1109/ACCESS.2020.29927488(94279-94293)Online publication date: 2020
https://doi.org/10.1109/ACCESS.2020.2992748
Park CJo YLee DKang K(2019)Change Your Cluster to Cold: Gradually Applicable and Serviceable Cold Storage DesignIEEE Access10.1109/ACCESS.2019.29341697(110216-110226)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2934169
Hikida SLe HYokota H(2019)Energy Efficient Data Placement and Buffer Management for Multiple ReplicationDatabase and Expert Systems Applications10.1007/978-3-030-27618-8_2(19-29)Online publication date: 6-Aug-2019
https://doi.org/10.1007/978-3-030-27618-8_2
Niu ZHe BLiu F(2018)JouleMR: Towards Cost-Effective and Green-Aware Data Processing FrameworksIEEE Transactions on Big Data10.1109/TBDATA.2017.26550374:2(258-272)Online publication date: 1-Jun-2018
https://doi.org/10.1109/TBDATA.2017.2655037
You XLi YZheng MZhu CYu L(2017)A Survey and Taxonomy of Energy Efficiency Relevant Surveys in Cloud-Related EnvironmentsIEEE Access10.1109/ACCESS.2017.27180015(14066-14078)Online publication date: 2017
https://doi.org/10.1109/ACCESS.2017.2718001
Guo BYu JLiao BYang DLu L(2017)A green framework for DBMS based on energy-aware query optimization and energy-efficient query processingJournal of Network and Computer Applications10.1016/j.jnca.2017.02.01584:C(118-130)Online publication date: 15-Apr-2017
https://dl.acm.org/doi/10.1016/j.jnca.2017.02.015
Jensen K(2016)High Throughput Tertiary Storage in HPC EnvironmentsProceedings of the Doctoral Symposium of the 17th International Middleware Conference10.1145/3009925.3009934(1-2)Online publication date: 12-Dec-2016
https://dl.acm.org/doi/10.1145/3009925.3009934
Niu ZHe BLiu F(2016)Not All Joules are Equal: Towards Energy-Efficient and Green-Aware Data Processing Frameworks2016 IEEE International Conference on Cloud Engineering (IC2E)10.1109/IC2E.2016.17(2-11)Online publication date: Apr-2016
https://doi.org/10.1109/IC2E.2016.17
Ding YQin XZhou QLiu LWang T(2016)Energy-aware processing of big data in homogeneous clusterSignal, Image and Video Processing10.1007/s11760-016-0964-811:2(371-379)Online publication date: 8-Sep-2016
https://doi.org/10.1007/s11760-016-0964-8
LE HHIKIDA SYOKOTA H(2015)Accordion: An Efficient Gear-Shifting for a Power-Proportional Distributed Data-Placement MethodIEICE Transactions on Information and Systems10.1587/transinf.2014DAP0007E98.D:5(1013-1026)Online publication date: 2015
https://doi.org/10.1587/transinf.2014DAP0007
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents