Nothing Special   »   [go: up one dir, main page]

skip to main content
10.5555/1960475.1960495acmotherconferencesArticle/Chapter ViewAbstractPublication PagesfastConference Proceedingsconference-collections
Article

Cost effective storage using extent based dynamic tiering

Published: 15 February 2011 Publication History

Abstract

Multi-tier systems that combine SSDs with SAS/FC and/or SATA disks mitigate the capital cost burden of SSDs, while benefiting from their superior I/O performance per unit cost and low power. Though commercial SSD-based multi-tier solutions are available, configuring such a system with the optimal number of devices per tier to achieve performance goals at minimum cost remains a challenge. Furthermore, these solutions do not leverage the opportunity to dynamically consolidate load and reduce power/operating cost.
Our extent-based dynamic tiering solution, EDT, addresses these limitations via two key components of its design. A Configuration Adviser EDT-CA determines the adequate mix of storage devices to buy and install to satisfy a given workload at minimum cost, and a Dynamic Tier Manager EDT-DTM performs dynamic extent placement once the system is running to satisfy performance requirements while minimizing dynamic power consumption. Key to the cost minimization of EDT-CA is its ability to simulate the dynamic extent placement afforded by EDT-DTM. Key to the overall effectiveness of EDT-DTM is its ability to consolidate load within tiers when feasible, rapidly respond to unexpected changes in the workload, and carefully control the overhead due to extent migration. Our results using production workloads show that EDT incurs lower capital and operating cost, consumes less power, and delivers similar or better performance relative to SAS-only storage systems as well as other simpler approaches to extent-based tiering.

References

[1]
SPC specifications. http://www. storageperformance.org/specs.
[2]
M. K. Aguilera, K. Keeton, A. Merchant, K.-K. Muniswamy-Reddy, and M. Uysal. Improving recoverability in multi-tier storage systems. In Proc. of the IEEE/IFIP DSN, 2007.
[3]
G. A. Alvarez, E. Borowsky, S. Go, T. H. Romer, R. Becker-Szendy, R. Golding, A. Merchant, M. Spasojevic, A. Veitch, and J. Wilkes. Minerva: An Automated Resource Provisioning Tool for Large-scale Storage Systems. ACM Transactions on Computer Systems, 19(4):483-518, 2001.
[4]
E. Anderson, J. Hall, J. Hartline, M. Hobbs, A. R. Karlin, J. Saia, R. Swaminathan, and J. Wilkes. An experimental study of data migration algorithms. Lecture Notes in Computer Science, 2141/2001: 145-158, 2001.
[5]
E. Anderson, M. Hobbs, K. Keeton, S. Spence, M. Uysal, and A. Veitch. Hippodrome: Running Circles Around Storage Administration. In Proc. of USENIX FAST, 2002.
[6]
E. Anderson, S. Spence, R. Swaminathan, M. Kallahalla, and Q. Wang. Quickly finding near-optimal storage designs. ACM Transactions on Computer Systems, 23(4):337-374, 2005.
[7]
M. Bhadkamkar, J. Guerra, L. Useche, S. Burnett, J. Liptak, R. Rangaswami, and V. Hristidis. BORG: Block-reORGanization for Self-Optimizing Storage Systems. Proc. of USENIX FAST, 2009.
[8]
D. Colarelli and D. Grunwald. Massive Arrays of Idle Disks for Storage Archives. In Proc. of IEEE/ACM SC, 2002.
[9]
K. Dasgupta, S. Ghosal, R. Jain, U. Sharma, and A. Verma. Qosmig: Adaptive rate-controlled migration of bulk data in storage systems. In Proc. of ICDE, 2005.
[10]
K. M. Greenan, D. D. Long, E. L. Miller, T. J. Schwarz, and J. J. Wylie. A Spin-Up Saved is Energy Earned: Achieving Power-Efficient, Erasure-Coded Storage. In Proc. of USENIX HotDep, 2008.
[11]
J. Guerra, H. Pucha, K. Gupta, W. Belluomini, and J. Glider. Energy Proportionality for Storage: Impact and Feasibility. In Proc. of ACM/USENIX Hot-Storage , 2009.
[12]
S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Frankez. DRPM: Dynamic speed control for power management in server class disks. In Proc. of ACM/IEEE ISCA, 2003.
[13]
IBM Corporation. High Performance Storage System (HPSS). Online: http://hpss-collaboration.org/, 2010.
[14]
IBM Corporation. IBM System Storage DS8000 series. Data Sheet, 2010.
[15]
G. Karche, M. Mamidi, and P. Massiglia. Using dynamic storage tiering. Available as Symantec Yellow Books at http://www.symantec.com/enterprise/yellowbooks/index.jsp., 2006.
[16]
R. Koller and R. Rangaswami. I/O Deduplication: Utilizing Content Similarity to Improve I/O Performance. In Proc. of USENIX FAST, 2010.
[17]
B. Laliberte. Automate and Optimize a Tiered Storage Environment FAST! ESG White Paper, 2009.
[18]
H. J. Lee, K. H. Lee, and S. H. Noh. Augmenting RAID with an SSD for Energy Relief. In Proc. of USENIX HotPower, 2008.
[19]
A. Leung, S. Pasupathy, G. Goodson, and E. Miller. Measurement and Analysis of Large-Scale Network File System Workloads. In Proc. of USENIX ATC, 2008.
[20]
D. Li and J. Wang. EERAID: Energy efficient redundant and inexpensive disk array. In Proc. of workshop on ACM SIGOPS European workshop, 2004.
[21]
D. Narayanan, A. Donnelly, and A. Rowstron. Write Off-Loading: Practical Power Management for Enterprise Storage. In Proc. of USENIX FAST, 2008.
[22]
D. Narayanan, E. Thereska, A. Donnelly, S. Elnikety, and A. Rowstron. Migrating Server Storage to SSDs: Analysis of Tradeoffs. In Proc. of ACM Eurosys, 2009.
[23]
M. Peters. Compellent harnessing ssds potential. ESG Storage Systems Brief, 2009.
[24]
M. Peters. Netapp's solid state hierarchy. ESG White Paper, 2009.
[25]
M. Peters. 3par: Optimizing io service levels. ESG White Paper, 2010.
[26]
E. Pinheiro and R. Bianchini. Energy conservation techniques for disk array-based servers. In Proc. of ACM ICS, 2004.
[27]
E. Pinheiro, R. Bianchini, and C. Dubnicki. Exploiting redundancy to conserve energy in storage systems. SIGMETRICS, 34(1), 2006.
[28]
J. D. Strunk, E. Thereska, C. Faloutsos, and G. R. Ganger. Using utility to provision storage systems. In Proc. of USENIX FAST, 2008.
[29]
Taneja Group Technology Analysts. The State of the Core Engineering the Enterprise Storage Infrastructure with the IBM DS8000. White Paper, 2010.
[30]
M. Uysal, G. A. Alvarez, and A. Merchant. A modular, analytical throughput model for modern disk arrays. In Proc. of IEEE MASCOTS, 2001.
[31]
A. Verma, R. Koller, L. Useche, and R. Rangaswami. SRCMap: Energy Proportional Storage Using Dynamic Consolidation. In Proc. of USENIX FAST, 2010.
[32]
C. Weddle, M. Oldham, J. Qian, A.-I. A. Wang, P. Reiher, and G. Kuenning. PARAID: A Gear-Shifting Power-Aware RAID. In Proc. of USENIX FAST, 2007.
[33]
J. Wilkes, R. Golding, C. Staeliin, and T. Sullivan. The HP AutoRAID Hierarchical Storage System. In Proc. of ACM SOSP, 1995.
[34]
X. Yao and J. Wang. RIMAC: a novel redundancy-based hierarchical cache architecture for energy efficient, high performance storage systems. SIGOPS Operating Systems Review, 40(4), 2006.
[35]
M. Yue. A simple proof of the inequality ffd(l) (11/9)opt(l) + 1, for all l, for the ffd bin-packing algorithm. Acta Mathematicae Applicatae Sinica, 7:321331, 1991.
[36]
G. Zhang, L. Chiu, C. Dickey, L. Liu, P. Muench, and S. Seshadri. Automated Lookahead Data Migration in SSD-enabled Multi-tiered Storage Systems. In IEEE MSST, 2010.
[37]
Q. Zhu, F. M. David, C. F. Devaraj, Z. Li, Y. Zhou, and P. Cao. Reducing Energy Consumption of Disk Storage Using Power-Aware Cache Management. In Proc. of IEEE HPCA, 2004.
[38]
Q. Zhu, Z. Chen, L. Tan, Y. Zhou, K. Keeton, and J. Wilkes. Hibernator: helping disk arrays sleep through the winter. In Proc. of ACM SOSP, 2005.

Cited By

View all
  • (2023)Prism: Optimizing Key-Value Store for Modern Heterogeneous Storage DevicesProceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 210.1145/3575693.3575722(588-602)Online publication date: 27-Jan-2023
  • (2022)Infusing pub-sub storage with transactionsProceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3538643.3539739(23-30)Online publication date: 27-Jun-2022
  • (2021)LIRS2Proceedings of the 14th ACM International Conference on Systems and Storage10.1145/3456727.3463772(1-12)Online publication date: 14-Jun-2021
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
FAST'11: Proceedings of the 9th USENIX conference on File and stroage technologies
February 2011
20 pages
ISBN:9781931971829

Sponsors

  • OFS: OrangeFS
  • NetApp
  • Google Inc.
  • DELL
  • USENIX Assoc: USENIX Assoc

In-Cooperation

Publisher

USENIX Association

United States

Publication History

Published: 15 February 2011

Check for updates

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 01 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Prism: Optimizing Key-Value Store for Modern Heterogeneous Storage DevicesProceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 210.1145/3575693.3575722(588-602)Online publication date: 27-Jan-2023
  • (2022)Infusing pub-sub storage with transactionsProceedings of the 14th ACM Workshop on Hot Topics in Storage and File Systems10.1145/3538643.3539739(23-30)Online publication date: 27-Jun-2022
  • (2021)LIRS2Proceedings of the 14th ACM International Conference on Systems and Storage10.1145/3456727.3463772(1-12)Online publication date: 14-Jun-2021
  • (2020)MosaicProceedings of the VLDB Endowment10.14778/3407790.340785213:12(2662-2675)Online publication date: 1-Jul-2020
  • (2019)Big Data Analytics for Large-scale Wireless NetworksACM Computing Surveys10.1145/333706552:5(1-36)Online publication date: 13-Sep-2019
  • (2019)ZoneTierACM Transactions on Storage10.1145/333554815:3(1-25)Online publication date: 10-Jul-2019
  • (2018)PocketProceedings of the 13th USENIX conference on Operating Systems Design and Implementation10.5555/3291168.3291200(427-444)Online publication date: 8-Oct-2018
  • (2018)EADCluster Computing10.5555/3287988.328800521:3(1561-1579)Online publication date: 1-Sep-2018
  • (2018)DuchyProceedings of the 47th International Conference on Parallel Processing10.1145/3225058.3225067(1-9)Online publication date: 13-Aug-2018
  • (2018)Storage tier-aware replicative data reorganization with prioritization for efficient workload processingFuture Generation Computer Systems10.1016/j.future.2017.04.01079:P2(618-629)Online publication date: 1-Feb-2018
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media