research-article

Flashing databases: expectations and limitations

Authors:

Stephan Baumann,

Giel de Nijs,

Michael Strobel,

Kai-Uwe SattlerAuthors Info & Claims

DaMoN '10: Proceedings of the Sixth International Workshop on Data Management on New Hardware

Pages 9 - 18

https://doi.org/10.1145/1869389.1869391

Published: 07 June 2010 Publication History

Get Access

Abstract

Flash devices (solid state disks) promise a significant performance improvement for disk-based database processing. However, database storage structures and processing strategies originally designed for magnetic disks prevent the optimal utilization of SSDs. Based on previous work on bench-marking SSDs and a detailed discussion of I/O methods, in this paper, we analyze appropriate execution methods for database processing as well as important parameters and boundaries and present a tool which helps to derive these parameters.

References

[1]

}}L. Bouganim, B. T. Jónsson, and P. Bonnet. uflip: Understanding flash io patterns. In CIDR'09, 2009.

Google Scholar

[2]

}}F. Chen, D. A. Koufaty, and X. Zhang. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In SIGMETRICS '09, pages 181--192, New York, NY, USA, 2009. ACM.

Digital Library

Google Scholar

[3]

}}G. Graefe. The Five-minute Rule 20 Years Later (and how Flash Memory Changes the Rules). Communications of the ACM, 52(7):48--59, 2009.

Digital Library

Google Scholar

[4]

}}Intel Corporation. Intel X18-M/X25-M SATA Solid State Drive - Product Manual. http://download.intel.com/design/flash/nand/mainstream/mainstream-sata-ssd-datasheet.pdf.

Google Scholar

[5]

}}Intel Corporation. Intel X25-E SATA Solid State Drive - Product Manual. http://download.intel.com/design/flash/nand/extreme/319984.pdf.

Google Scholar

[6]

}}S.-W. Lee and B. Moon. Design of Flash-based DBMS: an In-Page Logging Approach. In SIGMOD'07, pages 55--66, 2007.

Digital Library

Google Scholar

[7]

}}R. Love. Linux Kernel Development (2nd Edition) (Novell Press). Novell Press, 2005.

Digital Library

Google Scholar

[8]

}}S. Nath and A. Kansal. FlashDB: Dynamic Self-tuning Database for NAND Flash. In 6th Int. Conf. on Information Processing in Sensor Networks (IPSN) 2007, pages 410--419, 2007.

Digital Library

Google Scholar

[9]

}}P. E. O'Neil, E. J. O'Neil, X. Chen, and S. Revilak. The Star Schema Benchmark and Augmented Fact Table Indexing. In R. O. Nambiar and M. Poess, editors, TPCTC, volume 5895 of Lecture Notes in Computer Science, pages 237--252. Springer, 2009.

Digital Library

Google Scholar

[10]

}}S. Padmanabhan, B. Bhattacharjee, T. Malkemus, L. Cranston, and M. Huras. Multi-dimensional Clustering: a New Data Layout Scheme in DB2. In SIGMOD '03, pages 637--641, New York, NY, USA, 2003. ACM.

Digital Library

Google Scholar

[11]

}}M. Stonebraker, D. J. Abadi, A. Batkin, X. Chen, M. Cherniack, M. Ferreira, E. Lau, A. Lin, S. Madden, E. O'Neil, P. O'Neil, A. Rasin, N. Tran, and S. Zdonik. C-store: a column-oriented dbms. In VLDB '05: Proceedings of the 31st international conference on Very large data bases, pages 553--564. VLDB Endowment, 2005.

Digital Library

Google Scholar

[12]

}}D. Tsirogiannis, S. Harizopoulos, M. A. Shah, J. L. Wiener, and G. Graefe. Query Processing Techniques for Solid State Drives. In SIGMOD'09, pages 59--72, 2009.

Digital Library

Google Scholar

[13]

}}C.-H. Wu, T.-W. Kuo, and L.-P. Chang. An Efficient B-tree Layer Implementation for Flash-memory Storage Systems. ACM Trans. Embedded Comput. Syst., 6(3), 2007.

Digital Library

Google Scholar

[14]

}}M. Zukowski, P. A. Boncz, N. Nes, and S. Héman. Monetdb/x100 - a dbms in the cpu cache. IEEE Data Eng. Bull., 28(2):17--22, 2005.

Google Scholar

Cited By

View all

Philipp GStephan BKai-Uwe S(2018)An NVM-Aware Storage Layout for Analytical Workloads2018 IEEE 34th International Conference on Data Engineering Workshops (ICDEW)10.1109/ICDEW.2018.00025(110-115)Online publication date: Apr-2018
https://doi.org/10.1109/ICDEW.2018.00025
Baumann SBoncz PSattler K(2016)Bitwise dimensional co-clustering for analytical workloadsThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-015-0417-y25:3(291-316)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1007/s00778-015-0417-y
Baumann SBoncz PSattler K(2013)Automatic schema design for co-clustered tables2013 IEEE 29th International Conference on Data Engineering Workshops (ICDEW)10.1109/ICDEW.2013.6547427(56-61)Online publication date: Apr-2013
https://doi.org/10.1109/ICDEW.2013.6547427

Index Terms

Flashing databases: expectations and limitations

Recommendations

Flashing up the storage layer

In the near future, commodity hardware is expected to incorporate both flash and magnetic disks. In this paper we study how the storage layer of a database system can benefit from the presence of both kinds of disk. We propose using the flash and the ...
A data management method for databases using hybrid storage systems

When applications require high I/O performance, solid-state drives (SSDs) are often preferable because they perform better than traditional hard-disk drives (HDDs). Therefore, database system response time can be improved by moving frequently used data ...
I/O characteristics of NoSQL databases

The advent of the so-called NoSQL databases has brought about a new model of using storage systems. While traditional relational database systems took advantage of features offered by centrally-managed, enterprise-class storage arrays, the new ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

DaMoN '10: Proceedings of the Sixth International Workshop on Data Management on New Hardware

June 2010

56 pages

ISBN:9781450301893

DOI:10.1145/1869389

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SIGMOD/PODS '10

Sponsor:

SIGMOD

SIGMOD/PODS '10: International Conference on Management of Data

June 7, 2010

Indiana, Indianapolis

Acceptance Rates

Overall Acceptance Rate 94 of 127 submissions, 74%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
185
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Philipp GStephan BKai-Uwe S(2018)An NVM-Aware Storage Layout for Analytical Workloads2018 IEEE 34th International Conference on Data Engineering Workshops (ICDEW)10.1109/ICDEW.2018.00025(110-115)Online publication date: Apr-2018
https://doi.org/10.1109/ICDEW.2018.00025
Baumann SBoncz PSattler K(2016)Bitwise dimensional co-clustering for analytical workloadsThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-015-0417-y25:3(291-316)Online publication date: 1-Jun-2016
https://dl.acm.org/doi/10.1007/s00778-015-0417-y
Baumann SBoncz PSattler K(2013)Automatic schema design for co-clustered tables2013 IEEE 29th International Conference on Data Engineering Workshops (ICDEW)10.1109/ICDEW.2013.6547427(56-61)Online publication date: Apr-2013
https://doi.org/10.1109/ICDEW.2013.6547427

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Flashing up the storage layer

A data management method for databases using hybrid storage systems

I/O characteristics of NoSQL databases