tutorial

Data management over flash memory

Authors:

Ioannis Koltsidas,

Stratis D. ViglasAuthors Info & Claims

SIGMOD '11: Proceedings of the 2011 ACM SIGMOD International Conference on Management of data

Pages 1209 - 1212

https://doi.org/10.1145/1989323.1989455

Published: 12 June 2011 Publication History

Abstract

Flash SSDs are quickly becoming mainstream and emerge as alternatives to magnetic disks. It is therefore imperative to incorporate them seamlessly into the enterprise. We present the salient results of research in the area, touching all aspects of the data management stack: from the fundamentals of flash technology, through storage for database systems and the manipulation of SSD-resident data, to query processing.

Supplementary Material

JPG File (thursday16-athensview-tutorial5.jpg)

Download
13.11 KB

WMV File (thursday16-athensview-tutorial5.wmv)

Download
353.88 MB

References

[1]

N. Agrawal et al. Design tradeoffs for SSD performance. In USENIX Annual Technical, 2008.

Digital Library

[2]

A. Ailamaki et al. Data page layouts for relational databases on deep memory hierarchies. The VLDB Journal, 11(3), 2002.

Digital Library

[3]

D. Ajwani et al. Characterizing the performance of flash memory storage devices and its impact on algorithm design. In WEA 2008.

Digital Library

[4]

P. A. Bernstein et al. Hyder - a transactional record manager for shared flash. 2011.

[5]

A. Birrell et al. A design for high-performance flash disks. SIGOPS Oper. Syst. Rev., 41(2), 2007.

Digital Library

[6]

L. Bouganim et al. uFLIP: Understanding flash IO patterns. In CIDR, 2009.

[7]

M. Canim et al. An object placement advisor for DB2 using solid state storage. Proc. VLDB Endow., 2(2), 2009.

Digital Library

[8]

M. Canim et al. Buffered Bloom filters on solid state storage. In ADMS, 2010.

[9]

M. Canim et al. SSD bufferpool extensions for database systems. Proc. VLDB Endow., 3(2), 2010.

Digital Library

[10]

S. Chen. FlashLogging: exploiting flash devices for synchronous logging performance. In SIGMOD 2009.

Digital Library

[11]

T.-S. Chung et al. System software for flash memory: A survey. In EUC, 2006.

Digital Library

[12]

B. Debnath et al. Flashstore: High throughput persistent keyvalue store. Proc. VLDB Endow., 3(2), 2010.

Digital Library

[13]

J. Do and J. M. Patel. Join processing for flash SSDs: remembering past lessons. In DAMON 2009.

Digital Library

[14]

T. Emrich et al. On the impact of flash SSDs on spatial indexing. In DAMON, 2010.

Digital Library

[15]

E. Gal and S. Toledo. Algorithms and data structures for flash memories. ACM Comput. Surv., 37(2), 2005.

Digital Library

[16]

A. Holloway. Adapting database storage for new hardware. PhD Thesis. University of Wisconsin - Madison., 2009.

Digital Library

[17]

HP Labs. Getting smart about data center cooling. http://www.hpl.hp.com/news/2006/power.html, 2006.

[18]

X.-Y. Hu et al. Write amplification analysis in flash-based solid state drives. In SYSTOR 2009.

Digital Library

[19]

H. Kim and S. Ahn. BPLRU: a buffer management scheme for improving random writes in flash storage. In FAST, 2008.

Digital Library

[20]

J. Kim et al. A space-efficient flash translation layer for CompactFlash systems. Trans. on Consumer Electronics., 2002.

Digital Library

[21]

I. Koltsidas. Flashing up the storage hierarchy. PhD Thesis. The University of Edinburgh., 2010.

[22]

I. Koltsidas and S. D. Viglas. Flashing up the storage layer. Proc. VLDB Endow., 1(1), 2008.

Digital Library

[23]

S.-W. Lee and B. Moon. Design of flash-based DBMS: An in-page logging approach. In SIGMOD, 2007.

Digital Library

[24]

S.-W. Lee et al. Advances in flash memory SSD technology for enterprise database applications. In SIGMOD 2009.

Digital Library

[25]

S.-W. Lee et al. A log buffer-based flash translation layer using fully-associative sector translation. Trans. on Embedded Comp. Sys., 2007.

Digital Library

[26]

S.-W. Lee et al. A case for flash memory SSD in enterprise database applications. In SIGMOD, 2008.

Digital Library

[27]

A. Leventhal. Flash storage memory. Commun. ACM, 51(7):47--51, 2008.

Digital Library

[28]

X. Li et al. A new dynamic hash index for flash-based storage. In WAIM, 2008.

Digital Library

[29]

Y. Li et al. Tree indexing on flash disks. In ICDE, 2009.

Digital Library

[30]

D. Ma et al. LazyFTL: A page-level flash translation layer optimized for NAND flash memory. In SIGMOD, 2011.

Digital Library

[31]

D. Myers. On the use of NAND flash memory in high-performance relational databases. MSc Thesis, MIT, 2007.

[32]

D. Narayanan et al. Migrating server storage to SSDs: analysis of tradeoffs. In EuroSys, 2009.

Digital Library

[33]

S. Nath and P. B. Gibbons. Online maintenance of very large random samples on flash storage. Proc. VLDB Endow., 1(1), 2008.

Digital Library

[34]

S. Nath and A. Kansal. FlashDB: Dynamic Self-Tuning Database for NAND Flash. In IPSN, 2007.

Digital Library

[35]

Y. Ou et al. CFDC: a flash-aware replacement policy for database buffer management. In DAMON, 2009.

Digital Library

[36]

S.-Y. Park et al. CFLRU: a replacement algorithm for flash memory. In CASES, 2006.

Digital Library

[37]

K. A. Ross. Modeling the performance of algorithms on flash memory devices. In DAMON, 2008.

Digital Library

[38]

G. Soundararajan et al. Extending SSD lifetimes with disk-based write caches. In FAST, 2010.

Digital Library

[39]

R. Stoica et al. Evaluating and repairing write performance on flash devices. In DAMON, 2009.

Digital Library

[40]

Sun Microsystems. The Solaris ZFS filesystem, 2008.

[41]

D. Tsirogiannis et al. Query processing techniques for solid state drives. In SIGMOD, 2009.

Digital Library

[42]

X. Wu and A. N. Reddy. Exploiting concurrency to improve latency and throughput in a hybrid storage system. MASCOTS 2010.

Digital Library

[43]

C.-H. Wu et al. An efficient R-tree implementation over flash-memory storage systems. In GIS, 2003.

Digital Library

[44]

C.-H. Wu et al. An Efficient B-tree Layer Implementation for Flash-Memory Storage Systems. Trans. on Embedded Computing Sys., 6(3), 2007.

Digital Library

[45]

D. Zeinalipour-Yazti et al. Microhash: an efficient index structure for flash-based sensor devices. In FAST, 2005.

Digital Library

Cited By

Shukla SAbouzeid A(2017)Optimal Device-Aware CachingIEEE Transactions on Mobile Computing10.1109/TMC.2016.261097816:7(1994-2007)Online publication date: 1-Jul-2017
https://doi.org/10.1109/TMC.2016.2610978
Shukla SAbouzeid A(2016)On designing optimal memory damage aware caching policies for content-centric networks2016 14th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt)10.1109/WIOPT.2016.7492918(1-8)Online publication date: May-2016
https://doi.org/10.1109/WIOPT.2016.7492918
Kanza YYaari H(2016)External sorting on flash storageThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-016-0426-525:4(495-518)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s00778-016-0426-5
Show More Cited By

Index Terms

Data management over flash memory
1. Information systems
  1. Data management systems
    1. Database management system engines

Recommendations

A hybrid filesystem for hard disk drives in tandem with flash memory

The traditional hard disk drive (HDD) is often a bottleneck in the overall performance of modern computer systems. With the development of solid state drives (SSD) based on flash memory, new possibilities are available to improve secondary storage ...
Write amplification analysis in flash-based solid state drives
SYSTOR '09: Proceedings of SYSTOR 2009: The Israeli Experimental Systems Conference

Write amplification is a critical factor limiting the random write performance and write endurance in storage devices based on NAND-flash memories such as solid-state drives (SSD). The impact of garbage collection on write amplification is influenced by ...
Flash-Aware RAID Techniques for Dependable and High-Performance Flash Memory SSD

Solid-state disks (SSDs), which are composed of multiple NAND flash chips, are replacing hard disk drives (HDDs) in the mass storage market. The performances of SSDs are increasing due to the exploitation of parallel I/O architectures. However, ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMOD '11: Proceedings of the 2011 ACM SIGMOD International Conference on Management of data

June 2011

1364 pages

ISBN:9781450306614

DOI:10.1145/1989323

General Chair:
Timos Sellis
IMIS/RC Athena
,
Program Chair:
Renée J. Miller
University of Toronto
,
Publications Chairs:
Anastasios Kementsietsidis
IBM T.J. Watson Research Center
,
Yannis Velegrakis
University of Trento

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMOD: ACM Special Interest Group on Management of Data

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 June 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Tutorial

Conference

SIGMOD/PODS '11

Sponsor:

SIGMOD

SIGMOD/PODS '11: International Conference on Management of Data

June 12 - 16, 2011

Athens, Greece

Acceptance Rates

Overall Acceptance Rate 743 of 3,801 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
1,154
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)1

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shukla SAbouzeid A(2017)Optimal Device-Aware CachingIEEE Transactions on Mobile Computing10.1109/TMC.2016.261097816:7(1994-2007)Online publication date: 1-Jul-2017
https://doi.org/10.1109/TMC.2016.2610978
Shukla SAbouzeid A(2016)On designing optimal memory damage aware caching policies for content-centric networks2016 14th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt)10.1109/WIOPT.2016.7492918(1-8)Online publication date: May-2016
https://doi.org/10.1109/WIOPT.2016.7492918
Kanza YYaari H(2016)External sorting on flash storageThe VLDB Journal — The International Journal on Very Large Data Bases10.1007/s00778-016-0426-525:4(495-518)Online publication date: 1-Aug-2016
https://dl.acm.org/doi/10.1007/s00778-016-0426-5
Kang YJo YCha JKim SShin Y(2016)The uFLIP benchmark revisited for evaluating SSDsInternational Journal of Communication Systems10.1002/dac.299529:14(2100-2111)Online publication date: 25-Sep-2016
https://dl.acm.org/doi/10.1002/dac.2995
Viglas SSellis TDavidson SIves Z(2015)Data Management in Non-Volatile MemoryProceedings of the 2015 ACM SIGMOD International Conference on Management of Data10.1145/2723372.2731082(1707-1711)Online publication date: 27-May-2015
https://dl.acm.org/doi/10.1145/2723372.2731082
Viglas S(2014)Write-limited sorts and joins for persistent memoryProceedings of the VLDB Endowment10.14778/2732269.27322777:5(413-424)Online publication date: 1-Jan-2014
https://dl.acm.org/doi/10.14778/2732269.2732277
Ghodsnia PBowman INica ADyreson CLi FÖzsu M(2014)Parallel I/O aware query optimizationProceedings of the 2014 ACM SIGMOD International Conference on Management of Data10.1145/2588555.2595635(349-360)Online publication date: 18-Jun-2014
https://dl.acm.org/doi/10.1145/2588555.2595635
Do JKee YPatel JPark CPark KDeWitt DRoss KSrivastava DPapadias D(2013)Query processing on smart SSDsProceedings of the 2013 ACM SIGMOD International Conference on Management of Data10.1145/2463676.2465295(1221-1230)Online publication date: 22-Jun-2013
https://dl.acm.org/doi/10.1145/2463676.2465295
DeWitt DDo JPatel JZhang D(2013)Fast peak-to-peak behavior with SSD buffer poolProceedings of the 2013 IEEE International Conference on Data Engineering (ICDE 2013)10.1109/ICDE.2013.6544903(1129-1140)Online publication date: 8-Apr-2013
https://dl.acm.org/doi/10.1109/ICDE.2013.6544903
Ouarnoughi HBoukhobza JOlivier PPlassart LBellatreche L(2013)Performance analysis and modeling of SQLite embedded databases on flash file systemsDesign Automation for Embedded Systems10.1007/s10617-014-9149-217:3-4(507-542)Online publication date: 1-Sep-2013
https://dl.acm.org/doi/10.1007/s10617-014-9149-2
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents