short-paper

An analysis of LSM caching in NVRAM

Authors:

Wolfgang Lehner,

Ivan SchreterAuthors Info & Claims

DAMON '17: Proceedings of the 13th International Workshop on Data Management on New Hardware

Article No.: 9, Pages 1 - 5

https://doi.org/10.1145/3076113.3076123

Published: 14 May 2017 Publication History

Abstract

The rise of NVRAM technologies promises to change the way we think about system architectures. In order to fully exploit its advantages, it is required to develop systems specially tailored for NVRAM devices. Not only this imposes great challenges, but developing full system architectures from scratch is undesirable in many scenarios due to prohibitive development costs. Instead, we analyze in this paper the behavior of an existing log-structured persistent key-value store, namely LevelDB, when run on top of an emulated NVRAM device. We investigate initial opportunities for improvement when adapting a system tailored for HDD/SSDs to run on top of an NVRAM environment. Furthermore, we analyze the behavior of the legacy DRAM caching component of LevelDB and whether more suitable caching policies are required.

References

[1]

Apache Cassandra. http://cassandra.apache.org/. Accessed: 2017-02-17.

[2]

Apache HBase. https://hbase.apache.org/. Accessed: 2017-02-17.

[3]

Direct Access for files. https://www.kernel.org/doc/Documentation/filesystems/dax.txt. Accessed: 2017-02-17.

[4]

LevelDB. http://leveldb.org/. Accessed: 2017-02-17.

[5]

NVML. http://pmem.io/nvml/libpmem/. Accessed: 2017-02-17.

[6]

Riak. http://basho.com/products/riak-kv/. Accessed: 2017-02-17.

[7]

RocksDB. http://rocksdb.org/. Accessed: 2017-02-17.

[8]

P. Bonnet. What's Up with the Storage Hierarchy? CIDR 2017, 8th Biennial Conference on Innovative Data Systems Research (Online Proceedings), 2017.

[9]

F. Chang, J. Dean, S. Ghemawat, W. C. Hsieh, D. A. Wallach, M. Burrows, T. Chandra, A. Fikes, and R. E. Gruber. Bigtable: A Distributed Storage System for Structured Data. Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation, 2006.

Digital Library

[10]

B. F. Cooper, A. Silberstein, E. Tam, R. Ramakrishnan, and R. Sears. Benchmarking cloud serving systems with YCSB. Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC), 2010.

Digital Library

[11]

S. Dulloor, S. Kumar, A. Keshavamurthy, P. Lantz, D. Reddy, R. Sankaran, and J. Jackson. System Software For Persistent Memory. Eurosys Conference, 2014.

[12]

S. R. Dulloor. Systems and Applications for Persistent Memory. https://smartech.gatech.edu/bitstream/handle/1853/54396/DULLOOR-DISSERTATION-2015.pdf, 2015. PhD Thesis.

[13]

T. Johnson and D. E. Shasha. 2Q: A Low Overhead High Performance Buffer Management Replacement Algorithm. PVLDB, 1994.

[14]

J. Li, A. Pavlo, and S. Dong. NVMRocks: RocksDB on Non-Volatile Memory Systems. http://istc-bigdata.org/index.php/nvmrocks-rocksdb-on-non-volatile-memory-systems/. Accessed: 2017-02-17.

[15]

P. E. O'Neil, E. Cheng, D. Gawlick, and E. J. O'Neil. The Log-Structured Merge-Tree (LSM-Tree). Acta Inf., 1996.

Digital Library

[16]

I. Oukid, D. Booss, W. Lehner, P. Bumbulis, and T. Willhalm. SOFORT: a hybrid SCM-DRAM storage engine for fast data recovery. International Workshop on Data Management on New Hardware, 2014.

Digital Library

[17]

S. Pelley, T. F. Wenisch, B. T. Gold, and B. Bridge. Storage Management in the NVRAM Era. PVLDB, 2013.

Digital Library

[18]

SNIA. NVM Programming Model V1.1. http://www.snia.org/sites/default/files/NVMProgrammingModel_v1.1.pdf, 2015.

[19]

M. Wilcox. Add support for NV-DIMMs to ext4. https://lwn.net/Articles/613384/. Accessed: 2017-02-17.

[20]

J. Xu and S. Swanson. NOVA A Log-structured File System for Hybrid Volatile/Non-volatile Main Memories. Proceedings of the 14th USENIX Conference on File and Storage Technologies (FAST), 2016.

Cited By

Neganov A(2022)Multi-versioned log-structured index2022 Ivannikov Memorial Workshop (IVMEM)10.1109/IVMEM57067.2022.9983963(35-42)Online publication date: 23-Sep-2022
https://doi.org/10.1109/IVMEM57067.2022.9983963
Jibril MGötze PBroneske DSattler K(2021)Selective caching: a persistent memory approach for multi-dimensional index structuresDistributed and Parallel Databases10.1007/s10619-021-07327-0Online publication date: 14-Mar-2021
https://doi.org/10.1007/s10619-021-07327-0
Chen XHao JQiao YZhang T(2020)WAL-assisted Tiering: Painlessly Improving Your Favorite Log-Structured KV Store Instead of Building a New OneProceedings of the International Symposium on Memory Systems10.1145/3422575.3422802(304-316)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3422575.3422802
Show More Cited By

Recommendations

Research on write optimization of NVRAM memory management system based on decision tree and LSM-Tree
CIPAE 2020: Proceedings of the 2020 International Conference on Computers, Information Processing and Advanced Education

Non-volatile random memory has the characteristics of fast read and random storage of SRAM and DRAM, and the non-volatile characteristics of magnetic disks, which has become one of the current research hotspots of memory. However, the writing speed of ...
LSM-trie: an LSM-tree-based ultra-large key-value store for small data
USENIX ATC '15: Proceedings of the 2015 USENIX Conference on Usenix Annual Technical Conference

Key-value (KV) stores have become a backbone of large-scale applications in today's data centers. The data set of the store on a single server can grow to billions of KV items or many terabytes, while individual data items are often small (with their ...
Performance Trade-Offs in Using NVRAM Write Buffer for Flash Memory-Based Storage Devices

While NAND flash memory is used in a variety of end-user devices, it has a few disadvantages, such as asymmetric speed of read and write operations, inability to in-place updates, among others. To overcome these problems, various flash-aware strategies ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

DAMON '17: Proceedings of the 13th International Workshop on Data Management on New Hardware

May 2017

70 pages

ISBN:9781450350259

DOI:10.1145/3076113

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Short-paper

Conference

SIGMOD/PODS'17

SIGMOD/PODS'17: International Conference on Management of Data

May 14 - 19, 2017

Illinois, Chicago

Acceptance Rates

Overall Acceptance Rate 94 of 127 submissions, 74%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
532
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Neganov A(2022)Multi-versioned log-structured index2022 Ivannikov Memorial Workshop (IVMEM)10.1109/IVMEM57067.2022.9983963(35-42)Online publication date: 23-Sep-2022
https://doi.org/10.1109/IVMEM57067.2022.9983963
Jibril MGötze PBroneske DSattler K(2021)Selective caching: a persistent memory approach for multi-dimensional index structuresDistributed and Parallel Databases10.1007/s10619-021-07327-0Online publication date: 14-Mar-2021
https://doi.org/10.1007/s10619-021-07327-0
Chen XHao JQiao YZhang T(2020)WAL-assisted Tiering: Painlessly Improving Your Favorite Log-Structured KV Store Instead of Building a New OneProceedings of the International Symposium on Memory Systems10.1145/3422575.3422802(304-316)Online publication date: 28-Sep-2020
https://dl.acm.org/doi/10.1145/3422575.3422802
Jibril MGotze PBroneske DSattler K(2020)Selective Caching: A Persistent Memory Approach for Multi-Dimensional Index Structures2020 IEEE 36th International Conference on Data Engineering Workshops (ICDEW)10.1109/ICDEW49219.2020.00010(115-120)Online publication date: Apr-2020
https://doi.org/10.1109/ICDEW49219.2020.00010
Kim DChoi WSung HPark SHung CPapadopoulos G(2019)A scalable and persistent key-value store using non-volatile memoryProceedings of the 34th ACM/SIGAPP Symposium on Applied Computing10.1145/3297280.3298991(464-467)Online publication date: 8-Apr-2019
https://dl.acm.org/doi/10.1145/3297280.3298991
Qader MCheng SHristidis VDas GJermaine CBernstein P(2018)A Comparative Study of Secondary Indexing Techniques in LSM-based NoSQL DatabasesProceedings of the 2018 International Conference on Management of Data10.1145/3183713.3196900(551-566)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3183713.3196900
van Renen ALeis VKemper ANeumann THashida TOe KDoi YHarada LSato MDas GJermaine CBernstein P(2018)Managing Non-Volatile Memory in Database SystemsProceedings of the 2018 International Conference on Management of Data10.1145/3183713.3196897(1541-1555)Online publication date: 27-May-2018
https://dl.acm.org/doi/10.1145/3183713.3196897

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents