research-article

LosPem: A Novel Log-Structured Framework for Persistent Memory

Authors:

Linpeng HuangAuthors Info & Claims

ACM Journal on Emerging Technologies in Computing Systems (JETC), Volume 16, Issue 3

Article No.: 27, Pages 1 - 17

https://doi.org/10.1145/3379932

Published: 22 May 2020 Publication History

Abstract

New and emerging types of Persistent Memory (PM) technologies boost the opportunity to improve the performance of storage systems. PM can unify the main memory and secondary storage by incorporating it into legacy computer systems through the memory bus. In recent years, innovative results have been presented that exploit the byte-addressability, low latency, and non-volatility of PM; these have included local PM file systems and PM systems. However, the high overhead of ensuring data consistency has limited the performance of these systems.

In this article, we propose LosPem, a novel log-structured framework for persistent memory to address the performance challenge. LosPem utilizes two techniques to accomplish this. Firstly, LosPem deploys efficient hash-indexed linked lists to maintain the log contents to reduce the significant overhead of log content retrieval. Secondly, LosPem improves the transaction throughput by decoupling a transaction into two asynchronous steps and creating a write buffer on Dynamic Random Access Memory (DRAM) write buffer for processing the frequent data writes. The experimental results show that LosPem outperforms Non-volatile Memory Library (NVML), Mnemosyne and Log-structured Non-volatile Main Memory (LSNVMM) by 27%, 1.2x, and 1.0x on a read-intensive workload. On a write-intensive workload, LosPem outperforms NVML, Mnemosyne, and LSNVMM by 1.8x, 1.2x, and 34%, respectively.

References

[1]

M. H. Kryder and S. K. Chang. 2009. After hard drives, what comes next? IEEE Transactions on Magnetics 45, 10 (2009), 3406--3413.

[2]

H. S. Philip Wong, Simone Raoux, SangBum Kim, Jiale Liang, John P. Reifenberg, Bipin Rajendran, Mehdi Asheghi, and Kenneth E. Goodson. 2010. Phase change memory. Proceedings of the IEEE 98, 12 (2010), 2201--2227.

[3]

Benjamin C. Lee, Ping Zhou, Jun Yang, Youtao Zhang, Bo Zhao, Engin Ipek, Onur Mutlu, and Doug Burger. 2010. Phase-change technology and the future of main memory. IEEE Micro 1 (2010), 143--143.

Digital Library

[4]

D. C. Ralph and Mark D. Stiles. 2008. Spin transfer torques. Journal of Magnetism and Magnetic Materials 320, 7 (2008), 1190--1216.

[5]

A. A. Tulapurkar, Y. Suzuki, A. Fukushima, H. Kubota, H. Maehara, K. Tsunekawa, D. D. Djayaprawira, N. Watanabe, and S. Yuasa. 2005. Spin-torque diode effect in magnetic tunnel junctions. Nature 438, 7066 (2005), 339--342.

[6]

H. Shiga et al. 2010. A 1.6GB/s DDR2 128Mb chain FeRAM with scalable octal bitline and sensing schemes. Solid-State Circuits 45, 1 (2010), 142--152.

[7]

G. W. Burr, B. N. Kurdi, J. C. Scott, C. H. Lam, K. Gopalakrishnan, and R. S. Shenoy. 2008. Overview of candidate device technologies for storage-class memory. IBM Journal of Research and Development 52, 4 (2008), 449--464.

Digital Library

[8]

Intel Corporation, Intel Non-Volatile Memory 3D XPoint. Retrieved from http://www.intel.com/content/www/us/en/architecture-and-technology/non-volatile-memory.html?wapkw=3d+xpoint.

[9]

Iulian Moraru, David G. Andersen, Michael Kaminsky, Niraj Tolia, Parthasarathy Ranganathan, and Nathan L. Binkert. 2013. Consistent, durable, and safe memory management for byte-addressable non volatile main memory. In Proceedings of the 1st ACM SIGOPS Conference on Timely Results in Operating Systems, TRIOS@SOSP 2013. Farmington, PA, 1:1--1:17.

Digital Library

[10]

Ju-Young Jung, and Sangyeun Cho. 2013. Memorage: Emerging persistent ram based malleable main memory and storage architecture. In Proceedings of the 27th International ACM Conference on International Conference on Supercomputing. 115--126.

Digital Library

[11]

Moinuddin K. Qureshi, Vijayalakshmi Srinivasan, and Jude A. Rivers. 2009. Scalable high performance main memory system using phase-change memory technology. ACM SIGARCH Computer Architecture News 37, 3 (2009), 24--33.

Digital Library

[12]

Yiying Zhang, Jian Yang, Amirsaman Memaripour, and Steven Swanson. 2015. Mojim: A reliable and highly-available non-volatile memory system. In Proceedings of the 20th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’15). Istanbul, Turkey, 3--18.

Digital Library

[13]

Jeremy Condit, Edmund B. Nightingale, Christopher Frost, Engin Ipek, Benjamin Lee, Doug Burger, and Derrick Coetzee. 2009. Better I/O through byte-addressable, persistent memory. In Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles. 133--146.

Digital Library

[14]

Jian Xu and Steven Swanson. 2016. NOVA: A log-structured file system for hybrid volatile/non-volatile main memories. In Proceedings of the 14th USENIX Conference on File and Storage Technologies (FAST’16). Santa Clara, CA, 323--338.

Digital Library

[15]

Shengan Zheng, Hao Liu, Linpeng Huang, Yanyan Shen, and Yanmin Zhu. 2018. HMVFS: A versioning file system on DRAM/NVM hybrid memory. J. Parallel Distrib. Comput. 120 (2018), 355--368.

[16]

Subramanya R. Dulloor, Sanjay Kumar, Anil Keshavamurthy, Philip Lantz, Dheeraj Reddy, Rajesh Sankaran, and Jeff Jackson. 2014. System software for persistent memory. In Proceedings of the 9th European Conference on Computer Systems. 15.

Digital Library

[17]

Shuo-Han Chen, Tseng-Yi Chen, Yuan-Hao Chang, Hsin-Wen Wei, and Wei-Kuan Shih. 2018. UnistorFS: A union storage file system design for resource sharing between memory and storage on persistent RAM-based systems. TOS 14, 1 (2018), 3:1--3:22.

Digital Library

[18]

Jiaxin Ou, Jiwu Shu, and Youyou Lu. 2016. A high performance file system for non-volatile main memory. In Proceedings of the 11th European Conference on Computer Systems. 12.

Digital Library

[19]

Sudarsun Kannan, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, Yuangang Wang, Jun Xu, and Gopinath Palani. 2018. Designing a true direct-access file system with DevF. In Proceedings of the 16th USENIX Conference on File and Storage Technologies (FAST’18). Oakland, CA, 241--256.

[20]

Xiaojian Wu and A. L. Reddy. 2011. SCMFS: A file system for storage class memory. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis. 39.

[21]

Persistent Memory Development Kit. Retrieved from http://pmem.io/pmdk.

[22]

Taeho Hwang, Jaemin Jung, and Youjip Won. 2014. Heapo: Heap-based persistent object store. ACM Transactions on Storage (TOS) 11, 1 (2014), 3:1--3:21.

[23]

Qingda Hu, Jinglei Ren, Anirudh Badam, Jiwu Shu, and Thomas Moscibroda. 2017. Log-structured non-volatile main memory. In Proceedings of the 2017 USENIX Annual Technical Conference (USENIX ATC). Santa Clara, CA.

Digital Library

[24]

Haris Volos, Andres Jaan Tack, and Michael M. Swift. 2011. Mnemosyne: Lightweight persistent memory. ACM SIGARCH Computer Architecture News 39, 1 (2011), 91--104.

Digital Library

[25]

Joel Coburn, Adrian M. Caulfield, Ameen Akel, Laura M. Grupp, Rajesh K. Gupta, Ranjit Jhala, and Steven Swanson. 2011. NV-Heaps: Making persistent objects fast and safe with next-generation, non-volatile memories. ACM SIGARCH Computer Architecture News 39, 1 (2011), 105--118.

Digital Library

[26]

Yizhou Shan, Shin-Yeh Tsai, and Yiying Zhang. 2017. Distributed shared persistent memory. In Proceedings of the 2017 Symposium on Cloud Computing (SoCC’17). Santa, Clara, CA, 323--337.

Digital Library

[27]

Haixin Huang, Kaixin Huang, Litong You, and Linpeng Huang. 2018. Forca: Fast and atomic remote direct access to persistent memory. In Proceedings of the 36th IEEE International Conference on Computer Design (ICCD’18). Orlando, FL, 246--249.

[28]

Kosuke Suzuki and Steven Swanson. 2015. A survey of trends in non-volatile memory technologies: 2000-2014. In Proceedings of the 2015 IEEE International Memory Workshop (IMW). 1--4.

[29]

Retrieved from https://software.intel.com/en-us/blogs/2016/09/12/deprecate-pcommit-instruction.

[30]

Retreived from https://www.hpl.hp.com/techreports/2012/HPL-2012-236.html.

[31]

Radu Stoica and Anastasia Ailamaki. 2013. Improving Flash Write Performance by Using Update Frequency. PVLDB 6, 9 (2013), 733--744.

Digital Library

[32]

Sumin Li, Kaixin Huang, Linpeng Huang, and Jiashun Zhu. 2019. LiwePMS: A lightweight persistent memory with wear-aware memory management. JETC 15, 3 (2019), 30:1--30:24.

Digital Library

[33]

Jiashun Zhu, Sumin Li, and Linpeng Huang. 2016. Wamalloc: An efficient wear-aware allocator for non-volatile memory. In Proceedings of the 22nd IEEE International Conference on Parallel and Distributed Systems (ICPADS’16). Wuhan, China, 625--634.

[34]

Mendel Rosenblum and John K. Ousterhout. 1992. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1 (1992), 26--52.

Digital Library

[35]

Brian F. Cooper, Adam Silberstein, Erwin Tam, Raghu Ramakrishnan and Russell Sears. 2010. Benchmarking cloud serving systems with YCSB. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC’10). Indianapolis, Indiana, 143--154.

Digital Library

Cited By

Mishra S(2024)A survey of LSM-Tree based Indexes, Data Systems and KV-stores2024 IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS)10.1109/SCEECS61402.2024.10482249(1-6)Online publication date: 24-Feb-2024
https://doi.org/10.1109/SCEECS61402.2024.10482249
Gorjiara HLuo WLee AXu GDemsky BJhala RDillig I(2022)Checking robustness to weak persistency modelsProceedings of the 43rd ACM SIGPLAN International Conference on Programming Language Design and Implementation10.1145/3519939.3523723(490-505)Online publication date: 9-Jun-2022
https://dl.acm.org/doi/10.1145/3519939.3523723
Cai TGao PChen FNiu DWang FMa YLi L(2022)A Two Tier Hybrid Metadata Management Mechanism for NVM Storage SystemNetwork and Parallel Computing10.1007/978-3-030-93571-9_16(195-213)Online publication date: 1-Jan-2022
https://doi.org/10.1007/978-3-030-93571-9_16
Show More Cited By

Index Terms

LosPem: A Novel Log-Structured Framework for Persistent Memory

Recommendations

LiwePMS: A Lightweight Persistent Memory with Wear-aware Memory Management

Next-generation Storage Class Memory (SCM) offers low-latency, high-density, byte-addressable access and persistency. The potent combination of these attractive characteristics makes it possible for SCM to unify the main memory and storage to reduce the ...
Mobile Unified Memory-Storage Structure Based on Hybrid Non-Volatile Memories
Special Issue on Hardware and Algorithms for Learning On-a-chip and Special Issue on Alternative Computing Systems

In mobile computing systems, the limited amount of main memory space leads to page swap operation overhead and data duplication in both main memory and secondary storage. Furthermore, SQLite write operations in mobile devices such as smartphones and ...
HiNFS: A Persistent Memory File System with Both Buffering and Direct-Access
Special Issue on NVM and Storage

Persistent memory provides data persistence at main memory with emerging non-volatile main memories (NVMMs). Recent persistent memory file systems aggressively use direct access, which directly copy data between user buffer and the storage layer, to ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Journal on Emerging Technologies in Computing Systems

ACM Journal on Emerging Technologies in Computing Systems Volume 16, Issue 3

Special Issue on Nanoelectronic Device, Circuit, and Architecture Design, Part 1 and Regular Papers

July 2020

214 pages

ISSN:1550-4832

EISSN:1550-4840

DOI:10.1145/3399633

Editor:
Ramesh Karri
Polytechnic Institute of New York University, USA

Issue’s Table of Contents

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 22 May 2020

Online AM: 07 May 2020

Accepted: 01 January 2020

Revised: 01 November 2019

Received: 01 May 2019

Published in JETC Volume 16, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

National Key Research 8 Development Program of China
National Natural Science Foundation of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
306
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 18 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Mishra S(2024)A survey of LSM-Tree based Indexes, Data Systems and KV-stores2024 IEEE International Students' Conference on Electrical, Electronics and Computer Science (SCEECS)10.1109/SCEECS61402.2024.10482249(1-6)Online publication date: 24-Feb-2024
https://doi.org/10.1109/SCEECS61402.2024.10482249
Gorjiara HLuo WLee AXu GDemsky BJhala RDillig I(2022)Checking robustness to weak persistency modelsProceedings of the 43rd ACM SIGPLAN International Conference on Programming Language Design and Implementation10.1145/3519939.3523723(490-505)Online publication date: 9-Jun-2022
https://dl.acm.org/doi/10.1145/3519939.3523723
Cai TGao PChen FNiu DWang FMa YLi L(2022)A Two Tier Hybrid Metadata Management Mechanism for NVM Storage SystemNetwork and Parallel Computing10.1007/978-3-030-93571-9_16(195-213)Online publication date: 1-Jan-2022
https://doi.org/10.1007/978-3-030-93571-9_16
Cai TLiu PNiu DShi JLi L(2021)The Embedded IoT Time Series Database for Hybrid Solid-State Storage SystemScientific Programming10.1155/2021/99485332021Online publication date: 25-Oct-2021
https://dl.acm.org/doi/10.1155/2021/9948533

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Issue’s Table of Contents