research-article

Beyond block I/O: implementing a distributed shared log in hardware

Authors:

Mahesh Balakrishnan,

Dahlia MalkhiAuthors Info & Claims

SYSTOR '13: Proceedings of the 6th International Systems and Storage Conference

Article No.: 21, Pages 1 - 11

https://doi.org/10.1145/2485732.2485739

Published: 30 June 2013 Publication History

Abstract

The basic block I/O interface used for interacting with storage devices hasn't changed much in 30 years. With the advent of very fast I/O devices based on solid-state memory, it becomes increasingly attractive to make many devices directly and concurrently available to many clients. However, when multiple clients share media at fine grain, retaining data consistency is problematic: SCSI, IDE, and their descendants don't offer much help. We propose an interface to networked storage that reduces an existing software implementation of a distributed shared log to hardware. Our system achieves both scalable throughput and strong consistency, while obtaining significant benefits in cost and power over the software implementation.

References

[1]

N. Agrawal, V. Prabhakaran, T. Wobber, J. D. Davis, M. Manasse, and R. Panigrahy. Design tradeoffs for SSD performance. In USENIX ATC, 2008.

Digital Library

[2]

D. G. Andersen, J. Franklin, M. Kaminsky, A. Phanishayee, L. Tan, and V. Vasudevan. FAWN: A fast array of wimpy nodes. In SOSP, 2009.

Digital Library

[3]

ARM Ltd. Performance tab: ARM Cortex-A9 performance power & area. http://www.arm.com/products/processors/cortex-a/cortex-a9.php, 2012.

[4]

M. Balakrishnan, D. Malkhi, V. Prabhakaran, T. Wobber, M. Wei, and J. Davis. CORFU: A shared log design for flash clusters. In NSDI, 2012.

Digital Library

[5]

P. Bernstein, C. Reid, and S. Das. Hyder: A transactional record manager for shared flash. In CIDR, 2011.

[6]

A. Birrell, M. Isard, C. Thacker, and T. Wobber. A design for high-performance flash disks. Operating Systems Review, 41(2):88--93, 2007.

Digital Library

[7]

J. Davis, C. P. Thacker, and C. Chang. BEE3: Revitalizing computer architecture research. In MSR-TR-2009-45.

[8]

Fusion-io, Inc. Fusion-io achieves more than nine million iops from a single iodrive2. http://www.fusionio.com/press-releases, 2013.

[9]

J. Hartman and J. Ousterhout. The Zebra striped network file system. ACM TOCS, 13(3):274--310, 1995.

Digital Library

[10]

R. Haskin, Y. Malachi, and G. Chan. Recovery management in QuickSilver. ACM TOCS, 6(1):82--108, 1988.

Digital Library

[11]

P. Hunt, M. Konar, F. Junqueira, and B. Reed. ZooKeeper: Wait-free coordination for Internet-scale systems. In USENIX ATC, 2010.

Digital Library

[12]

Intel Corporation. Intel Solid-State Drive 320 Series. http://www.intel.com/content/dam/www/public/us/en/documents/product-specifications/ssd-320-specification.pdf, 2013.

[13]

Intel Corporation. Intel X18-M/X25-M SATA Solid-State Drive - 34 nm Product Line. http://download.intel.com/design/flash/nand/mainstream/Specification322296.pdf, 2013.

[14]

M. Ji, A. Veitch, J. Wilkes, et al. Seneca: Remote mirroring done write. In USENIX ATC, 2003.

[15]

L. Lamport. The part-time parliament. ACM TOCS, 16:133--169, 1998.

Digital Library

[16]

Microsoft Corporation. Registered Input/Output (RIO) API Extensions. http://technet.microsoft.com/en-us/library/hh997032.aspx, 2013.

[17]

Microsoft Research. Beehive distribution for licensees. http://research.microsoft.com/en-us/um/people/birrell/beehive/.

[18]

E. B. Nightingale, J. Elson, J. Fan, O. Hofmann, J. Howell, and Y. Suzue. Flat datacenter storage. In OSDI, 2012.

Digital Library

[19]

R. Pagh and F. F. Rodler. Cuckoo hashing. Journal of Algorithms, 41:122--144, 2004.

Digital Library

[20]

Pure Storage, Inc. Pure Storage FlashArray FA-300 Series. http://www.purestorage.com/pdf/Pure_Storage_FlashArray_Datasheet.pdf, 2013.

[21]

M. Rosenblum and J. Ousterhout. The design and implementation of a log-structured file system. ACM TOCS, 10(1), 1992.

Digital Library

[22]

F. Schmuck and R. Haskin. GPFS: A shared-disk file system for large computing clusters. In FAST, 2002.

Digital Library

[23]

F. Schmuck and J. Wylie. Experience with transactions in QuickSilver. Operating Systems Review, 25(5), 1991.

Digital Library

[24]

M. Seltzer, K. Smith, H. Balakrishnan, J. Chang, S. McMains, and V. Padmanabhan. File system logging versus clustering: A performance comparison. In USENIX ATC, 1995.

Digital Library

[25]

A. Spector, R. Pausch, and G. Bruell. Camelot: A flexible, distributed transaction processing system. In Compcon Spring'88.

[26]

J. E. Stine, I. Castellanos, M. Wood, J. Henson, F. Love, W. R. Davis, P. D. Franzon, M. Bucher, S. Basavarajaiah, J. Oh, and R. Jenkal. FreePDK: An open-source variation-aware design kit. In IEEE International Conference on Microelectronic Systems Education, 2007.

Digital Library

[27]

J. Suzuki, T. Baba, Y. Hidaka, J. Higuchi, N. Kami, S. Uchida, M. Takahashi, T. Sugawara, and T. Yoshikawa. Adaptive memory system over Ethernet. In HotStorage, 2010.

Digital Library

[28]

R. van Renesse and F. B. Schneider. Chain replication for supporting high throughput and availability. In OSDI, 2004.

Digital Library

[29]

Violin Memory, Inc. 6000 Series Flash Memory Arrays. http://www.violin-memory.com/products/6000-flash-memory-array/, 2013.

[30]

Xilinx. XUPV5-LX110T User Manual. http://www.xilinx.com/univ/xupv5-lx110T-manual.htm.

[31]

J. Yang, D. B. Minturn, and F. Hady. When poll is better than interrupt. In FAST, 2012.

Digital Library

Cited By

Trivedi ABrunella MBaumann ACrooks NSchwarzkopf M(2023)CPU-free Computing: A Vision with a BlueprintProceedings of the 19th Workshop on Hot Topics in Operating Systems10.1145/3593856.3595906(1-14)Online publication date: 22-Jun-2023
https://dl.acm.org/doi/10.1145/3593856.3595906
István ZSidler DAlonso G(2017)CaribouProceedings of the VLDB Endowment10.14778/3137628.313763210:11(1202-1213)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.14778/3137628.3137632
Balakrishnan MMalkhi DDavis JPrabhakaran VWei MWobber T(2013)CORFUACM Transactions on Computer Systems10.1145/253593031:4(1-24)Online publication date: 20-Dec-2013
https://dl.acm.org/doi/10.1145/2535930

Index Terms

Beyond block I/O: implementing a distributed shared log in hardware

Recommendations

Fracturable DSP Block for Multi-context Reconfigurable Architectures

Multi-context architectures like NATURE enable low-power applications to leverage fast context switching for improved energy efficiency and lower area footprint. The NATURE architecture incorporates 16-bit reconfigurable DSP blocks for accelerating ...
An Anti-cheating Block Secret Sharing Scheme Based on Cyclic Codes
IIH-MSP '13: Proceedings of the 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing

In secret sharing, cheaters may reconstruct and recover the secret by providing faked shares, but the honest participants get no information about it. The anti-cheating secret sharing scheme can detect cheating and identify cheaters, so that it can ...
Parallel and element-reduced error-diffused block truncation coding
ICIP'09: Proceedings of the 16th IEEE international conference on Image processing

Block Truncation Coding (BTC) is an efficient compression technique for its inherent simple coding strategy. However, the annoying blocking effect and false contour accompanied in high coding gain configurations make the applications relatively limited ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SYSTOR '13: Proceedings of the 6th International Systems and Storage Conference

June 2013

198 pages

ISBN:9781450321167

DOI:10.1145/2485732

General Chair:
Ronen Kat
IBM Research
,
Program Chairs:
Mary Baker
HP Labs
,
Sivan Toledo
Tel Aviv University

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

INTEL: Intel Corporation
Riverbed: Riverbed
NetApp
Technion: Israel Institute of Technology
Google Inc.
SAP
SIGOPS: ACM Special Interest Group on Operating Systems
EMC<sup>2</sup>: EMC<sup>2</sup>
AXCIENT: AXCIENT
USENIX Assoc: USENIX Assoc
IBM: IBM
HP: HP

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 June 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SYSTOR '13

Sponsor:

INTEL
Riverbed
Technion
SIGOPS
EMC<sup>2</sup>
AXCIENT
USENIX Assoc
IBM
HP

SYSTOR '13: 6th Annual International Systems and Storage Conference

June 30 - July 2, 2013

Haifa, Israel

Acceptance Rates

SYSTOR '13 Paper Acceptance Rate 20 of 49 submissions, 41%;

Overall Acceptance Rate 108 of 323 submissions, 33%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
210
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Trivedi ABrunella MBaumann ACrooks NSchwarzkopf M(2023)CPU-free Computing: A Vision with a BlueprintProceedings of the 19th Workshop on Hot Topics in Operating Systems10.1145/3593856.3595906(1-14)Online publication date: 22-Jun-2023
https://dl.acm.org/doi/10.1145/3593856.3595906
István ZSidler DAlonso G(2017)CaribouProceedings of the VLDB Endowment10.14778/3137628.313763210:11(1202-1213)Online publication date: 1-Aug-2017
https://dl.acm.org/doi/10.14778/3137628.3137632
Balakrishnan MMalkhi DDavis JPrabhakaran VWei MWobber T(2013)CORFUACM Transactions on Computer Systems10.1145/253593031:4(1-24)Online publication date: 20-Dec-2013
https://dl.acm.org/doi/10.1145/2535930

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents