research-article

GIGA+: scalable directories for shared file systems

Authors:

Swapnil V. Patil,

Garth A. Gibson,

Sam Lang,

Milo PolteAuthors Info & Claims

PDSW '07: Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07

Pages 26 - 29

https://doi.org/10.1145/1374596.1374604

Published: 11 November 2007 Publication History

Get Access

Abstract

There is an increasing use of high-performance computing (HPC) clusters with thousands of compute nodes that, with the advent of multi-core CPUs, will impose a significant challenge for storage systems: The ability to scale to handle I/O generated by applications executing in parallel in tens of thousands of threads. One such challenge is building scalable directories for cluster storage - i.e., directories that can store billions to trillions of entries and handle hundreds of thousands of operations per second.

References

[1]

Private Communication with Garth A. Gibson, Panasas Inc.

Google Scholar

[2]

M. Baker and J. K. Ousterhout. Availability in the Sprite Distributed File System. Operating Systems Review, 25(2), Apr. 1991.

Digital Library

Google Scholar

[3]

M. Eisler, P. Corbett, M. Kazar, D. S. Nydick, and J. C. Wagner. Data ONTAP GX: A Scalable Storage Cluster. In Proc. of the FAST '07 Conference on File and Storage Technologies, San Jose CA, Feb. 2007.

Digital Library

Google Scholar

[4]

R. Fagin, J. Nievergelt, N. Pippenger, and H. R. Strong. Extendible Hashing - A Fast Access Method for Dynamic Files. ACM Transactions on Database Systems, 4(3), Sept. 1979.

Digital Library

Google Scholar

[5]

P. L. Lehman and S. B. Yao. Efficient Locking for Concurrent Operations on B-Trees. ACM Transactions on Database Systems, 6(4), Dec. 1981.

Digital Library

Google Scholar

[6]

J. MacCormick, N. Murphy, M. Najork, C. A. Thekkath, and L. Zhou. Boxwood: Abstractions as the Foundation for Storage Infrastructure. In Proc. of the 6th Symposium on Operating Systems Design and Implementation (OSDI '04), San Francisco CA, Dec. 2004.

Digital Library

Google Scholar

[7]

J. K. Ousterhout, H. D. Costa, D. Harrison, J. A. Kunze, M. Kupfer, and J. G. Thompson. A Trace-Driven Analysis of the UNIX 4.2 BSD File System. In Proc. of 10th ACM Symposium on Operating Systems Principles (SOSP '85), Orcas Island WA, Dec. 1985.

Digital Library

Google Scholar

[8]

PVFS2. Parallel Virtual File System, Version 2. http://www.pvfs2.org.

Google Scholar

[9]

R. Ross, E. Felix, B. Loewe, L. Ward, J. Nunez, J. Bent, E. Salmon, and G. Grider. High end computing revitalization task force (HECRTF), inter agency working group (HECIWG) file systems and I/O research guidance workshop. http://institutes.lanl.gov/hec-fsio/docs/HECIWG-FSIO-FY06-Workshop-Document-FINAL6.pdf, 2006.

Google Scholar

[10]

F. Schmuck and R. Haskin. GPFS: A Shared-Disk File System for Large Computing Clusters. In Proc. of the FAST '02 Conference on File and Storage Technologies, Monterey CA, Jan. 2002.

Digital Library

Google Scholar

[11]

A. Sweeney, D. Doucette, W. Hu, C. Anderson, M. Nishimoto, and G. Peck. Scalability in the XFS File System. In Proc. of USENIX Conference '96, San Jose CA, 1996.

Digital Library

Google Scholar

[12]

T. Y. Ts'o. Planned Extensions to the Linux Ext2/Ext3 Filesystem. In Proc. of USENIX Conference '02, FREENIX Track, Monterey CA, 2002.

Digital Library

Google Scholar

[13]

VERIZON. 'Trans-Pacific Express' to Offer Greater Speed, Reliability and Efficiency. http://newscenter.verizon.com/press-releases/verizon/2006/verizon-business-joins.html, Dec. 2006.

Google Scholar

Cited By

View all

Liao GAbadi D(2023)FileScaleProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624784(459-474)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624784
Macko PHennessey J(2022)Survey of Distributed File System Design ChoicesACM Transactions on Storage10.1145/346540518:1(1-34)Online publication date: 2-Mar-2022
https://dl.acm.org/doi/10.1145/3465405
Li HCheng PChen ZXiao N(2019)Pream: Enhancing HPC Storage System Performance with Pre-Allocated Metadata Management Mechanism2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS)10.1109/HPCC/SmartCity/DSS.2019.00069(413-420)Online publication date: Aug-2019
https://doi.org/10.1109/HPCC/SmartCity/DSS.2019.00069
Show More Cited By

GIGA+: scalable directories for shared file systems
1. General and reference
  1. Cross-computing tools and techniques
2. Software and its engineering
  1. Software organization and properties
    1. Contextual software domains
      1. Operating systems
    2. Software system structures

Recommendations

Scale and concurrency of GIGA+: file system directories with millions of files
FAST'11: Proceedings of the 9th USENIX conference on File and stroage technologies

We examine the problem of scalable file system directories, motivated by data-intensive applications requiring millions to billions of small files to be ingested in a single directory at rates of hundreds of thousands of file creates every second. We ...
Evaluation of Rodinia Codes on Intel Xeon Phi
ISMS '13: Proceedings of the 2013 4th International Conference on Intelligent Systems, Modelling and Simulation

High performance computing (HPC) is a niche area where various parallel benchmarks are constantly used to explore and evaluate the performance of Heterogeneous computing systems on the horizon. The Rodinia benchmark suite, a collection of parallel ...
On the Efficacy of a Fused CPU+GPU Processor (or APU) for Parallel Computing
SAAHPC '11: Proceedings of the 2011 Symposium on Application Accelerators in High-Performance Computing

The graphics processing unit (GPU) has made significant strides as an accelerator in parallel computing. However, because the GPU has resided out on PCIe as a discrete device, the performance of GPU applications can be bottlenecked by data transfers ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

PDSW '07: Proceedings of the 2nd international workshop on Petascale data storage: held in conjunction with Supercomputing '07

November 2007

72 pages

ISBN:9781595938992

DOI:10.1145/1374596

Conference Chair:
Garth A. Gibson
Carnegie Mellon University and Panasas Inc.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Conference

SC '07

Sponsor:

SIGARCH

SC '07: International Conference for High Performance Computing, Networking, Storage and Analysis

November 11, 2007

Nevada, Reno

Acceptance Rates

Overall Acceptance Rate 17 of 41 submissions, 41%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

32
Total Citations
View Citations
232
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Liao GAbadi D(2023)FileScaleProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624784(459-474)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624784
Macko PHennessey J(2022)Survey of Distributed File System Design ChoicesACM Transactions on Storage10.1145/346540518:1(1-34)Online publication date: 2-Mar-2022
https://dl.acm.org/doi/10.1145/3465405
Li HCheng PChen ZXiao N(2019)Pream: Enhancing HPC Storage System Performance with Pre-Allocated Metadata Management Mechanism2019 IEEE 21st International Conference on High Performance Computing and Communications; IEEE 17th International Conference on Smart City; IEEE 5th International Conference on Data Science and Systems (HPCC/SmartCity/DSS)10.1109/HPCC/SmartCity/DSS.2019.00069(413-420)Online publication date: Aug-2019
https://doi.org/10.1109/HPCC/SmartCity/DSS.2019.00069
Niazi SIsmail MHaridi SDowling J(2019)HopsFS: Scaling Hierarchical File System Metadata Using NewSQL DatabasesEncyclopedia of Big Data Technologies10.1007/978-3-319-77525-8_146(965-979)Online publication date: 20-Feb-2019
https://doi.org/10.1007/978-3-319-77525-8_146
Singh HBawa S(2018)Scalable Metadata Management Techniques for Ultra-Large Distributed Storage Systems -- A Systematic ReviewACM Computing Surveys10.1145/321268651:4(1-37)Online publication date: 31-Jul-2018
https://dl.acm.org/doi/10.1145/3212686
Zhang ZXiao LSu SRuan LWei BZhou NLiu XWang HWei Z(2018)HSAStore: A Hierarchical Storage Architecture for Computing Systems Containing Large-Scale Intermediate DataCollaborative Computing: Networking, Applications and Worksharing10.1007/978-3-030-00916-8_54(591-601)Online publication date: 26-Sep-2018
https://doi.org/10.1007/978-3-030-00916-8_54
Niazi SIsmail MHaridi SDowling JGrohsschmiedt SRonström MKuenning GWaldspurger C(2017)HopsFSProceedings of the 15th Usenix Conference on File and Storage Technologies10.5555/3129633.3129642(89-103)Online publication date: 27-Feb-2017
https://dl.acm.org/doi/10.5555/3129633.3129642
Wang TMoody AZhu YMohror KSato KIslam TYu W(2017)MetaKV: A Key-Value Store for Metadata Management of Distributed Burst Buffers2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS)10.1109/IPDPS.2017.39(1174-1183)Online publication date: May-2017
https://doi.org/10.1109/IPDPS.2017.39
Fattahi TAzmi R(2017)A new approach for directory management in GlusterFS2017 9th International Conference on Information and Knowledge Technology (IKT)10.1109/IKT.2017.8258635(166-174)Online publication date: Oct-2017
https://doi.org/10.1109/IKT.2017.8258635
Wu HZhu LLu KLi GWu D(2016)StageFS: A Parallel File System Optimizing Metadata Performance for SSD Based Clusters2016 IEEE Trustcom/BigDataSE/ISPA10.1109/TrustCom.2016.0330(2147-2152)Online publication date: Aug-2016
https://doi.org/10.1109/TrustCom.2016.0330
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

Scale and concurrency of GIGA+: file system directories with millions of files

Evaluation of Rodinia Codes on Intel Xeon Phi

On the Efficacy of a Fused CPU+GPU Processor (or APU) for Parallel Computing