short-paper

SOR-HDFS: a SEDA-based approach to maximize overlapping in RDMA-enhanced HDFS

Authors:

Nusrat S. Islam,

Xiaoyi Lu,

Md. Wasi-ur- Rahman,

Dhabaleswar K. (DK) PandaAuthors Info & Claims

HPDC '14: Proceedings of the 23rd international symposium on High-performance parallel and distributed computing

Pages 261 - 264

https://doi.org/10.1145/2600212.2600715

Published: 23 June 2014 Publication History

Get Access

Abstract

In this paper, we propose SOR-HDFS, a SEDA (Staged Event-Driven Architecture)-based approach to improve the performance of HDFS Write operation. This design not only incorporates RDMA-based communication over InfiniBand but also maximizes overlapping among different stages of data transfer and I/O. Performance evaluations show that, the new design improves the aggregated write throughput of Enhanced DFSIO benchmark in Intel HiBench by up to 64% and reduces the job execution time by 37% compared to IPoIB (IP over InfiniBand). Compared to the previous best RDMA-enhanced design [4], the improvements in throughput and execution time are 30% and 20%, respectively. Our design can also improve the performance of HBase Put operation by up to 53% over IPoIB and 29% compared to the previous best RDMA-enhanced HDFS. To the best of our knowledge, this is the first design of SEDA-based HDFS in the literature.

References

[1]

Gordon at San Diego Supercomputer Center, http://www.sdsc.edu/us/resources/gordon/.

Google Scholar

[2]

N. S. Islam, X. Lu, M. W. Rahman, J. Jose, H. Wang, and D. K. Panda. A Micro-benchmark Suite for Evaluating HDFS Operations on Modern Clusters. In The Proceedings of 2nd Workshop on Big Data Benchmarking (WBDB), India, 2012.

Google Scholar

[3]

N. S. Islam, X. Lu, M. W. Rahman, and D. K. Panda. Can Parallel Replication Benefit Hadoop Distributed File System for High Performance Interconnects? In The Proceedings of IEEE 21st Annual Symposium on High-Performance Interconnects (HOTI), San Jose, CA, 2013.

Digital Library

Google Scholar

[4]

N. S. Islam, M. W. Rahman, J. Jose, R. Rajachandrasekar, H. Wang, H. Subramoni, C. Murthy, and D. K. Panda. High Performance RDMA-based Design of HDFS over InfiniBand. In The Proceedings of The International Conference for High Performance Computing, Networking, Storage and Analysis (SC), Salt Lake City, 2012.

Digital Library

Google Scholar

[5]

J. Shafer, S. Rixner, and A. L. Cox. The Hadoop Distributed Filesystem: Balancing Portability and Performance. In The Proceedings of the International Symposium on Performance Analysis of Systems and Software (ISPASS'10), White Plains, NY, 2010.

Google Scholar

[6]

Stampede at Texas Advanced Computing Center. http://www.tacc.utexas.edu/resources/hpc/stampede.

Google Scholar

[7]

M. Welsh, D. Culler, and E. Brewer. SEDA: An Architecture for Well-Conditioned, Scalable Internet Services. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP), Banff, Alberta, Canada, 2001.

Digital Library

Google Scholar

Cited By

View all

Li YKashyap AGuo YLu X(2023)Characterizing Lossy and Lossless Compression on Emerging BlueField DPU Architectures2023 IEEE Symposium on High-Performance Interconnects (HOTI)10.1109/HOTI59126.2023.00019(33-40)Online publication date: Aug-2023
https://doi.org/10.1109/HOTI59126.2023.00019
Weingram ALi YQi HNg DDai LLu X(2023)xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep LearningJournal of Computer Science and Technology10.1007/s11390-023-2894-638:1(166-195)Online publication date: 31-Mar-2023
https://doi.org/10.1007/s11390-023-2894-6
Liu YZhang XLiu BZhao X(2022)The research and analysis of efficiency of hardware usage base on HDFSCluster Computing10.1007/s10586-022-03597-025:5(3719-3732)Online publication date: 11-May-2022
https://doi.org/10.1007/s10586-022-03597-0
Show More Cited By

Index Terms

SOR-HDFS: a SEDA-based approach to maximize overlapping in RDMA-enhanced HDFS
1. General and reference
  1. Cross-computing tools and techniques
    1. Design

Recommendations

A comparative between hadoop mapreduce and apache Spark on HDFS
IML '17: Proceedings of the 1st International Conference on Internet of Things and Machine Learning

Data is growing now in a very high speed with a large volume, Spark and MapReduce¹ both provide a processing model for analyzing and managing this large data -Big Data- stored on HDFS. In this paper, we discuss a comparative between Apache Spark and ...
A Micro-benchmark Suite for Evaluating HDFS Operations on Modern Clusters
Revised Selected Papers of the First Workshop on Specifying Big Data Benchmarks - Volume 8163

Hadoop Distributed File System HDFS is the primary storage system of Hadoop. Many applications use HDFS as the underlying file system due to its portability and fault-tolerance. The most popular benchmark to measure the I/O performance of HDFS is ...
Unifying HDFS and GPFS: Enabling Analytics on Software-Defined Storage
Middleware '16: Proceedings of the 17th International Middleware Conference

Distributed file systems built for Big Data Analytics and cluster file systems built for traditional applications have very different functionality requirements, resulting in separate storage silos. In enterprises, there is often the need to run ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

HPDC '14: Proceedings of the 23rd international symposium on High-performance parallel and distributed computing

June 2014

334 pages

ISBN:9781450327497

DOI:10.1145/2600212

General Chairs:
Beth Plale
Indiana University, USA
,
Matei Ripeanu
University of British Columbia, CA
,
Program Chairs:
Franck Cappello
Argonne National Lab and INRIA, USA
,
Dongyan Xu
Purdue University, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 June 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Conference

HPDC'14

Sponsor:

SIGARCH

HPDC'14: The 23rd International Symposium on High-Performance Parallel and Distributed Computing

June 23 - 27, 2014

BC, Vancouver, Canada

Acceptance Rates

HPDC '14 Paper Acceptance Rate 21 of 130 submissions, 16%;

Overall Acceptance Rate 166 of 966 submissions, 17%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
347
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Li YKashyap AGuo YLu X(2023)Characterizing Lossy and Lossless Compression on Emerging BlueField DPU Architectures2023 IEEE Symposium on High-Performance Interconnects (HOTI)10.1109/HOTI59126.2023.00019(33-40)Online publication date: Aug-2023
https://doi.org/10.1109/HOTI59126.2023.00019
Weingram ALi YQi HNg DDai LLu X(2023)xCCL: A Survey of Industry-Led Collective Communication Libraries for Deep LearningJournal of Computer Science and Technology10.1007/s11390-023-2894-638:1(166-195)Online publication date: 31-Mar-2023
https://doi.org/10.1007/s11390-023-2894-6
Liu YZhang XLiu BZhao X(2022)The research and analysis of efficiency of hardware usage base on HDFSCluster Computing10.1007/s10586-022-03597-025:5(3719-3732)Online publication date: 11-May-2022
https://doi.org/10.1007/s10586-022-03597-0
Li TShi HLu Xde Supinski BHall MGamblin T(2021)HatRPCProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476191(1-14)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476191
Zhang XLiu BGou ZShi JZhao X(2020)DCache: A Distributed Cache Mechanism for HDFS based on RDMA2020 IEEE 22nd International Conference on High Performance Computing and Communications; IEEE 18th International Conference on Smart City; IEEE 6th International Conference on Data Science and Systems (HPCC/SmartCity/DSS)10.1109/HPCC-SmartCity-DSS50907.2020.00035(283-291)Online publication date: Dec-2020
https://doi.org/10.1109/HPCC-SmartCity-DSS50907.2020.00035
Pathak APandey MRautaray S(2019)Approaches of enhancing interoperations among high performance computing and big data analytics via augmentationCluster Computing10.1007/s10586-019-02960-yOnline publication date: 3-Aug-2019
https://doi.org/10.1007/s10586-019-02960-y
Nicolae BCosta CMisale CKatrinis KPark Y(2017)Leveraging Adaptive I/O to Optimize Collective Data Shuffling Patterns for Big Data AnalyticsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.262755828:6(1663-1674)Online publication date: 1-Jun-2017
https://dl.acm.org/doi/10.1109/TPDS.2016.2627558
Rahman MIslam NLu XPanda D(2017)A Comprehensive Study of MapReduce Over Lustre for Intermediate Data Placement and Shuffle Strategies on HPC ClustersIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2016.259194728:3(633-646)Online publication date: 1-Mar-2017
https://dl.acm.org/doi/10.1109/TPDS.2016.2591947
Gugnani SLu XPanda D(2017)Swift-XProceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing10.1109/CCGRID.2017.103(238-247)Online publication date: 14-May-2017
https://dl.acm.org/doi/10.1109/CCGRID.2017.103
Rahman MIslam NLu XPanda D(2017)NVMD: Non-volatile memory assisted design for accelerating MapReduce and DAG execution frameworks on HPC systems2017 IEEE International Conference on Big Data (Big Data)10.1109/BigData.2017.8257947(369-374)Online publication date: Dec-2017
https://doi.org/10.1109/BigData.2017.8257947
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

A comparative between hadoop mapreduce and apache Spark on HDFS

A Micro-benchmark Suite for Evaluating HDFS Operations on Modern Clusters

Unifying HDFS and GPFS: Enabling Analytics on Software-Defined Storage