article

A dynamic replica management strategy in data grid

Authors:

Najme Mansouri,

Gholam Hosein DastghaibyfardAuthors Info & Claims

Journal of Network and Computer Applications, Volume 35, Issue 4

Pages 1297 - 1303

https://doi.org/10.1016/j.jnca.2012.01.014

Published: 01 July 2012 Publication History

Abstract

Data Grid provides scalable infrastructure for storage resource and data files management, which supports several large scale applications. Due to limitation of available resources in grid, efficient use of the grid resources becomes an important challenge. Replication is a technique used in data grid to improve fault tolerance and to reduce the bandwidth consumption. This paper proposes a Dynamic Hierarchical Replication (DHR) algorithm that places replicas in appropriate sites i.e. best site that has the highest number of access for that particular replica. It also minimizes access latency by selecting the best replica when various sites hold replicas. The proposed replica selection strategy selects the best replica location for the users' running jobs by considering the replica requests that waiting in the storage and data transfer time. The simulated results with OptorSim, i.e. European Data Grid simulator show that DHR strategy gives better performance compared to the other algorithms and prevents unnecessary creation of replica which leads to efficient storage usage.

References

[1]

Allcock B, Bester J, Bresnahan J., Chervenak AL, Kesselman C, Meder S, Nefedova V, Quesnel D, Tuecke S, Foster I, Secure. efficient data transport and replica management for high-performance data-intensive computing, in: Proceedings of the First Eighteenth IEEE Symposium on Mass Storage Systems and Technologies, 2001.

[2]

Abawajy, JH, Placement of file replicas in data grid environments, in: ICCS 2004, in: Lecture Notes in Computer Science, 2004, pp. 66-73.

[3]

Resource placement in torus based networks. IEEE Transactions on Computers. v46 i10. 1083-1092.

[4]

Enhanced fast spread replication strategy for data grid. Journal of Network and Compute Applications. v34. 575-580.

[5]

The data grid: towards an architecture for the distributed management and analysis of large scientific datasets. Journal of Network and Compute Applications. v23 i3. 187-200.

[6]

Cameron DG, Millar AP, Nicholson C, Carvajal-Schiaffino R, Zini F, Stockinger K. Optorsim: A simulation tool for scheduling and replica optimization in data grids, in: International Conference for Computing in High Energy and Nuclear Physics (CHEP 2004), 2004.

[7]

Evaluation of an economy-based file replication strategy for a data grid. in: International Workshop on Agent based Cluster and Grid Computing. 120-126.

[8]

A study on performance of dynamic file replication algorithms for real-time file access in Data Grids. Future Generation Computer System. v25. 829-839.

Digital Library

[9]

The grid: a new infrastructure for 21st century science. Physics Today. v55 i2. 42-47.

[10]

Hara T. Effective replica allocation in ad hoc networks for improving data accessibility, in: Proceeding of IEEE Infocom Conference, 2001, pp. 1568-1576.

[11]

A hierarchical scheduling and replication strategy. International Journal of Computer Science and Network Security. v8.

[12]

PHFS: A dynamic replication method, to decrease access latency in the multi-tier data grid. Future Generation Computer System. v27. 233-244.

[13]

Loukopoulos T, Lampsas P, Ahmad I. Continuous replica placement schemes in distributed systems, in: Proceedings of the 19th International Conference on Supercomputing, 2005, pp. 284-292.

Digital Library

[14]

Data replication in data intensive scientific applications with performance guarantee. IEEE Transactions on Parallel and Distributed Systems. v22. 1299-1306.

[15]

OptorSim-A Replica Optimizer Simulation: {http://edg-wp2.web.cern.ch/edgwp2/optimization/optorsim.html}

[16]

. Dynamic data replication strategy based on internet hierarchy BHR, 2004.Lecture notes in computer science publisher, Springer-Verlag, Heidelberg.

[17]

Rehn-Sonigo, V, Optimal replica placement in tree networks with QOS and bandwidth constraints and the closest allocation policy, Technical Report, No. 6233, INRIA, 2007.

[18]

Replica placement strategies in data grid. Journal of Grid Computing. v6 i1. 103-123.

[19]

Ranganathana K, Foster I. Identifying dynamic replication strategies for a high performance data grid, in: Proceedings of the International Grid Computing Workshop, 2001, pp. 75-86.

Digital Library

[20]

Replica selection strategies in data grid. Journal of Parallel and Distributed Computing. v68. 1561-1574.

Digital Library

[21]

Stockinger H, Samar A, Allcock B, Foster I, Holtman K, Tierney B. File and object replication in data grids, in: 10th IEEE Symposium on High Performance and Distributed Computing, 2001, pp. 305-314.

Digital Library

[22]

Adaptive popularity-driven replica placement in hierarchical data grids. Journal of Supercomputers. v51. 374-392.

[23]

Resource allocation in cube network systems based on the covering radius. IEEE Transactions on Parallel and Distributed Systems. v7 i4. 328-342.

[24]

Replica placement algorithms for mobile transaction systems. IEEE Transactions on Knowledge and Data Engineering. v18 i7. 954-970.

[25]

Worldwide Lhc Computing Grid, {http://lcg.web.cern.ch/LCG/}, 2011.

[26]

The multicast policy and its relationship to replicated data placement. ACM Transactions on Database System. v16 i1. 181-205.

[27]

Zhong H, Zhang Z, Zhang X. A dynamic replica management strategy based on Data Grid, in: Ninth International Conference on Grid and Cloud Computing, 2010.

Digital Library

Cited By

Sabaghian KKhamforoosh KGhaderzadeh A(2023)Data Replication and Placement Strategies in Distributed Systems: A State of the Art SurveyWireless Personal Communications: An International Journal10.1007/s11277-023-10240-7129:4(2419-2453)Online publication date: 20-Mar-2023
https://dl.acm.org/doi/10.1007/s11277-023-10240-7
He LQian ZShang F(2020)A novel predicted replication strategy in cloud storageThe Journal of Supercomputing10.1007/s11227-018-2647-476:7(4838-4856)Online publication date: 1-Jul-2020
https://dl.acm.org/doi/10.1007/s11227-018-2647-4
Mansouri NJavidi M(2020)Cost-based job scheduling strategy in cloud computing environmentsDistributed and Parallel Databases10.1007/s10619-019-07273-y38:2(365-400)Online publication date: 1-Jun-2020
https://dl.acm.org/doi/10.1007/s10619-019-07273-y
Show More Cited By

A dynamic replica management strategy in data grid

Recommendations

Job scheduling and dynamic data replication in data grid environment

Data Grid is a geographically distributed environment that deals with large-scale data-intensive applications. Effective scheduling in Grid can reduce the amount of data transferred among nodes by submitting a job to a node, where most of the requested ...
Combination of data replication and scheduling algorithm for improving data availability in Data Grids

Data Grid is a geographically distributed environment that deals with large-scale data-intensive applications. Effective scheduling in Grid can reduce the amount of data transferred among nodes by submitting a job to a node, where most of the requested ...
Enhanced Dynamic Hierarchical Replication and Weighted Scheduling Strategy in Data Grid

The Data Grid provides massive aggregated computing resources and distributed storage space to deal with data-intensive applications. Due to the limitation of available resources in the grid as well as production of large volumes of data, efficient use ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Journal of Network and Computer Applications

Journal of Network and Computer Applications Volume 35, Issue 4

July, 2012

201 pages

ISSN:1084-8045

Issue’s Table of Contents

Copyright © Elsevier Ltd © 2012.

Publisher

Academic Press Ltd.

United Kingdom

Publication History

Published: 01 July 2012

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

25
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sabaghian KKhamforoosh KGhaderzadeh A(2023)Data Replication and Placement Strategies in Distributed Systems: A State of the Art SurveyWireless Personal Communications: An International Journal10.1007/s11277-023-10240-7129:4(2419-2453)Online publication date: 20-Mar-2023
https://dl.acm.org/doi/10.1007/s11277-023-10240-7
He LQian ZShang F(2020)A novel predicted replication strategy in cloud storageThe Journal of Supercomputing10.1007/s11227-018-2647-476:7(4838-4856)Online publication date: 1-Jul-2020
https://dl.acm.org/doi/10.1007/s11227-018-2647-4
Mansouri NJavidi M(2020)Cost-based job scheduling strategy in cloud computing environmentsDistributed and Parallel Databases10.1007/s10619-019-07273-y38:2(365-400)Online publication date: 1-Jun-2020
https://dl.acm.org/doi/10.1007/s10619-019-07273-y
Li CWang YTang HLuo Y(2019)Dynamic multi-objective optimized replica placement and migration strategies for SaaS applications in edge cloudFuture Generation Computer Systems10.1016/j.future.2019.05.003100:C(921-937)Online publication date: 1-Nov-2019
https://dl.acm.org/doi/10.1016/j.future.2019.05.003
Li CWang YTang HZhang YXin YLuo Y(2019)Flexible replica placement for enhancing the availability in edge computing environmentComputer Communications10.1016/j.comcom.2019.07.013146:C(1-14)Online publication date: 15-Oct-2019
https://dl.acm.org/doi/10.1016/j.comcom.2019.07.013
Mansouri NJavidi M(2018)A hybrid data replication strategy with fuzzy-based deletion for heterogeneous cloud data centersThe Journal of Supercomputing10.5555/3288339.328836474:10(5349-5372)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.5555/3288339.3288364
Matri PPérez MCostan ABougé LAntoniu G(2018)Keeping up with storageFuture Generation Computer Systems10.1016/j.future.2017.06.00986:C(1093-1105)Online publication date: 1-Sep-2018
https://dl.acm.org/doi/10.1016/j.future.2017.06.009
Mansouri NJavidi M(2018)A hybrid data replication strategy with fuzzy-based deletion for heterogeneous cloud data centersThe Journal of Supercomputing10.1007/s11227-018-2427-174:10(5349-5372)Online publication date: 1-Oct-2018
https://dl.acm.org/doi/10.1007/s11227-018-2427-1
Souravlas SSifaleras A(2017)Binary-Tree Based Estimation of File Requests for Efficient Data ReplicationIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2017.265022828:7(1839-1852)Online publication date: 10-Jun-2017
https://dl.acm.org/doi/10.1109/TPDS.2017.2650228
Wang TYao SXu ZPan S(2017)Dynamic replication to reduce access latency based on fuzzy logic systemComputers and Electrical Engineering10.1016/j.compeleceng.2016.11.02260:C(48-57)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1016/j.compeleceng.2016.11.022
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents