article

An on-line replication strategy to increase availability in Data Grids

Authors:

Susan V. Vrbsky,

Xiaoyan HongAuthors Info & Claims

Future Generation Computer Systems, Volume 24, Issue 2

Pages 85 - 98

https://doi.org/10.1016/j.future.2007.04.009

Published: 01 February 2008 Publication History

Abstract

Data is typically replicated in a Data Grid to improve the job response time and data availability. Strategies for data replication in a Data Grid have previously been proposed, but they typically assume unlimited storage for replicas. In this paper, we address the system-wide data availability problem assuming limited replica storage. We describe two new metrics to evaluate the reliability of the system, and propose an on-line optimizer algorithm that can Minimize the Data Missing Rate (MinDmr) in order to maximize the data availability. Based on MinDmr, we develop four optimizers associated with four different file access prediction functions. Simulation results utilizing the OptorSim show our MinDmr strategies achieve better performance overall than other strategies in terms of the goal of data availability using the two new metrics.

References

[1]

Bell, William H., Cameron, David G., Capozza, Luigi, Paul Millar, A., Stockinger, Kurt and Zini, Floriano, OptorSim-A grid simulator for studying dynamic data replication strategies. International Journal of High Performance Computing Applications. v17 i4.

[2]

Bell, William H., Cameron, David G., Carvajal-Schiaffino, Ruben, Paul Millar, A., Stockinger, Kurt and Zini, Floriano, Evaluation of an economy-based file replication strategy for a Data Grid. In: International Workshop on Agent Based Cluster and Grid Computing at CCGrid 2003, IEEE Computer Society Press.

Digital Library

[3]

Cameron, David G., Carvajal-Schiaffino, Ruben, Paul Millar, A., Nicholson, Caitriana, Stockinger, Kurt and Zini, Floriano, Evaluating scheduling and replica optimisation strategies in OptorSim. In: 4th International Workshop on Grid Computing (Grid2003), IEEE Computer Society Press.

Digital Library

[4]

Carman, Mark, Zini, Floriano, Serafini, Luciano and Stockinger, Kurt, Towards an economy-based optimisation of file access and replication on a Data Grid. In: International Workshop on Agent Based Cluster and Grid Computing at International Symposium on Cluster Computing and the Grid, IEEE Computer Society Press.

Digital Library

[5]

EU Data Grid project. http://www.eu-egee.org/

[6]

GriPhyN: The Grid physics network project. http://www.griphyn.org

[7]

Ming Lei, S. Vrbsky, A data replication strategy to increase availability in Data Grids, in: Grid Computing and Applications, Las Vegas, NV, 2006, pp. 221-227

[8]

T.E. Ng, H. Zhang, Predicting internet network distance with coordinates-based approaches, in: 21st IEEE INFOCOM Conference, June 2002

[9]

OptorSim-A replica optimizer simulation. http://edg-wp2.web.cern.ch/edgwp2/optimization/optorsim.html

[10]

E. Otoo, A. Shoshani, Accurate modeling of cache replacement policies in a Data-Grid. in: Proceedings. 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, MSS03, San Diego, CA, April 2003, 2003

Digital Library

[11]

Sang-Min Park, Jai-Hoon Kim, Young-Bae Ko, Won-Sik Yoon, Dynamic Data Grid replication strategy based on internet hierarchy, in: Second International Workshop on Grid and CooperativeComputing, GCC'2003, Shanghai, China, Dec 2003

[12]

PPDG. http://www.ppdg.net

[13]

Kavitha Ranganathan, Adriana Iamnitchi, Ian Foster, Improving data availability through dynamic model-driven replication in large peer-to-peer communities, in: Proceedings of the Workshop on Global and Peer-to-Peer Computing on Large Scale Distributed Systems, Berlin, May 2002

[14]

Kavitha Ranganathan, Ian Foster, Identifying dynamic replication strategies for a high performance Data Grid, in: International Workshop on Grid Computing, Denver, November 2001

Digital Library

[15]

Schintke, F. and Reinefeld, A., Modeling replica availability in large Data Grids. Journal of Grid Computing. v1 i2.

[16]

Michal Szymaniak, Guillaume Pierre, Maarten van Steen, Latency-driven replica placement, in: 2005 Symposium on Applications and the Internet, SAINT'05, pp. 399-405

Digital Library

[17]

Kunszt, Peter, Laure, Erwin, Stockinger, Heinz and Stockinger, Kurt, File-based replica management. Future Generation Computer Systems Journal. v21. 115-123.

[18]

Tang, Ming, Lee, Bu-Sung, Tang, Xueyan and Yeo, Chai-Kiat, The impact of data replication on job scheduling performance in the Data Grid. Future Generation Computer Systems Journal. v22. 254-268.

[19]

Chang, Ruay-Shiung and Chen, Po-Hung, Complete and fragmented replica selection and retrieval in Data Grids. Future Generation Computer Systems Journal. v23. 536-546.

Digital Library

[20]

Tang, Ming, Lee, Bu-Sung, Yeo, Chai-Kiat and Tang, Xueyan, Dynamic replication algorithms for the multi-tier Data Grid. Future Generation Computer Systems Journal. v21. 775-790.

[21]

Cameron, David, Casey, James, Guy, Leanne, Kunszt, Peter, Lemaitre, Sophie, McCance, Gavin, Stockinger, Heinz, Stockinger, Kurt, Andronico, Giuseppe, Bell, William, Ben-Akiva, Itzhak, Bosio, Diana, Chytracek, Radovan, Domenici, Andrea, Donno, Flavia, Hoschek, Wolfgang, Laure, Erwin, Lucio, Levi, Millar, Paul, Salconi, Livio, Segal, Ben and Silander, Mika, Replica management in the European DataGrid project. Journal of Grid Computer. v2 i4. 341-351.

[22]

BIRN. http://www.nbirn.net/

[23]

LHC accelerator project. http://www-td.fnal.gov/LHC/USLHC.html

[24]

IVOA. http://www.ivoa.net/pub/info/

Cited By

Spivak ARazumovskiy ANasonov DBoukhanovsky ARedice A(2018)Storage tier-aware replicative data reorganization with prioritization for efficient workload processingFuture Generation Computer Systems10.1016/j.future.2017.04.01079:P2(618-629)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.future.2017.04.010
Hamdeni CHamrouni TBen Charrada F(2018)Evaluation of site availability exploitation towards performance optimization in data gridsCluster Computing10.1007/s10586-018-2836-121:4(1967-1980)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s10586-018-2836-1
Chai ACamarasu-Pop SGlatard TBenoit-Cattin HSuter F(2018)Evaluation Through Realistic Simulations of File Replication Strategies for Large Heterogeneous Distributed SystemsEuro-Par 2018: Parallel Processing Workshops10.1007/978-3-030-10549-5_32(409-420)Online publication date: 27-Aug-2018
https://dl.acm.org/doi/10.1007/978-3-030-10549-5_32
Show More Cited By

An on-line replication strategy to increase availability in Data Grids

Recommendations

Combination of data replication and scheduling algorithm for improving data availability in Data Grids

Data Grid is a geographically distributed environment that deals with large-scale data-intensive applications. Effective scheduling in Grid can reduce the amount of data transferred among nodes by submitting a job to a node, where most of the requested ...
A Two-Level Fuzzy Value-Based Replica Replacement Algorithm in Data Grids

One of the challenges of data grid is to access widely distributed data fast and efficiently and providing maximum data availability with minimum latency. Data replication is an efficient way used to address this challenge by replicating and storing ...
A dynamic, cost-aware, optimized data replication strategy for heterogeneous cloud data centers

In cloud computing, it is important to maintain high data availability and the performance of the system. In order to meet these requirements, the concept of replication is used. As the number of replicas of a data file increases, the data availability ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Future Generation Computer Systems

Future Generation Computer Systems Volume 24, Issue 2

February, 2008

95 pages

ISSN:0167-739X

Issue’s Table of Contents

Copyright © Elsevier Ltd © 2007.

Publisher

Elsevier Science Publishers B. V.

Netherlands

Publication History

Published: 01 February 2008

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Spivak ARazumovskiy ANasonov DBoukhanovsky ARedice A(2018)Storage tier-aware replicative data reorganization with prioritization for efficient workload processingFuture Generation Computer Systems10.1016/j.future.2017.04.01079:P2(618-629)Online publication date: 1-Feb-2018
https://dl.acm.org/doi/10.1016/j.future.2017.04.010
Hamdeni CHamrouni TBen Charrada F(2018)Evaluation of site availability exploitation towards performance optimization in data gridsCluster Computing10.1007/s10586-018-2836-121:4(1967-1980)Online publication date: 1-Dec-2018
https://dl.acm.org/doi/10.1007/s10586-018-2836-1
Chai ACamarasu-Pop SGlatard TBenoit-Cattin HSuter F(2018)Evaluation Through Realistic Simulations of File Replication Strategies for Large Heterogeneous Distributed SystemsEuro-Par 2018: Parallel Processing Workshops10.1007/978-3-030-10549-5_32(409-420)Online publication date: 27-Aug-2018
https://dl.acm.org/doi/10.1007/978-3-030-10549-5_32
Kouidri SYagoubi B(2017)Dynamic Data Replication Based on Tasks scheduling for Cloud Computing EnvironmentInternational Journal of Strategic Information Technology and Applications10.4018/IJSITA.20171001048:4(40-51)Online publication date: 1-Oct-2017
https://dl.acm.org/doi/10.4018/IJSITA.2017100104
Eom STabet KMokadem RLaouar M(2017)Data Replication in Cloud SystemsInternational Journal of Information Systems and Social Change10.4018/IJISSC.20170701028:3(17-33)Online publication date: 1-Jul-2017
https://dl.acm.org/doi/10.4018/IJISSC.2017070102
Hamdeni CHamrouni TCharrada F(2016)Data popularity measurements in distributed systemsJournal of Network and Computer Applications10.1016/j.jnca.2016.06.00272:C(150-161)Online publication date: 1-Sep-2016
https://dl.acm.org/doi/10.1016/j.jnca.2016.06.002
Alami Milani BJafari Navimipour N(2016)A comprehensive review of the data replication techniques in the cloud environmentsJournal of Network and Computer Applications10.1016/j.jnca.2016.02.00564:C(229-238)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.1016/j.jnca.2016.02.005
Gill NSingh S(2016)A dynamic, cost-aware, optimized data replication strategy for heterogeneous cloud data centersFuture Generation Computer Systems10.1016/j.future.2016.05.01665:C(10-32)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1016/j.future.2016.05.016
Mokadem RHameurlain A(2015)Data replication strategies with performance objective in data grid systemsInternational Journal of Grid and Utility Computing10.1504/IJGUC.2015.0663956:1(30-46)Online publication date: 1-Dec-2015
https://dl.acm.org/doi/10.1504/IJGUC.2015.066395
Tos UMokadem RHameurlain AAyav TBora S(2015)Dynamic replication strategies in data grid systemsThe Journal of Supercomputing10.1007/s11227-015-1508-771:11(4116-4140)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.1007/s11227-015-1508-7
Show More Cited By

View Options

View options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Issue’s Table of Contents