Article

Space-efficient page-level incremental checkpointing

Authors:

Sung Y. ShinAuthors Info & Claims

SAC '05: Proceedings of the 2005 ACM symposium on Applied computing

Pages 1558 - 1562

https://doi.org/10.1145/1066677.1067026

Published: 13 March 2005 Publication History

Get Access

Abstract

Incremental checkpointing, which is intended to minimize checkpointing overhead, saves only the modified pages of a process. However, the cumulative size of incremental checkpoints increases at a steady rate over time because many updated values may be saved for the same page. In this paper, we present a comprehensive overview of Pickpt, which is a page-level incremental checkpointing facility. Pickpt provides space-efficient techniques for minimizing the use of disk space. For our experiments, the results show that the use of disk space of Pickpt was significantly reduced compared with existing incremental checkpointing.

References

[1]

M. Beck, J. S. Plank, and G. Kingsley. Compiler-assisted checkpointing. Technical Report UT-CS-94-269, University of Tennessee, 1994.]]

Digital Library

Google Scholar

[2]

J. Heo, S. Yi, J. Hong, Y. Cho, and J. Choi. An efficient merging algorithm for recovery and garbage collection in incremental checkpointing. In IASTED International Conference on Parallel and, Distributed and Networks, pages 365--368, February 2004.]]

Google Scholar

[3]

J. Hong, S. Kim, and Y. Cho. Cost analysis of optimistic recovery model for forked checkpointing. IEICE Transactions on Information and Systems, E86-D(9):1534--1541, September 2003.]]

Google Scholar

[4]

J. Hong, T. Park, H. Yeom, and Y. Cho. Kckpt: An efficient checkpoint facility on unixware. In International Conference on Computers and Their Applications, pages 303--308, March 2000.]]

Google Scholar

[5]

J. Lawall and G. Muller. Efficient incremental checkpointing of java programs. In IEEE Proceedings of the International Conference on Dependable Systems and Networks, pages 61--70, June 2000.]]

Digital Library

Google Scholar

[6]

M. Litzkow, T. Tannenbaun, J. Basney, and M. Livny. Checkpoint and migration of unix processes in the condor distributed processing system. Technical Report 1346, Department of Computer Science, Univ. of Wisconsin-Madison, 1997.]]

Google Scholar

[7]

J. Plank, M. Beck, and G. Kingsley. Compiler-assisted memory exclusion for fast checkpointing. In IEEE Technical Committee on Operating Systems and Application Environments, Special Issue on Fault-Tolerance, pages 62--67, December 1995.]]

Google Scholar

[8]

J. Plank, M. Beck, G. Kingsley, and K. Li. Libckpt:transparent checkpointing under unix. In Usenix Winter Technical Conference, pages 213--223, January 1995.]]

Digital Library

Google Scholar

[9]

J. Plank, Y. Chen, M. B. K. Li, and G. Kingsley. Memory exclusion: optimizing the performance of checkpointing systems. Software Practice and Experience, 29(2): 125--142, February 1999.]]

Digital Library

Google Scholar

[10]

J. Plank, K. Li, and M. Puening. Diskless checkpointing. IEEE Transactions on Parallel and Distributed Systems, 9(10):303--308, October 1998.]]

Digital Library

Google Scholar

[11]

J. Plank, J. Xu, and R. Netzer. Compressed differences: An algorithm for fast incremental checkpointing. Technical Report CS-95-302, University of Tennessee, August 1995.]]

Google Scholar

[12]

A. Ziv and J. Bruck. An on-line algorithm for checkpoint placement. IEEE Transactions on Computers, 46(9):976--985, September 1997.]]

Digital Library

Google Scholar

Cited By

View all

Shahneous Bari MBasu DLu WCurtis TChapman B(2020)Checkpointing OpenSHMEM Programs Using Compiler Analysis2020 IEEE/ACM 10th Workshop on Fault Tolerance for HPC at eXtreme Scale (FTXS)10.1109/FTXS51974.2020.00011(51-60)Online publication date: Nov-2020
https://doi.org/10.1109/FTXS51974.2020.00011
Lee KSullivan MHari STsai TKeckler SErez MEigenmann RDing CMcKee S(2019)GPU snapshotProceedings of the ACM International Conference on Supercomputing10.1145/3330345.3330361(171-183)Online publication date: 26-Jun-2019
https://dl.acm.org/doi/10.1145/3330345.3330361
Tran VRenault ÉHa V(2019)CAPE: A Checkpointing-Based Solution for OpenMP on Distributed-Memory ArchitecturesParallel Computing Technologies10.1007/978-3-030-25636-4_8(93-106)Online publication date: 17-Jul-2019
https://doi.org/10.1007/978-3-030-25636-4_8
Show More Cited By

Index Terms

Space-efficient page-level incremental checkpointing

Recommendations

Adaptive page-level incremental checkpointing based on expected recovery time
SAC '06: Proceedings of the 2006 ACM symposium on Applied computing

Incremental checkpointing, which is intended to minimize checkpointing overhead, saves only the modified pages of a process. This means that in incremental checkpointing, the time consumed for checkpointing varies according to the amount of modified ...
The overhead model of word-level and page-level incremental checkpointing
SAC '06: Proceedings of the 2006 ACM symposium on Applied computing

Generally, word-level granularity for incremental checkpointing may reduce the checkpoint file size, and hence get better the performance. However, word-level granularity may not always be more efficient than page-level granularity, because word-level ...
N-Level Diskless Checkpointing
HPCC '09: Proceedings of the 2009 11th IEEE International Conference on High Performance Computing and Communications

Diskless checkpointing is an efficient technique to tolerate a small number of processor failures in large parallel and distributed systems. In literature, a simultaneous failure of no more than N processors is often tolerated by using a one-level Reed-...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

SAC '05: Proceedings of the 2005 ACM symposium on Applied computing

March 2005

1814 pages

ISBN:1581139640

DOI:10.1145/1066677

Conference Chair:
Hisham M. Haddad
Kennesaw State University
,
Editor:
Lorie M. Liebrock
New Mexico Institute of Mining and Technology, Socorro, NM
,
Program Chairs:
Andrea Omicini
Alma Mater Studiorum, Universita di Bologna, Italy
,
Roger L. Wainwright
Univerity of Tulsa, OK

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 March 2005

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SAC05

Sponsor:

SIGAPP

SAC05: The 2005 ACM Symposium on Applied Computing

March 13 - 17, 2005

New Mexico, Santa Fe

Acceptance Rates

Overall Acceptance Rate 1,650 of 6,669 submissions, 25%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
386
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 29 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Shahneous Bari MBasu DLu WCurtis TChapman B(2020)Checkpointing OpenSHMEM Programs Using Compiler Analysis2020 IEEE/ACM 10th Workshop on Fault Tolerance for HPC at eXtreme Scale (FTXS)10.1109/FTXS51974.2020.00011(51-60)Online publication date: Nov-2020
https://doi.org/10.1109/FTXS51974.2020.00011
Lee KSullivan MHari STsai TKeckler SErez MEigenmann RDing CMcKee S(2019)GPU snapshotProceedings of the ACM International Conference on Supercomputing10.1145/3330345.3330361(171-183)Online publication date: 26-Jun-2019
https://dl.acm.org/doi/10.1145/3330345.3330361
Tran VRenault ÉHa V(2019)CAPE: A Checkpointing-Based Solution for OpenMP on Distributed-Memory ArchitecturesParallel Computing Technologies10.1007/978-3-030-25636-4_8(93-106)Online publication date: 17-Jul-2019
https://doi.org/10.1007/978-3-030-25636-4_8
Miraglia AVogt DBos HTanenbaum AGiuffrida C(2016)Peeking into the Past: Efficient Checkpoint-Assisted Time-Traveling Debugging2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE.2016.9(455-466)Online publication date: Oct-2016
https://doi.org/10.1109/ISSRE.2016.9
Vogt DMiraglia APortokalidis GBos HTanenbaum AGiuffrida CLea RGopalakrishnan STilevich EMurphy ABlackstock M(2015)Speculative Memory CheckpointingProceedings of the 16th Annual Middleware Conference10.1145/2814576.2814802(197-209)Online publication date: 24-Nov-2015
https://dl.acm.org/doi/10.1145/2814576.2814802
Egger BGustafsson EJo CSon J(2015)Efficiently Restoring Virtual MachinesInternational Journal of Parallel Programming10.1007/s10766-013-0295-043:3(421-439)Online publication date: 1-Jun-2015
https://dl.acm.org/doi/10.1007/s10766-013-0295-0
Lu PRavindran BKim C(2012)VPCProceedings of the 2012 IEEE 24th International Symposium on Computer Architecture and High Performance Computing10.1109/SBAC-PAD.2012.31(203-210)Online publication date: 24-Oct-2012
https://dl.acm.org/doi/10.1109/SBAC-PAD.2012.31
Kharbas KKim DHoefler TMueller F(2012)Assessing HPC Failure Detectors for MPI JobsProceedings of the 2012 20th Euromicro International Conference on Parallel, Distributed and Network-based Processing10.1109/PDP.2012.11(81-88)Online publication date: 15-Feb-2012
https://dl.acm.org/doi/10.1109/PDP.2012.11
Wang CMueller FEngelmann CScott S(2010)Hybrid Checkpointing for MPI Jobs in HPC EnvironmentsProceedings of the 2010 IEEE 16th International Conference on Parallel and Distributed Systems10.1109/ICPADS.2010.48(524-533)Online publication date: 8-Dec-2010
https://dl.acm.org/doi/10.1109/ICPADS.2010.48
Liao JIshikawa Y(2010)A New Concurrent Checkpoint Mechanism for Real-Time and Interactive ProcessesProceedings of the 2010 IEEE 34th Annual Computer Software and Applications Conference10.1109/COMPSAC.2010.12(47-52)Online publication date: 19-Jul-2010
https://dl.acm.org/doi/10.1109/COMPSAC.2010.12
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Adaptive page-level incremental checkpointing based on expected recovery time

The overhead model of word-level and page-level incremental checkpointing

N-Level Diskless Checkpointing