research-article

Multi-stage replay with crosscut

Authors:

Dominic Lucchetti,

Geoffrey Lefebvre,

Peter M. ChenAuthors Info & Claims

VEE '10: Proceedings of the 6th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

Pages 13 - 24

https://doi.org/10.1145/1735997.1736002

Published: 17 March 2010 Publication History

Abstract

Deterministic record-replay has many useful applications, ranging from fault tolerance and forensics to reproducing and diagnosing bugs. When choosing a record-replay solution, the system administrator must choose a priori how comprehensively to record the execution and at what abstraction level to record it. Unfortunately, these choices may not match well with how the recording is eventually used. A recording may contain too little information to support the end use of replay, or it may contain more sensitive information than is allowed to be shown to the end user of replay. Similarly, fixing the abstraction level at the time of recording often leads to a semantic mismatch with the end use of replay.

This paper describes how to remedy these problems by adding customizable replay stages to create special-purpose logs for the end users of replay. Our system, called Crosscut, allows replay logs to be "sliced" along time and abstraction boundaries. Using this approach, users can create slices that include only the processes, applications, or components of interest, excluding parts that handle sensitive data. Users can also retarget the abstraction level of the replay log to higher-level platforms, such as Perl or Valgrind. Execution can then be augmented with additional analysis code at replay time, without disturbing the replayed components in the slice. Crosscut thus uses replay itself to transform logs into a more efficient, secure, and usable form for replay-based applications.

Our current Crosscut prototype builds on VMware Workstation's record-replay capabilities, and supports a variety of different replay environments. We show how Crosscut can create slices of only the parts of the computation of interest and thereby avoid leaking sensitive information, and we show how to retarget the abstraction level of the log to enable more convenient use during replay debugging.

References

[1]

Bacon, D. F., and Goldstein, S. C. Hardware-Assisted Replay of Multiprocessor Programs. In Proceedings of the ACM/ONR Workshop on Parallel and Distributed Debugging (May 1991).

Digital Library

[2]

Bressoud, T. C., and Schneider, F. B. Hypervisor-based fault tolerance. ACM Transactions on Computer Systems 14, 1 (February 1996), 80--107.

Digital Library

[3]

Castro, M., Costa, M., and Martin, J.-P. Better Bug Reporting With Better Privacy. In Proceedings of the 2008 International Conference on Architectural Support for Programming Languages and Operating Systemst (ASPLOS) (March 2008), pp. 319--328.

Digital Library

[4]

Chow, J., Garfinkel, T., and Chen, P. M. Decoupling dynamic program analysis from execution in virtual environments. In Proceedings of the 2008 USENIX Technical Conference (June 2008), pp. 1--14.

Digital Library

[5]

Dunlap, G. W., King, S. T., Cinar, S., Basrai, M., and Chen, P. M. ReVirt: Enabling Intrusion Analysis through Virtual-Machine Logging and Replay. In Proceedings of the 2002 Symposium on Operating Systems Design and Implementation (December 2002), pp. 211--224.

Digital Library

[6]

Garfinkel, T., and Rosenblum, M. A Virtual Machine Introspection Based Architecture for Intrusion Detection. In Proceedings of the 2003 Network and Distributed System Security Symposium (NDSS) (February 2003).

[7]

Guo, Z., Wang, X., Tang, J., Liu, X., Xu, Z., Wu, M., Kaashoek, M. F., and Zhang, Z. R2: An ApplicationLevel Kernel for Record and Replay. In Proceedings of the 2008 Symposium on Operating Systems Design and Implementation (December 2008), pp. 193--208.

Digital Library

[8]

Hower, D. R., and Hill, M. D. Rerun: Exploiting Episodes for Lightweight memory Race Recording. In Proceedings of the 2008 International Symposium on Computer Architecture (June 2008), pp. 265--276.

Digital Library

[9]

Jiang, X., Wang, X., and Xu, D. Stealthy Malware Detection Through VMM-Based Out-of-the-Box Semantic View Reconstruction. In Proceedings of the 2007 ACM Conference on Computer and Communications Security (CCS) (November 2007), pp. 128--138.

Digital Library

[10]

Joshi, A., King, S. T., Dunlap, G. W., and Chen, P. M. Detecting past and present intrusions through vulnerability-specific predicates. In Proceedings of the 2005 Symposium on Operating Systems Principles (October 2005), pp. 91--104.

Digital Library

[11]

King, S. T., Dunlap, G. W., and Chen, P. M. Debugging operating systems with time-traveling virtual machines. In Proceedings of the 2005 USENIX Technical Conference (April 2005), pp. 1--15.

Digital Library

[12]

Lewis, B. Debugging backwards in time. In Proceedings of the 2003 Workshop on Automated and Algorithmic Debugging (September 2003).

[13]

Litzkow, M., and Solomon, M. Supporting Checkpointing and Process Migration outside the Unix Kernel. In Proceedings of the Winter 1992 USENIX Conference (January 1992).

[14]

Mellor-Crummey, J. M., and LeBlanc, T. J. A Software Instruction Counter. In Proceedings of the 1989 International Conference on Architectural Support for Programming Languages and Operating Systems (1989), pp. 78--86.

Digital Library

[15]

Montesinos, P., Ceze, L., and Torrellas, J. DeLorean: Recording and Deterministically Replaying Shared-Memory Multiprocessor Execution Efficiently. In Proceedings of the 2008 International Symposium on Computer Architecture (June 2008), pp. 289--300.

Digital Library

[16]

Napper, J., Alvisi, L., and Vin, H. A Fault-Tolerant Java Virtual Machine. In Proceedings of the 2003 International Conference on Dependable Systems and Networks (DSN) (June 2003).

[17]

Nethercote, N., and Seward, J. How to shadow every byte of memory used by a program. In Proceedings of the 2007 Conference on Virtual Execution Environments (June 2007).

Digital Library

[18]

Nethercote, N., and Seward, J. Valgrind: A framework for heavyweight dynamic binary instrumentation. In Proceedings of the 2007 Programming Language Design and Implementation Conference (June 2007).

Digital Library

[19]

Nightingale, E. B., Peek, D., Chen, P. M., and Flinn, J. Parallelizing security checks on commodity hardware. In Proceedings of the 2008 International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS) (March 2008), pp. 308--318.

Digital Library

[20]

O'Callahan, R. Efficient collection and storage of indexed program traces. http://www.ocallahan.org/Amber.pdf, December 2006.

[21]

O'Callahan, R. Announcing chronomancer. http://weblogs.mozillazine.org/roc/archives/2007/08/announcing_chro.html, August 2007.

[22]

Seward, J., and Nethercote, N. Using Valgrind to detect undefined value errors with bit-precision. In Proceedings of the 2005 USENIX Technical Conference (April 2005).

Digital Library

[23]

Srinivasan, S., Kandula, S., Andrews, C., and Zhou, Y. Flashback: A light-weight rollback and deterministic replay extension for software debugging. In Proceedings of the 2004 USENIX Technical Conference (June 2004).

Digital Library

[24]

Tucek, J., Lu, S., Huang, C., Xanthos, S., and Zhou, Y. Triage: Diagnosing Production Run Failures at the User's Site. In Proceedings of the 2007 Symposium on Operating Systems Principles (October 2007), pp. 131--144.

Digital Library

[25]

Wallace, S., and Hazelwood, K. SuperPin: Parallelizing Dynamic Instrumentation for Real-Time Performance. In Proceedings of the 2007 International Symposium on Code Generation and Optimization (CGO) (March 2007), pp. 209--217.

Digital Library

[26]

Weiser, M. Programmers use slices when debugging. Communications of the ACM 25, 7 (July 1982), 446--452.

Digital Library

[27]

Xu, M., Bodik, R., and Hill, M. D. A Flight Data Recorder for Enabling Full-system Multiprocessor Deterministic Replay. In Proceedings of the 2003 International Symposium on Computer Architecture (June 2003).

Digital Library

[28]

Xu, M., Malyugin, V., Sheldon, J., Venkitachalam, G., and Weissman, B. ReTrace: Collecting Execution Trace with Virtual Machine Deterministic Replay. In Proceedings of the 2007 Workshop on Modeling, Benchmarking and Simulation (MoBS) (June 2007).

Cited By

Shankar SMacke SChasins SHead AParameswaran A(2022)Bolt-on, Compact, and Rapid Program Slicing for NotebooksProceedings of the VLDB Endowment10.14778/3565838.356585515:13(4038-4047)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.14778/3565838.3565855
Wang WHao ZCui LCriswell JWilliams DXia Y(2022)ClusterRR: a record and replay framework for virtual machine clusterProceedings of the 18th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3516807.3516819(31-44)Online publication date: 25-Feb-2022
https://dl.acm.org/doi/10.1145/3516807.3516819
Dovgalyuk PVasiliev IFursova NDmitriev DAbakumov MMakarov V(2020)Non-intrusive Virtual Machine Analysis and Reverse Debugging with SWAT2020 IEEE 20th International Conference on Software Quality, Reliability and Security (QRS)10.1109/QRS51102.2020.00036(196-203)Online publication date: Dec-2020
https://doi.org/10.1109/QRS51102.2020.00036
Show More Cited By

Index Terms

Multi-stage replay with crosscut
1. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Software defect analysis
        Software testing and debugging

Recommendations

Multi-stage replay with crosscut
VEE '10

Deterministic record-replay has many useful applications, ranging from fault tolerance and forensics to reproducing and diagnosing bugs. When choosing a record-replay solution, the system administrator must choose a priori how comprehensively to record ...
Software-only system-level record and replay in wireless sensor networks
IPSN '15: Proceedings of the 14th International Conference on Information Processing in Sensor Networks

Wireless sensor networks (WSNs) are plagued by the possibility of bugs manifesting only at deployment. However, debugging deployed WSNs is challenging for several reasons---the remote location of deployed sensor nodes, the non- determinism of execution ...
Replay debugging: leveraging record and replay for program debugging
ISCA '14: Proceeding of the 41st annual international symposium on Computer architecuture

Hardware-assisted Record and Deterministic Replay (RnR) of programs has been proposed as a primitive for debugging hard-to-repeat software bugs. However, simply providing support for repeatedly stumbling on the same bug does not help diagnose it. For ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

VEE '10: Proceedings of the 6th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments

March 2010

176 pages

ISBN:9781605589107

DOI:10.1145/1735997

General Chair:
Marc E. Fiuczynski
Princeton University
,
Program Chairs:
Emery Berger
University of Massachusetts, Amherst
,
Andrew Warfield
University of British Columbia

ACM SIGPLAN Notices Volume 45, Issue 7
VEE '10
July 2010
161 pages
ISSN:0362-1340
EISSN:1558-1160
DOI:10.1145/1837854
Issue’s Table of Contents

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 March 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

VEE '10

Sponsor:

VEE '10: ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments

March 17 - 19, 2010

Pennsylvania, Pittsburgh, USA

Acceptance Rates

Overall Acceptance Rate 80 of 235 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

24
Total Citations
View Citations
461
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)3

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Shankar SMacke SChasins SHead AParameswaran A(2022)Bolt-on, Compact, and Rapid Program Slicing for NotebooksProceedings of the VLDB Endowment10.14778/3565838.356585515:13(4038-4047)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.14778/3565838.3565855
Wang WHao ZCui LCriswell JWilliams DXia Y(2022)ClusterRR: a record and replay framework for virtual machine clusterProceedings of the 18th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments10.1145/3516807.3516819(31-44)Online publication date: 25-Feb-2022
https://dl.acm.org/doi/10.1145/3516807.3516819
Dovgalyuk PVasiliev IFursova NDmitriev DAbakumov MMakarov V(2020)Non-intrusive Virtual Machine Analysis and Reverse Debugging with SWAT2020 IEEE 20th International Conference on Software Quality, Reliability and Security (QRS)10.1109/QRS51102.2020.00036(196-203)Online publication date: Dec-2020
https://doi.org/10.1109/QRS51102.2020.00036
Wang WCui LHao ZFei HWang CPeng Y(2020)pRnR: A Parallel Record-Replay Framework for Virtual Machines2020 IEEE 38th International Conference on Computer Design (ICCD)10.1109/ICCD50377.2020.00106(610-618)Online publication date: Oct-2020
https://doi.org/10.1109/ICCD50377.2020.00106
Stamatogiannakis MAthanasopoulos EBos HGroth P(2017)PROV2RACM Transactions on Internet Technology10.1145/306217617:4(1-24)Online publication date: 18-Aug-2017
https://dl.acm.org/doi/10.1145/3062176
Miraglia AVogt DBos HTanenbaum AGiuffrida C(2016)Peeking into the Past: Efficient Checkpoint-Assisted Time-Traveling Debugging2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE)10.1109/ISSRE.2016.9(455-466)Online publication date: Oct-2016
https://doi.org/10.1109/ISSRE.2016.9
Chen YZhang SGuo QLi LWu RChen T(2015)Deterministic ReplayACM Computing Surveys10.1145/279007748:2(1-47)Online publication date: 24-Sep-2015
https://dl.acm.org/doi/10.1145/2790077
Van't Hof AJamjoom HNieh JWilliams DRéveillère LHarris THerlihy M(2015)FluxProceedings of the Tenth European Conference on Computer Systems10.1145/2741948.2741955(1-17)Online publication date: 17-Apr-2015
https://dl.acm.org/doi/10.1145/2741948.2741955
Honarmand NTorrellas JYew PZhai AKeckler S(2014)Replay debuggingProceeding of the 41st annual international symposium on Computer architecuture10.5555/2665671.2665737(445-456)Online publication date: 14-Jun-2014
https://dl.acm.org/doi/10.5555/2665671.2665737
Honarmand NTorrellas J(2014)Replay debuggingACM SIGARCH Computer Architecture News10.1145/2678373.266573742:3(445-456)Online publication date: 14-Jun-2014
https://dl.acm.org/doi/10.1145/2678373.2665737
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents