Article

Monitoring deployed software using software tomography

Authors:

Alessandro Orso,

Mary Jean HarroldAuthors Info & Claims

PASTE '02: Proceedings of the 2002 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering

Pages 2 - 9

https://doi.org/10.1145/586094.586099

Published: 18 November 2002 Publication History

Abstract

Software products are often released with missing functionality or errors that result in failures in the field. In previous work, we presented the Gamma technology, which facilitates remote monitoring of deployed software and allows for a prompt reaction to failures. In this paper, we investigate one of the principal technologies on which Gamma is based: software tomography. Software tomography splits monitoring tasks across many instances of the software, so that partial information can be (1) collected from users by means of light-weight instrumentation and (2) merged to gather the overall monitoring information. After describing the technology, we illustrate an instance of software tomography for a specific monitoring task. We also present two case studies that we performed to evaluate the presented technique on a real program. The results of the studies show that software tomography can be successfully applied to collect accurate monitoring information using only minimal instrumentation on each deployed program instance.

References

[1]

T. Apiwattanapong and M. J. Harrold. Selective path profiling. In Proceedings of the Workshop on Program Analysis for Software Tools and Engineering (PASTE'02), November 2002. (to appear).

Digital Library

[2]

Aristotle Research Group. Aristotle: Software engineering tools, 2002. http://www.cc.gatech.edu/aristotle/.

[3]

T. Ball and J. R. Larus. Efficient path profiling. In Proceedings of the 29th International Symposium on Microarchitecture, pages 46--57, Dec 1996.

Digital Library

[4]

Expectation-driven event monitoring (EDEM), 2002. http://www.ics.uci.edu/~dhilbert/edem/.

[5]

D. Gupta, P. Jalote, and G. Barua. A formal framework for on-line software version change. IEEE Transactions on Software Engineering, 22(2):120--131, Feb 1996.

Digital Library

[6]

M. Harrold and G. Rothermel. Aristotle: A system for research on and development of program analysis based tools. Technical Report Technical Report OSU-CISRC-3/97-TR17, The Ohio State University, Mar 1997.

[7]

M. J. Harrold, G. Rothermel, K. Sayre, R. Wu, and Y. L. An empirical evaluation of the correlation between fault-revealing test behavior and differences in program spectra. Journal of Software Testing, Verification, and Reliability, 10(3), Sep 2000.

[8]

M. Hicks, J. Moore, and S. Nettles. Dynamic software updating. In C. Norris and J. J. B. Fenwick, editors, Proceedings of the ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI'01), ACM SIGPLAN Notices, pages 13--23. ACMPress, Jun 2001.

Digital Library

[9]

D. M. Hilbert and D. F. Redmiles. Extracting usability information from user interface events. ACM Computing Surveys, 32(4):384--421, Dec 2000.

Digital Library

[10]

Microsoft Corporation. Microsoft .Net, 2002. http://www.microsoft.net/net/.

[11]

J. D. Musa, A. Iannino, and K. Okumoto. Software Reliability: Measurement, Prediction, Application. MacGraw-Hill (New York NY), 1987.

Digital Library

[12]

A. Orso, D. Liang, M. Harrold, and R. Lipton. Gamma system: Continuous evolution of software after deployment. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA'02), pages 65--69, Jul 2002.

Digital Library

[13]

A. Orso, A. Rao, and M. J. Harrold. A technique for dynamic updating of Java software. In Proceedings of the IEEE International Conference on Software Maintenance (ICSM 2002), Oct 2002. (to appear).

Digital Library

[14]

C. Pavlopoulou and M. Young. Residual test coverage monitoring. In Proceedings of the 21st International Conference on Software Engineering (ICSE'99), pages 277--284, May 1999.

Digital Library

[15]

Perpetual testing, 2002. http://www.ics.uci.edu/~djr/edcs/, http://laser.cs.umass.edu/perptest/, http://www.cs.uoregon.edu/research/perpetual/edcs/Perpetual-Testing.html.

[16]

T. Reps, T. Ball, M. Das, and J. Larus. The use of program profiling for software maintenance with applications to the Year 2000 problem. In Proceedings of the 6th European Software Engineering Conference (ESEC'97), pages 432--449, Sep 1997.

Digital Library

[17]

Sun Microsystems. Sun{tm} Open Net Environment (Sun ONE), 2002. http://wwws.sun.com/software/sunone/.

[18]

M. Tikir and J. Hollingsworth. Efficient instrumentation for code coverage testing. In Proceedings of the International Symposium on Software Testing and Analysis (ISSTA 2002), pages 86--96, Jul 2002.

Digital Library

Cited By

Cornejo OBriola DMicucci DGinelli DMariani LSantos Parrilla AJuristo N(2024)A family of experiments about how developers perceive delayed system response timeSoftware Quality Journal10.1007/s11219-024-09660-w32:2(567-605)Online publication date: 4-Mar-2024
https://doi.org/10.1007/s11219-024-09660-w
Cornejo OBriola DMicucci DMariani L(2020)CBR: Controlled Burst Recording2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)10.1109/ICST46399.2020.00033(243-253)Online publication date: Oct-2020
https://doi.org/10.1109/ICST46399.2020.00033
Cornejo OGinelli DBriola DMicucci DMariani L(2019)Field Monitoring With Delayed SavingIEEE Access10.1109/ACCESS.2019.29258557(85913-85924)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2925855
Show More Cited By

Index Terms

Monitoring deployed software using software tomography
1. Information systems
  1. Data management systems
    1. Middleware for databases
      1. Distributed transaction monitors
2. Software and its engineering
  1. Software creation and management
    1. Software verification and validation
      1. Process validation
        Traceability
      2. Software defect analysis
        Software testing and debugging
  2. Software organization and properties
    1. Contextual software domains
      1. Operating systems
        Process management
        Monitors

Recommendations

Monitoring deployed software using software tomography

Software products are often released with missing functionality or errors that result in failures in the field. In previous work, we presented the Gamma technology, which facilitates remote monitoring of deployed software and allows for a prompt ...
Software development: what it is, what it should be, and how to get there

Developing large software systems is notoriously difficult and unpredictable. Software projects are often canceled, finish late and over budget, or yield low quality results --- setting software engineering apart from established engineering ...
Development of a Software Engineering Ontology for Multisite Software Development

This paper aims to present an ontology model of software engineering to represent its knowledge. The fundamental knowledge relating to software engineering is well described in the textbook entitled Software Engineering by Sommerville that is now in its ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

PASTE '02: Proceedings of the 2002 ACM SIGPLAN-SIGSOFT workshop on Program analysis for software tools and engineering

November 2002

92 pages

ISBN:1581134797

DOI:10.1145/586094

Program Chairs:
Matthew B. Dwyer
Kansas State University, USA
,
Jens Palsberg
Purdue University, USA

ACM SIGSOFT Software Engineering Notes Volume 28, Issue 1
January 2003
83 pages
ISSN:0163-5948
DOI:10.1145/634636
Issue’s Table of Contents

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 November 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

PASTE02

Sponsor:

PASTE02: PASTE '02 - ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering ( co-located with SIGSOFT '02/ FSE-10 )

November 18 - 19, 2002

South Carolina, Charleston, USA

Acceptance Rates

PASTE '02 Paper Acceptance Rate 9 of 26 submissions, 35%;

Overall Acceptance Rate 57 of 159 submissions, 36%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

58
Total Citations
View Citations
890
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)2

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cornejo OBriola DMicucci DGinelli DMariani LSantos Parrilla AJuristo N(2024)A family of experiments about how developers perceive delayed system response timeSoftware Quality Journal10.1007/s11219-024-09660-w32:2(567-605)Online publication date: 4-Mar-2024
https://doi.org/10.1007/s11219-024-09660-w
Cornejo OBriola DMicucci DMariani L(2020)CBR: Controlled Burst Recording2020 IEEE 13th International Conference on Software Testing, Validation and Verification (ICST)10.1109/ICST46399.2020.00033(243-253)Online publication date: Oct-2020
https://doi.org/10.1109/ICST46399.2020.00033
Cornejo OGinelli DBriola DMicucci DMariani L(2019)Field Monitoring With Delayed SavingIEEE Access10.1109/ACCESS.2019.29258557(85913-85924)Online publication date: 2019
https://doi.org/10.1109/ACCESS.2019.2925855
Cornejo OBriola DMicucci DMariani L(2017)Fragmented MonitoringElectronic Proceedings in Theoretical Computer Science10.4204/EPTCS.254.5254(57-68)Online publication date: 23-Aug-2017
https://doi.org/10.4204/EPTCS.254.5
Cornejo OBriola DMicucci DMariani LCadar CTan L(2017)In the field monitoring of interactive applicationsProceedings of the 39th International Conference on Software Engineering: New Ideas and Emerging Results Track10.1109/ICSE-NIER.2017.19(55-58)Online publication date: 20-May-2017
https://dl.acm.org/doi/10.1109/ICSE-NIER.2017.19
Brunink MRosenblum D(2017)Using Branch Frequency Spectra to Evaluate Operational Coverage2017 24th Asia-Pacific Software Engineering Conference (APSEC)10.1109/APSEC.2017.21(150-159)Online publication date: Dec-2017
https://doi.org/10.1109/APSEC.2017.21
Ohmann PLiblit B(2017)Lightweight control-flow instrumentation and postmortem analysis in support of debuggingAutomated Software Engineering10.1007/s10515-016-0190-124:4(865-904)Online publication date: 1-Dec-2017
https://dl.acm.org/doi/10.1007/s10515-016-0190-1
Ohmann PBrown DNeelakandan NLinderoth JLiblit BLo DApel SKhurshid S(2016)Optimizing customized program coverageProceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering10.1145/2970276.2970351(27-38)Online publication date: 25-Aug-2016
https://dl.acm.org/doi/10.1145/2970276.2970351
Brünink MRosenblum DZimmermann TCleland-Huang JSu Z(2016)Mining performance specificationsProceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering10.1145/2950290.2950314(39-49)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1145/2950290.2950314
Afraz MSaha DKanade ADi Nitto EHarman MHeymans P(2015)P3: partitioned path profilingProceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering10.1145/2786805.2786868(485-495)Online publication date: 30-Aug-2015
https://dl.acm.org/doi/10.1145/2786805.2786868
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents