research-article

In the field monitoring of interactive applications

Authors:

Daniela Briola,

Daniela Micucci,

Leonardo MarianiAuthors Info & Claims

ICSE-NIER '17: Proceedings of the 39th International Conference on Software Engineering: New Ideas and Emerging Results Track

Pages 55 - 58

https://doi.org/10.1109/ICSE-NIER.2017.19

Published: 20 May 2017 Publication History

Abstract

Monitoring techniques can extract accurate data about the behavior of software systems. When used in the field, they can reveal how applications behave in real-world contexts and how programs are actually exercised by their users. Nevertheless, since monitoring might need significant storage and computational resources, it may interfere with users activities degrading the quality of the user experience.

While the impact of monitoring has been typically studied by measuring the overhead that it may introduce in a monitored application, there is little knowledge about how monitoring solutions may actually impact on the user experience and to what extent users may recognize their presence.

In this paper, we present our investigation on how collecting data in the field may impact the quality of the user experience. Our initial results show that non-trivial overhead can be tolerated by users, depending on the kind of activity that is performed. This opens interesting opportunities for research in monitoring solutions, which could be designed to opportunistically collect data considering the kind of activities performed by the users.

References

[1]

Eclipse Community, "Eclipse," http://www.eclipse.org, visited in 2017.

[2]

Microsoft, "Windows 10," http://www.microsoft.com, visited in 2017.

[3]

N. Delgado, A. Q. Gates, and S. Roach, "A taxonomy and catalog of runtime software-fault monitoring tools," IEEE Transactions on Software Engineering (TSE), vol. 30, no. 12, pp. 859--872, 2004.

Digital Library

[4]

G. Jin, A. Thakur, B. Liblit, and S. Lu, "Instrumentation and sampling strategies for cooperative concurrency bug isolation," ACM Sigplan Notices, vol. 45, no. 10, pp. 241--255, 2010.

Digital Library

[5]

B. Liblit, A. Aiken, A. X. Zheng, and M. I. Jordan, "Bug isolation via remote program sampling," ACM Sigplan Notices, vol. 38, no. 5, pp. 141--154, 2003.

Digital Library

[6]

S. Elbaum and M. Diep, "Profiling deployed software: Assessing strategies and testing opportunities," IEEE Transactions on Software Engineering (TSE), vol. 31, no. 4, pp. 312--327, 2005.

Digital Library

[7]

P. Ohmann, D. B. Brown, N. Neelakandan, J. Linderoth, and B. Liblit, "Optimizing customized program coverage," in Proceedings of the International Conference on Automated Software Engineering (ASE), 2016.

Digital Library

[8]

C. Pavlopoulou and M. Young, "Residual test coverage monitoring," in Proceedings of the International Conference on Software Engineering (ICSE), 1999.

Digital Library

[9]

W. Jin and A. Orso, "BugRedux: reproducing field failures for in-house debugging," in Proceedings of the International Conference on Software Engineering (ICSE), 2012.

Digital Library

[10]

J. Clause and A. Orso, "A technique for enabling and supporting debugging of field failures," in Proceedings of the International Conference on Software Engineering (ICSE), 2007.

Digital Library

[11]

A. Orso, D. Liang, M. J. Harrold, and R. Lipton, "Gamma system: continuous evolution of software after deployment," in Proceedings of the International Symposium on Software Testing and Analysis (ISSTA), 2002.

Digital Library

[12]

A. Orso, "Monitoring, analysis, and testing of deployed software," in Proceedings of the FSE/SDP Workshop on Future of Software Engineering Research (FoSER), 2010.

Digital Library

[13]

J. Bowring, A. Orso, and M. J. Harrold, "Monitoring deployed software using software tomography," in Proceedings of the Workshop on Program Analysis for Software Tools and Engineering (PASTE), 2002.

Digital Library

[14]

S. C. Seow, Designing and engineering time: the psychology of time perception in software. Addison-Wesley Professional, 2008.

Digital Library

[15]

P. R. Killeen and N. A. Weiss, "Optimal timing and the Weber function." Psychological Review, vol. 94, no. 4, pp. 455--468, 1987.

Cited By

Cornejo OBriola DMicucci DGinelli DMariani LSantos Parrilla AJuristo N(2024)A family of experiments about how developers perceive delayed system response timeSoftware Quality Journal10.1007/s11219-024-09660-w32:2(567-605)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1007/s11219-024-09660-w
Cornejo OUchitel SOrso ARobillard M(2017)Flexible in-the-field monitoringProceedings of the 39th International Conference on Software Engineering Companion10.1109/ICSE-C.2017.37(479-480)Online publication date: 20-May-2017
https://dl.acm.org/doi/10.1109/ICSE-C.2017.37

Recommendations

The experience of interactive storytelling: comparing “fahrenheit” with “façade”
ICEC'11: Proceedings of the 10th international conference on Entertainment Computing

At the intersection of multimedia, artificial intelligence, and gaming technology, new visions of future entertainment media arise that approximate the “Holodeck” ® idea of interactive storytelling. We report exploratory experiments on the user ...
Flexible in-the-field monitoring
ICSE-C '17: Proceedings of the 39th International Conference on Software Engineering Companion

Fully assessing the robustness of a software application in-house is infeasible, especially considering the huge variety of hardly predictable stimuli, environments, and configurations that applications must handle in the field. For this reason, modern ...
Measuring user responses to interactive stories: towards a standardized assessment tool
ICIDS'10: Proceedings of the Third joint conference on Interactive digital storytelling

With the increasing number of prototypes and market applications of interactive storytelling, the understanding and optimization of how end users respond to computer-mediated interactive narratives is of growing importance. Based on a conceptual model ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICSE-NIER '17: Proceedings of the 39th International Conference on Software Engineering: New Ideas and Emerging Results Track

May 2017

75 pages

ISBN:9781538626757

Program Chairs:
Cristian Cadar
Imperial College London
,
Lin Tan
University of Waterloo

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering
IEEE-CS: Computer Society
SADIO: SADIO

Publisher

IEEE Press

Publication History

Published: 20 May 2017

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE '17

Sponsor:

SIGSOFT
IEEE-CS
SADIO

ICSE '17: 39th International Conference on Software Engineering

May 20 - 28, 2017

Buenos Aires, Argentina

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
71
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 27 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cornejo OBriola DMicucci DGinelli DMariani LSantos Parrilla AJuristo N(2024)A family of experiments about how developers perceive delayed system response timeSoftware Quality Journal10.1007/s11219-024-09660-w32:2(567-605)Online publication date: 1-Jun-2024
https://dl.acm.org/doi/10.1007/s11219-024-09660-w
Cornejo OUchitel SOrso ARobillard M(2017)Flexible in-the-field monitoringProceedings of the 39th International Conference on Software Engineering Companion10.1109/ICSE-C.2017.37(479-480)Online publication date: 20-May-2017
https://dl.acm.org/doi/10.1109/ICSE-C.2017.37

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents