Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Design Recommendations for Self-Monitoring in the Workplace: Studies in Software Development

Published: 06 December 2017 Publication History

Abstract

One way to improve the productivity of knowledge workers is to increase their self-awareness about productivity at work through self-monitoring. Yet, little is known about expectations of, the experience with, and the impact of self-monitoring in the workplace. To address this gap, we studied software developers, as one community of knowledge workers. We used an iterative, user-feedback-driven development approach (N=20) and a survey (N=413) to infer design elements for workplace self-monitoring, which we then implemented as a technology probe called WorkAnalytics. We field-tested these design elements during a three-week study with software development professionals (N=43). Based on the results of the field study, we present design recommendations for self-monitoring in the workplace, such as using experience sampling to increase the awareness about work and to create richer insights, the need for a large variety of different metrics to retrospect about work, and that actionable insights, enriched with benchmarking data from co-workers, are likely needed to foster productive behavior change and improve collaboration at work. Our work can serve as a starting point for researchers and practitioners to build self-monitoring tools for the workplace.

References

[1]
Elena Agapie, Daniel Avrahami, and Jennifer Marlow. 2016. Staying the Course: System-Driven Lapse Management for Supporting Behavior Change. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems.
[2]
Jessica S. Ancker and David Kaufman. 2007. Rethinking health numeracy: A multidisciplinary literature review. Journal of the American Medical Informatics Association 14, 6 (2007), 713--721.
[3]
John Anvik, Lyndon Hiew, and Gail C. Murphy. 2006. Who Should Fix This Bug?. In Proceedings of the 28th International Conference on Software Engineering (ICSE '06). ACM, 361--370.
[4]
Microsoft Graph API. 2017. https://graph.microsoft.io. (2017). Retrieved July 9, 2017.
[5]
Maryi Arciniegas-Mendez, Alexey Zagalsky, Margaret-Anne Storey, and Allyson Fiona Hadwin. 2017. Using the Model of Regulation to Understand Software Development Collaboration Practices and Tool Support. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, 1049--1065.
[6]
Alberto Bacchelli and Christian Bird. 2013. Expectations, Outcomes, and Challenges of Modern Code Review. In Proceedings of the 2013 International Conference on Software Engineering. 712--721.
[7]
Lyn Bartram. 2015. Design Challenges and Opportunities for Eco-Feedback in the Home. IEEE Computer Graphics and Applications 35, 4 (2015).
[8]
James B. Begole, John C. Tang, Randall B. Smith, and Nicole Yankelovich. 2002. Work Rhythms: Analyzing Visualizations of Awareness Histories of Distributed Groups. 230 (2002).
[9]
M. Beller, I. Levaja, A. Panichella, G. Gousios, and A. Zaidman. 2016. How to Catch 'Em All: WatchDog, a Family of IDE Plug-Ins to Assess Testing. In 2016 IEEE/ACM 3rd International Workshop on Software Engineering Research and Industrial Practice (SER IP). 53--56.
[10]
Frank Bentley, Konrad Tollmar, Peter Stephenson, and Levy Laura. 2013. Health Mashups: Presenting Statistical Patterns between Wellbeing Data and Context in Natural Language to Promote Behavior Change. 20, 5 (2013), 1--27.
[11]
Ann Brown. 1992. Design Experiments: Theoretical and Methodological Challenges in Creating Complex Interventions in Classroom Settings. Journal of the Learning Sciences 2, 2 (1992), 141--178.
[12]
Chloë Brown, Christos Efstratiou, Ilias Leontiadis, Daniele Quercia, and Cecilia Mascolo. 2013. Tracking Serendipitous Interactions: How Individual Cultures Shape the Office. CoRR (2013).
[13]
Rafael A. Calvo and Dorian Peters. 2014. Self-Awareness and Self-Compassion. MIT Press, 304.
[14]
Eun Kyoung Choe, Nicole B. Lee, Bongshin Lee, Wanda Pratt, and Julie a. Kientz. 2014. Understanding quantifiedselfers' practices in collecting and exploring personal data. Proceedings of the 32nd annual ACM conference on Human factors in computing systems (CHI '14) (2014), 1143--1152.
[15]
Jan Chong and Rosanne Siino. 2006. Interruptions on software teams: a comparison of paired and solo programmers. In Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work. ACM, 29--38.
[16]
Codealike. 2017. http://codealike.com. (2017). Retrieved July 9, 2017.
[17]
Emily I. M. Collins, Anna L. Cox, Jon Bird, and Daniel Harrison. 2014. Social Networking Use and RescueTime: The Issue of Engagement. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (UbiComp '14 Adjunct). ACM, 687--690.
[18]
Sunny Consolvo, Predrag Klasnja, David W. McDonald, Daniel Avrahami, Jon Froehlich, Louis LeGrand, Ryan Libby, Keith Mosher, and James A. Landay. 2008. Flowers or a Robot Army?: Encouraging Awareness & Activity with Personal, Mobile Displays. In Proceedings of the 10th International Conference on Ubiquitous Computing (UbiComp '08). ACM, 54--63.
[19]
Sunny Consolvo, David W. McDonald, Tammy Toscos, Mike Y Chen, Jon Froehlich, Beverly Harrison, Predrag Klasnja, Anthony LaMarca, Louis LeGrand, Ryan Libby, Ian Smith, and James A. Landay. 2008. Activity sensing in the wild: a field trial of ubifit garden. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, 1797--1806.
[20]
Kate Crawford, Jessa Lingel, and Tero Karppi. 2015. Our metrics, ourselves: A hundred years of self-tracking from the weight scale to the wrist wearable device. European Journal of Cultural Studies 18 (2015), 479--496.
[21]
Mary Czerwinski, Eric Horvitz, and Susan Wilhite. 2004. A diary study of task switching and interruptions. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 175--182.
[22]
Tom DeMarco and Tim Lister. 1985. Programmer performance and the effects of the workplace. In Proceedings of the 8th international conference on Software engineering. IEEE Computer Society Press, 268--272.
[23]
Daniel A Epstein, Daniel Avrahami, and Jacob T Biehl. 2016. Taking 5: Work-Breaks, Productivity, and Opportunities for Personal Informatics for Knowledge Workers. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems.
[24]
Fitbit. 2017. http://fitbit.com. (2017). Retrieved July 9, 2017.
[25]
B. J. Fogg. 2003. Persuasive Technology: Using Computers to Change What We Think and Do. Elsevier Science.
[26]
Thomas Fritz, Elaine M. Huang, Gail C. Murphy, and Thomas Zimmermann. 2014. Persuasive Technology in the Real World: A Study of Long-term Use of Activity Sensing Devices for Fitness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, 487--496.
[27]
Mirta Galesic and Rocio Garcia-Retamero. 2011. Graph literacy a cross-cultural comparison. Medical Decision Making 31, 3 (2011), 444--457.
[28]
Roland Gasser, Dominique Brodbeck, Markus Degen, Jürg Luthiger, Remo Wyss, and Serge Reichlin. 2006. Persuasiveness of a mobile lifestyle coaching application using social facilitation. In International Conference on Persuasive Technology. Springer, 27--38.
[29]
Márcio Kuroki Gonçalves, Leidson de Souza, and Víctor M. González. 2011. Collaboration, Information Seeking and Communication: An Observational Study of Software Developers' Work Practices. Journal of Universal Computer Science 17, 14 (2011), 1913--1930.
[30]
Victor M. González and Gloria Mark. 2004. Constant, Constant, Multi-tasking Craziness: Managing Multiple Working Spheres. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '04). ACM, 113--120.
[31]
G. Hofstede. 1994. Cultures and Organizations: Software of the Mind : Intercultural Cooperation and Its Importance for Survival. HarperCollins.
[32]
Victoria Hollis, Artie Konrad, and Steve Whittaker. 2015. Change of Heart: Emotion Tracking to Promote Behavior Change. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15) (2015), 2643--2652.
[33]
Dandan Huang, Melanie Tory, and Lyn Bartram. 2016. A Field Study of On-Calendar Visualizations. In Proceedings of Graphics Interface 2016. 13--20.
[34]
Hubstaff. 2017. http://hubstaff.com. (2017). Retrieved July 9, 2017.
[35]
Watts S Humphrey. 2000. The Personal Software Process SM (PSP SM). November (2000).
[36]
Mikkel R Jakobsen, Roland Fernandez, Mary Czerwinski, Kori Inkpen, Olga Kulyk, and George G. Robertson. 2009. WIPDash: Work Item and People Dashboard for Software Development Teams. In Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II. Springer-Verlag, 791--804.
[37]
Simon L. Jones and Ryan Kelly. 2017. DealingWith Information Overload in Multifaceted Personal Informatics Systems. Human Computer Interaction (2017), 1--48.
[38]
Matthew Kay, Eun Kyoung Choe, Jesse Shepherd, Benjamin Greenstein, Nathaniel Watson, Sunny Consolvo, and Julie A. Kientz. 2012. Lullaby: A Capture and Access System for Understanding the Sleep Environment. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). ACM, 226--234.
[39]
Allan Kelly. 2008. Changing Software Development: Learning to Become Agile. Wiley.
[40]
Young-Ho Kim, Jae Ho Jeon, Eun Kyoung Choe, Bongshin Lee, Kwonhyun Kim, and Jinwook Seo. 2016. TimeAware: Leveraging Framing Effects to Enhance Personal Productivity. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). 272--283.
[41]
Predrag Klasnja, Sunny Consolvo, and Wanda Pratt. 2011. How to Evaluate Technologies for Health Behavior Change in HCI Research. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 3063--3072.
[42]
Saskia Koldijk, Mark Van Staalduinen, Stephan Raaijmakers, and Wessel Kraaij. 2011. Activity-Logging for Self- Coaching of Knowledge Workers. 0--3.
[43]
Ian Li, Anind Dey, and Jodi Forlizzi. 2010. A stage-based model of personal informatics systems. Proceedings of the 28th international conference on Human factors in computing systems (CHI '10) (2010), 557.
[44]
Ian Li, Anind Dey, and Jodi Forlizzi. 2011. Understanding my data, myself: supporting self-reflection with Ubicomp technologies. In Proceedings of the 13th international conference on Ubiquitous computing (UbiComp '11). 405.
[45]
Paul Luo Li, Andrew J. Ko, and Jiamin Zhu. 2015. What Makes a Great Software Engineer?. In Proceedings of the 37th International Conference on Software Engineering - Volume 1 (ICSE '15). IEEE Press, 700--710.
[46]
James Lin, Lena Mamykina, Silvia Lindtner, Gregory Delajoux, and Henry Strub. 2006. Fish-n-Steps: Encouraging Physical Activity with an Interactive Computer Game. In UbiComp 2006: Ubiquitous Computing. Lecture Notes in Computer Science, Vol. 4206. Chapter 16, 261--278.
[47]
Lena Mamykina, Elizabeth Mynatt, Patricia Davidson, and Daniel Greenblatt. 2008. MAHI: Investigation of Social Scaffolding for Reflective Thinking in Diabetes Management. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). ACM, 477--486.
[48]
Manictime. 2017. http://manictime.com. (2017). Retrieved July 9, 2017.
[49]
Gloria Mark, Shamsi T. Iqbal, Mary Czerwinski, Paul Johns, and Akane Sano. 2016. Email Duration, Batching and Self-interruption: Patterns of Email Use on Productivity and Stress. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16), Vol. 21. 98--109.
[50]
Gloria Mark, Shamsi T. Iqbal, Mary Czerwinski, Paul Johns, and Akane Sano. 2016. Neurotics Can't Focus: An in situ Study of Online Multitasking in the Workplace. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1739--1744.
[51]
Akhil Mathur, Marc Van Den Broeck, Geert Vanderhulst, Afra Mashhadi, and Fahim Kawsar. 2015. Tiny Habits in the Giant Enterprise: Understanding the Dynamics of a Quantified Workplace. In Proceedings of the Joint International Conference on Pervasive and Ubiquitous Computing and the International Symposium on Wearable Computers (Ubicomp/ISWC'15). 577--588.
[52]
Daniel McDuff, Amy Karlson, and Ashish Kapoor. 2012. AffectAura: an Intelligent System for Emotional Memory. ACM.
[53]
André N. Meyer, Laura E Barton, Gail C Murphy, Thomas Zimmermann, and Thomas Fritz. 2017. The Work Life of Developers: Activities, Switches and Perceived Productivity. Transactions of Software Engineering (2017), 1--15.
[54]
André N. Meyer, Thomas Fritz, Gail C. Murphy, and Thomas Zimmermann. 2014. Software Developers' Perceptions of Productivity. In Proceedings of the 22Nd ACM SIGSOFT International Symposium on Foundations of Software Engineering (FSE 2014). ACM, 19--29.
[55]
Rosemery O. Nelson and Steven C. Hayes. 1981. Theoretical explanations for reactivity in self-monitoring. Behavior Modification 5, 1 (1981), 3--14.
[56]
James O. Prochaska and Wayne F. Velicer. 1997. The Transtheoretical Change Model of Health Behavior. American Journal of Health Promotion 12, 1 (1997), 38--48.
[57]
RescueTime. 2017. http://rescuetime.com. (2017). Retrieved July 9, 2017.
[58]
John Rooksby, Parvin Asadzadeh, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2016. Personal Tracking of Screen Time on Digital Devices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 284--296.
[59]
John Rooksby, Mattias Rost, Alistair Morrison, and Matthew Chalmers. 2014. Personal Tracking as Lived Informatics. (2014).
[60]
Slife. 2017. http://www.slifelabs.com. (2017). Retrieved July 9, 2017.
[61]
Margaret-Anne Storey, Leif Singer, Brendan Cleary, Fernando Figueira Filho, and Alexey Zagalsky. 2014. The Evolution of Social Media in Software Engineering. In FOSE 2014 Proceedings of the on Future of Software Engineering. 100--116.
[62]
Margaret Anne Storey, Alexey Zagalsky, Fernando Figueira Filho, Leif Singer, and Daniel M. German. 2017. How Social and Communication Channels Shape and Challenge a Participatory Culture in Software Development. IEEE Transactions on Software Engineering 43, 2 (2017), 185--204.
[63]
Anselm Strauss and Juliet Corbin. 1998. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory.
[64]
Link to Supplementary Material. 2017. (2017).
[65]
Tammy Toscos, Anne Faber, Shunying An, and Mona P Gandhi. 2006. Chick Clique : Persuasive Technology to Motivate Teenage Girls to Exercise. In CHI '06: CHI '06 extended abstracts on Human factors in computing systems. 1873--1878.
[66]
Christoph Treude, Fernando Figueira Filho, and Uirá Kulesza. 2015. Summarizing and Measuring Development Activity. In Proceedings of the 2015 10th Joint Meeting on Foundations of Software Engineering. 625--636.
[67]
Christoph Treude and Margaret-Anne Storey. 2010. Awareness 2.0: Staying Aware of Projects, Developers and Tasks using Dashboards and Feeds. In 2010 ACM/IEEE 32nd International Conference on Software Engineering. 365--374.
[68]
Bogdan Vasilescu, Kelly Blincoe, Qi Xuan, Casey Casalnuovo, Daniela Damian, Premkumar Devanbu, and Vladimir Filkov. 2016. The Sky is Not the Limit: Multitasking on GitHub Projects. 994--1005.
[69]
Wakatime. 2017. http://wakatime.com. (2017). Retrieved July 9, 2017.
[70]
Steve Whittaker, Victoria Hollis, and Andrew Guydish. 2016. Don't Waste My Time: Use of Time Information Improves Focus. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16).
[71]
Joanne V. Wood. 1989. Theory and research concerning social comparisons of personal attributes. Psychological Bulletin 106, 2 (1989), 231--248.
[72]
Manuela Züger, Christopher Corley, André N. Meyer, Boyang Li, Thomas Fritz, David Shepherd, Vinay Augustine, Patrick Francis, Nicholas Kraft, and Will Snipes. 2017. Reducing Interruptions at Work: A Large-Scale Field Study of FlowLight. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). 61--72.

Cited By

View all
  • (2024)A Systematic Literature Review on the Influence of Enhanced Developer Experience on Developers' Productivity: Factors, Practices, and RecommendationsACM Computing Surveys10.1145/368729957:1(1-46)Online publication date: 7-Oct-2024
  • (2024)Trinity: A Design Fiction to Unravel the Present and Future Tensions in Professional Informatics and Awareness Support ToolsProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663396(1-15)Online publication date: 25-Jun-2024
  • (2024)Supporting Developers' Emotional Awareness: from Self-reported Emotions to BiometricsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661209(500-504)Online publication date: 18-Jun-2024
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Human-Computer Interaction
Proceedings of the ACM on Human-Computer Interaction  Volume 1, Issue CSCW
November 2017
2095 pages
EISSN:2573-0142
DOI:10.1145/3171581
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2017
Published in PACMHCI Volume 1, Issue CSCW

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. personal analytics
  2. productivity tracking
  3. quantified workplace
  4. self-monitoring
  5. workplace awareness

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)137
  • Downloads (Last 6 weeks)21
Reflects downloads up to 12 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)A Systematic Literature Review on the Influence of Enhanced Developer Experience on Developers' Productivity: Factors, Practices, and RecommendationsACM Computing Surveys10.1145/368729957:1(1-46)Online publication date: 7-Oct-2024
  • (2024)Trinity: A Design Fiction to Unravel the Present and Future Tensions in Professional Informatics and Awareness Support ToolsProceedings of the 3rd Annual Meeting of the Symposium on Human-Computer Interaction for Work10.1145/3663384.3663396(1-15)Online publication date: 25-Jun-2024
  • (2024)Supporting Developers' Emotional Awareness: from Self-reported Emotions to BiometricsProceedings of the 28th International Conference on Evaluation and Assessment in Software Engineering10.1145/3661167.3661209(500-504)Online publication date: 18-Jun-2024
  • (2024)Examining Algorithmic Metrics and their Effects through the Lens of ReactivityProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660676(3179-3192)Online publication date: 1-Jul-2024
  • (2024)Using Speculative Design to Understand Preferred Futures for the Design and Use of Tracking Data in U.S. College Sport TeamsProceedings of the ACM on Human-Computer Interaction10.1145/36410288:CSCW1(1-35)Online publication date: 26-Apr-2024
  • (2024)Migrant Farmworkers' Experiences of Agricultural Technologies: Implications for Worker Sociality and Desired ChangeProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642263(1-23)Online publication date: 11-May-2024
  • (2024)A family of experiments about how developers perceive delayed system response timeSoftware Quality Journal10.1007/s11219-024-09660-w32:2(567-605)Online publication date: 4-Mar-2024
  • (2023)A Meta-Synthesis of the Barriers and Facilitators for Personal Informatics SystemsProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36108937:3(1-35)Online publication date: 27-Sep-2023
  • (2023)Cultivating a Team Mindset about Productivity with a Nudge: A Field Study in Hybrid Development TeamsProceedings of the ACM on Human-Computer Interaction10.1145/36101847:CSCW2(1-21)Online publication date: 4-Oct-2023
  • (2023)Powerful Futures: How a Big Tech Company Envisions Humans and Technologies in the Workplace of the FutureProceedings of the ACM on Human-Computer Interaction10.1145/36101037:CSCW2(1-35)Online publication date: 4-Oct-2023
  • Show More Cited By

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media