research-article

Open access

Combining Momentary and Retrospective Self-Reflection in a Mobile Photo-Based Journaling Application

Authors:

Pelin Karaturhan,

Asim Evren Yantac,

Kemal KuscuAuthors Info & Claims

NordiCHI '22: Nordic Human-Computer Interaction Conference

Article No.: 64, Pages 1 - 12

https://doi.org/10.1145/3546155.3546676

Published: 08 October 2022 Publication History

All formats PDF

Abstract

The concept of self-reflection is investigated in a wide range of fields, from Psychology to HCI. Different fields use different methods to trigger reflection, such as visualizing accumulated personal quantitative data, personal photos, journaling, or asking reflective questions about experiences. This study combines photo-based journaling, reflective questions and data visualization for triggering momentary and retrospective self-reflection. We prototyped a photo-based journaling app and conducted a 5-week field study (N=13) to observe in-the-wild experiences. Following, we conducted an evaluation workshop (N=9) to explore strategies for motivating reflective question answering and retrospective self-reflection. Our approach encourages momentary and retrospective self-reflection, but the question-answering process could be burdensome and retrospective self-reflection should be incentivized. For that, we compiled design strategies for both kinds of self-reflection. We contribute to the HCI literature with strategies for unifying momentary and retrospective self-reflection in photo-based journaling.

References

[1]

Likert, R. 1932. A technique for the measurement of attitudes. Archives of Psychology. (1932), 22 140, 55.

[2]

Alexandra, Y. 2015. The Role of Accidental Self-Reflection in Wearable Camera Research. Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. https://doi.org/10.1145/2786567

Digital Library

[3]

Avrahami, D. 2020. Celebrating Everyday Success: Improving Engagement and Motivation using a System for Recording Daily Highlights. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376369

Digital Library

[4]

Ayobi, A. 2018. Flexible and mindful self-tracking: Design implications from paper bullet journals. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). Association for Computing Machinery, New York, NY, USA, Paper 28, 1–14. https://doi.org/10.1145/3173574.3173602

Digital Library

[5]

Barton, S. 1994. Chaos, Self-Organization, and Psychology. American Psychologist. 49, 1 (1994), 5–14. https://doi.org/10.1037/0003-066X.49.1.5

[6]

Baumer, E.P.S. 2014. Reviewing Reflection: On the Use of Reflection in Interactive System Design. In Proceedings of the 2014 conference on Designing interactive systems (DIS '14). Association for Computing Machinery, New York, NY, USA, 93–102. https://doi.org/10.1145/2598510.2598598

Digital Library

[7]

Bentvelzen, M. 2021. The technology-mediated reflection model: Barriers and assistance in data-driven reflection. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 246, 1–12. https://doi.org/10.1145/3411764.3445505

Digital Library

[8]

Braun, V. and Clarke, V. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology. 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oa

[9]

Brooke, J. 2020. SUS: A “Quick and Dirty” Usability Scale. Usability Evaluation In Industry. July (2020), 207–212. https://doi.org/10.1201/9781498710411-35

[10]

Carter, S. and Mankoff, J. 2005. When participants do the capturing: the role of media in diary studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '05). Association for Computing Machinery, New York, NY, USA, 899–908. https://doi.org/10.1145/1054972.1055098

Digital Library

[11]

Choe, E.K. 2017. Understanding self-reflection: How people reflect on personal data through visual data exploration. In Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth '17). Association for Computing Machinery, New York, NY, USA, 173–182. https://doi.org/10.1145/3154862.3154881

Digital Library

[12]

Clarke, M. 2004. Reflection: Journals and Reflective Questions: a Strategy for Professional Learning. Australian Journal of Teacher Education. 29, 2 (2004). https://doi.org/10.14221/ajte.2004v29n2.2

[13]

Consolvo, S. 2008. Flowers or a robot army? encouraging awareness & activity with personal, mobile displays. In Proceedings of the 10th international conference on Ubiquitous computing (UbiComp '08). Association for Computing Machinery, New York, NY, USA, 54–63. https://doi.org/10.1145/1409635.1409644

Digital Library

[14]

Devakumar, A. 2021. A review on strategies for data collection, reflection, and communication in eating disorder apps. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 547, 1–19. https://doi.org/10.1145/3411764.3445670

Digital Library

[15]

Dunlap, J.C. 2006. Using guided reflective journaling activities to capture students’ changing perceptions. TechTrends. 50, 6 (2006), 20–26. https://doi.org/10.1007/s11528-006-7614-x

[16]

Elsden, C. 2016. It's just my history, isn't it?: Understanding smart journaling practices. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 2819–2831. https://doi.org/10.1145/2858036.2858103

Digital Library

[17]

Epstein, D. 2014. Taming Data Complexity in Lifelogs: Exploring Visual Cuts of Personal Informatics Data. In Proceedings of the 2014 conference on Designing interactive systems (DIS '14). Association for Computing Machinery, New York, NY, USA, 667–676. https://doi.org/10.1145/2598510.2598558

Digital Library

[18]

Fan, C. 2012. A spark of activity: Exploring informative art as visualization for physical activity. In Proceedings of the 2012 ACM Conference on Ubiquitous Computing (UbiComp '12). Association for Computing Machinery, New York, NY, USA, 81–84. https://doi.org/10.1145/2370216.2370229

Digital Library

[19]

Farnham, S.D. and Churchill, E.F. 2011. Faceted identity, faceted lives: Social and technical issues with being yourself online. In Proceedings of the ACM 2011 conference on Computer supported cooperative work (CSCW '11). Association for Computing Machinery, New York, NY, USA, 359–368. https://doi.org/10.1145/1958824.1958880

Digital Library

[20]

Fleck, R. and Fitzpatrick, G. 2010. Reflecting on reflection: framing a design landscape. In Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction (OZCHI '10). Association for Computing Machinery, New York, NY, USA, 216–223. https://doi.org/10.1145/1952222.1952269

Digital Library

[21]

Froehlich, J. 2012. The design and evaluation of prototype eco-feedback displays for fixture-level water usage data. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). Association for Computing Machinery, New York, NY, USA, 2367–2376. https://doi.org/10.1145/2207676.2208397

Digital Library

[22]

Ghosh, S. 2020. Towards improving emotion self-report collection using self-reflection. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (CHI EA '20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3383019

Digital Library

[23]

Gortner, E.M. 2006. Benefits of Expressive Writing in Lowering Rumination and Depressive Symptoms. Behavior Therapy. 37, 3 (2006), 292–303. https://doi.org/10.1016/j.beth.2006.01.004

[24]

Guilford, J.P. 1967. Creativity: Yesterday, Today and Tomorrow. The Journal of Creative Behavior. 1, 1 (Jan. 1967), 3–14. https://doi.org/10.1002/j.2162-6057.1967.tb00002.x

[25]

van House, N.A. 2011. Personal photography, digital technologies and the uses of the visual. Visual Studies. 26, 2 (2011), 125–134. https://doi.org/10.1080/1472586X.2011.571888

[26]

Isaacs, E. 2013. Echoes from the past: How technology mediated reflection improves well-being. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 1071–1080. https://doi.org/10.1145/2470654.2466137 .

Digital Library

[27]

Jung, H. 2020. In Search of Forms for Evocative and Generative Reflection: Exploratory Studies and a Design Proposal. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376231

Digital Library

[28]

Karaturhan, P. 2021. Layer zero: An approach for deepening self-reflection on instagram shares. In: Meiselwitz, G. (eds) Social Computing and Social Media: Applications in Marketing, Learning, and Health. HCII 2021. Lecture Notes in Computer Science(), vol 12775. Springer, Cham. https://doi.org/10.1007/978-3-030-77685-5_27

Digital Library

[29]

Kim, Y.H. 2016. TimeAware: Leveraging framing effects to enhance personal productivity. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). Association for Computing Machinery, New York, NY, USA, 272–283. https://doi.org/10.1145/2858036.2858428

Digital Library

[30]

Lange, A. 1996. Using writing assignments with families managing legacies of extreme traumas. Journal of Family Therapy. 18, 4 (1996), 375–388. https://doi.org/10.1111/j.1467-6427.1996.tb00058.x

[31]

Li, I. 2010. A stage-based model of personal informatics systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 557–566. https://doi.org/10.1145/1753326.1753409

Digital Library

[32]

Limueco, J.M. and Prudente, M.S. 2020. Improving Students’ Reflections in Physics Class Using Video-based Journals. In Proceedings of the 2020 11th International Conference on E-Education, E-Business, E-Management, and E-Learning (IC4E 2020). Association for Computing Machinery, New York, NY, USA, 218–222. https://doi.org/10.1145/3377571.3377591

Digital Library

[33]

Lindley, S. 2008. Collocated social practices surrounding photos. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). Association for Computing Machinery, New York, NY, USA, 3921–3924. https://doi.org/10.1145/1358628.1358957

Digital Library

[34]

Lu, X. 2021. How Cultural Norms Influence Persuasive Design: A Study on Chinese Food Journaling Apps. In Designing Interactive Systems Conference 2021 (DIS '21). Association for Computing Machinery, New York, NY, USA, 619–637. https://doi.org/10.1145/3461778.3462142 .

Digital Library

[35]

M. Silva, L. and A. Epstein, D. 2021. Investigating Preferred Food Description Practices in Digital Food Journaling. In Designing Interactive Systems Conference 2021 (DIS '21). Association for Computing Machinery, New York, NY, USA, 589–605. https://doi.org/10.1145/3461778.3462145

Digital Library

[36]

Mair, C. 2012. Using technology for enhancing reflective writing, metacognition and learning. Journal of Further and Higher Education. 36, 2 (2012), 147–167. https://doi.org/10.1080/0309877X.2011.590583

[37]

McGookin, D. 2019. Reveal: Investigating proactive location-based reminiscing with personal digital photo repositories. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). Association for Computing Machinery, New York, NY, USA, Paper 435, 1–14. https://doi.org/10.1145/3290605.3300665

Digital Library

[38]

Meston, C.M. 2013. Effects of expressive writing on sexual dysfunction, depression, and PTSD in women with a history of childhood sexual abuse: Results from a randomized clinical trial. Journal of Sexual Medicine. 10, 9 (2013), 2177–2189. https://doi.org/10.1111/jsm.12247

[39]

Mitchell, E.G. 2021. From reflection to action: Combining machine learning with expert knowledge for nutrition goal recommendations. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI '21). Association for Computing Machinery, New York, NY, USA, Article 206, 1–17. https://doi.org/10.1145/3411764.3445555

Digital Library

[40]

Mols, I. 2017. Balance, Cogito and Dott: Exploring Media Modalities for Everyday-life Reflection. In Proceedings of the Eleventh International Conference on Tangible, Embedded, and Embodied Interaction (TEI '17). Association for Computing Machinery, New York, NY, USA, 427–433. https://doi.org/10.1145/3024969.3025069

Digital Library

[41]

Mols, I. 2016. Informing Design for Reflection. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). Association for Computing Machinery, New York, NY, USA, Article 21, 1–10. https://doi.org/10.1145/2971485.2971494

Digital Library

[42]

Mols, I. 2014. Making memories: A cultural probe study into the remembering of everyday life. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational (NordiCHI '14). Association for Computing Machinery, New York, NY, USA, 256–265. https://doi.org/10.1145/2639189.2639209

Digital Library

[43]

Mols, I. 2016. Technologies for Everyday Life Reflection: Illustrating a Design Space. Proceedings of the Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI ’16). Association for Computing Machinery, New York, NY, USA, 53–61. https://doi.org/10.1145/2839462.2839466

Digital Library

[44]

Moore, S.E. 2011. Social work students and self-care: A model assignment for teaching. Journal of Social Work Education. 47, 3, 545–553. https://doi.org/10.5175/JSWE.2011.201000004

[45]

Moussa-Inaty, J. 2015. Reflective writing through the use of guiding questions. International Journal of Teaching and Learning in Higher Education. 27, 1, 104–113.

[46]

Oh, H. 2018. Multimodal food journaling. HealthMedia 2018 - Proceedings of the 3rd International Workshop on Multimedia for Personal Health and Health Care, co-located with MM 2018. 39–47. https://doi.org/10.1145/3264996.3265000

Digital Library

[47]

Peesapati, S.T. 2010. Pensieve: Supporting everyday reminiscence. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). Association for Computing Machinery, New York, NY, USA, 2027–2036. https://doi.org/10.1145/1753326.1753635

Digital Library

[48]

Petrelli, D. 2009. Making history: Intentional capture of future memories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, New York, NY, USA, 1723–1732. https://doi.org/10.1145/1518701.1518966

Digital Library

[49]

Sellen, A.J. 2007. Do life-logging technologies support memory for the past? an experimental study using sensecam. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 81–90. https://doi.org/10.1145/1240624.1240636

Digital Library

[50]

Terzimehić, N. 2021. MEMEories: Internet Memes as Means for Daily Journaling. In Proceedings of the 2021 ACM Designing Interactive Systems Conference: Nowhere and Everywhere (DIS ’21). Association for Computing Machinery, New York, NY, USA, 538–548. https://doi.org/10.1145/3461778.3462080

Digital Library

[51]

Thieme, A. 2012. “we've bin watching you” - Designing for reflection and social persuasion to promote sustainable lifestyles. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). Association for Computing Machinery, New York, NY, USA, 2337–2346. https://doi.org/10.1145/2207676.2208394

Digital Library

[52]

Tholander, J. and Normark, M. 2020. Crafting Personal Information - Resistance, Imperfection, and Self-Creation in Bullet Journaling. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376410

Digital Library

[53]

Utley, A. and Garza, Y. 2011. The therapeutic use of journaling with adolescents. Journal of Creativity in Mental Health. 6, 1 (2011), 29–41. https://doi.org/10.1080/15401383.2011.557312

[54]

Whittaker, S. 2010. Easy on that trigger dad: A study of long term family photo retrieval. Pers Ubiquit Comput 14, 31–43. https://doi.org/10.1007/s00779-009-0218-7

Digital Library

[55]

Ye, X. 2016. Assisting food journaling with automatic eating detection. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). Association for Computing Machinery, New York, NY, USA, 3255–3262. https://doi.org/10.1145/2851581.2892426

Digital Library

[56]

Zimmerman, J. 2007. Research through design as a method for interaction design research in HCI. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). Association for Computing Machinery, New York, NY, USA, 493–502. https://doi.org/10.1145/1240624.1240704

Digital Library

Cited By

Loerakker MNiess JWoźniak P(2024)Technology which Makes You ThinkProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596158:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659615
Ren XZhang XZou RYan RYu B(2024)EmoVis: exploring data-enabled analogue journaling to promote self-reflection for mental wellness among college studentsBehaviour & Information Technology10.1080/0144929X.2024.234918244:4(859-881)Online publication date: 10-May-2024
https://doi.org/10.1080/0144929X.2024.2349182
Karaturhan POrhan İKuşcu KYantaç A(2024)Informing the design of question-asking conversational agents for reflectionPersonal and Ubiquitous Computing10.1007/s00779-024-01831-728:6(1001-1019)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s00779-024-01831-7

Index Terms

Combining Momentary and Retrospective Self-Reflection in a Mobile Photo-Based Journaling Application
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Empirical studies in HCI

Recommendations

Understanding self-reflection: how people reflect on personal data through visual data exploration
PervasiveHealth '17: Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare

Rapid advancements in consumer technologies enable people to collect a wide range of personal data. With a proper means for people to ask questions and explore their data, longitudinal data feeds from multiple self-tracking tools pose great ...
Self-Reflection and Personal Physicalization Construction
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Self-reflection is a central goal of personal informatics systems, and constructing visualizations from physical tokens has been found to help people reflect on data. However, so far, constructive physicalization has only been studied in lab environments ...
Personal informatics and reflection: a critical examination of the nature of reflection
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

Personal informatics systems that help people both collect and reflect on various kinds of personal information are growing rapidly. Despite the importance of journaling and the main role it has in tracking one's personal growth, a limited number of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

NordiCHI '22: Nordic Human-Computer Interaction Conference

October 2022

1091 pages

ISBN:9781450396998

DOI:10.1145/3546155

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 October 2022

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

NordiCHI '22

NordiCHI '22: Nordic Human-Computer Interaction Conference

October 8 - 12, 2022

Aarhus, Denmark

Acceptance Rates

Overall Acceptance Rate 379 of 1,572 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
920
Total Downloads

Downloads (Last 12 months)524
Downloads (Last 6 weeks)66

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Loerakker MNiess JWoźniak P(2024)Technology which Makes You ThinkProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596158:2(1-24)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659615
Ren XZhang XZou RYan RYu B(2024)EmoVis: exploring data-enabled analogue journaling to promote self-reflection for mental wellness among college studentsBehaviour & Information Technology10.1080/0144929X.2024.234918244:4(859-881)Online publication date: 10-May-2024
https://doi.org/10.1080/0144929X.2024.2349182
Karaturhan POrhan İKuşcu KYantaç A(2024)Informing the design of question-asking conversational agents for reflectionPersonal and Ubiquitous Computing10.1007/s00779-024-01831-728:6(1001-1019)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s00779-024-01831-7

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten