research-article

What Makes Creators Engage with Online Critiques? Understanding the Role of Artifacts’ Creation Stage, Characteristics of Community Comments, and their Interactions

Authors:

Xiaojuan MaAuthors Info & Claims

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

Article No.: 556, Pages 1 - 17

https://doi.org/10.1145/3544548.3581054

Published: 19 April 2023 Publication History

Abstract

Online critique communities (OCCs) provide a convenient space for creators to solicit feedback on their artifacts and improve skills. Creators’ behavioral, emotional, and cognitive engagement with comments on their works contribute to their skill development. However, what kinds of critique creators feel engaging may change with the creation stage of their shared artifacts. In this paper, we first model three dimensions of engagement expressed in creators’ replies to peer comments. Then we quantitatively examine how their engagement is affected by artifacts’ stage and feedback characteristics via regression analysis. Results show that creators sharing works-in-progress tend to exhibit lower behavioral and emotional engagement, but higher cognitive engagement than those sharing complete works. The increase in the valence of the feedback is associated with a stronger increase in behavior engagement for seekers sharing complete works than works-in-progress. Finally, we discuss how our insights could benefit OCCs and other online help-seeking platforms.

Supplementary Material

MP4 File (3544548.3581054-talk-video.mp4)

Pre-recorded Video Presentation

Download
78.95 MB

References

[1]

Jay S Albanese. 2009. Combating Piracy: Intellectual Property Theft and Fraud. Routledge, London, UK.

[2]

Nazanin Andalibi and Andrea Forte. 2018. Announcing pregnancy loss on Facebook: A decision-making framework for stigmatized disclosures on identified social network sites. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 158, 14 pages.

Digital Library

[3]

GD Atlas, B Fassett, and C Peterson. 1994. Sensitivity to criticism and depressive symptoms. Journal of Social Behavior and Personality 9, 2 (1994), 301–316.

[4]

Vipin Balachandran. 2013. Reducing human effort and improving quality in peer code reviews using automatic static analysis and reviewer recommendation. In Proceedings of the International Conference on Software Engineering. IEEE, New York, NY, USA, 931–940.

[5]

Jason Baumgartner, Savvas Zannettou, Brian Keegan, Megan Squire, and Jeremy Blackburn. 2020. The pushshift reddit dataset. Proceedings of the International AAAI Conference on Web and Social Media 14(2020), 830–839.

[6]

Chris Beaumont, Ella O’Doherty, and Lee Shannon. 2011. Reconceptualising Assessment Feedback: A Key to Improving Student Learning?Studies in Higher Education 36 (2011), 671–687.

[7]

William D Berry, Stanley Feldman, and Dr Stanley Feldman. 1985. Multiple regression in practice. SAGE, Thousand Oaks, CA, USA.

[8]

Viv Bewick, Liz Cheek, and Jonathan Ball. 2005. Statistics review 14: Logistic regression. Critical Care 9, 1, Article 112 (2005), 7 pages.

[9]

Neelma Bhatti, Amarachi Blessing Mbakwe, Sandra Nnadi, Geetha Saarunya Clarke, Aakash Gautam, D Scott McCrickard, and Aisling Kelliher. 2022. Intimate Narratives: An Assets-Based Approach to Develop Holistic Perspectives of Student Mothers’ Lives and Their Use of Technology in Parenting. Proceedings of the ACM on Human-Computer Interaction 6, Article 522(2022), 28 pages. Issue CSCW2.

Digital Library

[10]

Richard Bounds, Colleen Bush, Amish Aghera, Nestor Rodriguez, R. Brent Stansfield, Sally A. Santen, and MERC at CORD Feedback Study Group. 2013. Emergency medicine residents’ self-assessments play a critical role when receiving feedback. Academic Emergency Medicine: Official Journal of the Society for Academic Emergency Medicine 20, 10 (2013), 1055–1061.

[11]

Virginia Braun and Victoria Clarke. 2012. Thematic analysis. In APA Handbook of Research Methods in Psychology, Vol 2: Research Designs: Quantitative, Qualitative, Neuropsychological, and Biological. APA, Washington, DC, USA, 57–71.

[12]

Deirdre Burke. 2009. Strategies for using feedback students bring to higher education. Assessment & Evaluation in Higher Education 34, 1 (2009), 41–50.

[13]

Rich Caruana, Steve Lawrence, and C Giles. 2000. Overfitting in neural nets: Backpropagation, conjugate gradient, and early stopping. Advances in Neural Information Processing Systems 13 (2000), 381–387.

[14]

Daniela Castellanos-Reyes. 2021. The dynamics of a MOOC’s learner-learner interaction over time: A longitudinal network analysis. Computers in Human Behavior 123, Article 106880(2021), 14 pages.

[15]

John M Chambers. 2017. Linear models. In Statistical models in S. Routledge, London, UK, 95–144.

[16]

Jackie Chan, Aditi Atreyasa, Stevie Chancellor, and Eshwar Chandrasekharan. 2022. Community Resilience: Quantifying the Disruptive Effects of Sudden Spikes in Activity within Online Communities. In Proceedings of the ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 339, 8 pages.

Digital Library

[17]

Diane D Chapman, Julia Storberg-Walker, and Sophia J Stone. 2008. Hitting reply: A qualitative study to understand student decisions to respond to online discussion postings. E-Learning and Digital Media 5, 1 (2008), 29–39.

[18]

Ruijia Cheng and Jenna Frens. 2022. Feedback Exchange and Online Affinity: A Case Study of Online Fanfiction Writers. Proceedings of the ACM on Human-Computer Interaction 6, Article 402(2022), 29 pages. Issue CSCW2.

Digital Library

[19]

Ruijia Cheng, Ziwen Zeng, Maysnow Liu, and Steven Dow. 2020. Critique Me: Exploring How Creators Publicly Request Feedback in an Online Critique Community. Proceedings of the ACM on Human-Computer Interaction 4, Article 161(2020), 24 pages. Issue CSCW2.

Digital Library

[20]

Michelene T. H. Chi and Ruth Wylie. 2014. The ICAP Framework: Linking Cognitive Engagement to Active Learning Outcomes. Educational Psychologist 49, 4 (2014), 219–243.

[21]

Lerita M Coleman, Lee Jussim, and Jack Abraham. 1987. Students’ Reactions to Teachers’ Evaluations: The Unique Impact of Negative Feedback 1. Journal of Applied Social Psychology 17, 12 (1987), 1051–1070.

[22]

Patrick A Crain and Brian P Bailey. 2017. Share Once or Share Often? Exploring How Designers Approach Iteration in a Large Online Community. In Proceedings of the SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 80–92.

Digital Library

[23]

Munmun De Choudhury, Emre Kiciman, Mark Dredze, Glen Coppersmith, and Mrinal Kumar. 2016. Discovering shifts to suicidal ideation from mental health content in social media. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2098–2110.

Digital Library

[24]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). ACL, Minneapolis, MN, USA, 4171–4186.

[25]

Kevin Doherty and Gavin Doherty. 2018. Engagement in HCI: conception, theory and measurement. Comput. Surveys 51, 5, Article 99 (2018), 39 pages.

[26]

Gokhan Egri and Coskun Bayrak. 2014. The role of search engine optimization on keeping the user on the site. Procedia Computer Science 36 (2014), 335–342.

[27]

Kevin W. Eva, Heather Armson, Eric Holmboe, Jocelyn Lockyer, Elaine Loney, Karen Mann, and Joan Sargeant. 2012. Factors influencing responsiveness to feedback: on the interplay between fear, confidence, and reasoning processes. Advances in Health Sciences Education: Theory and Practice 17, 1(2012), 15–26.

[28]

Edmund Burke Feldman. 1994. Practical art criticism. Prentice Hall, Englewood Cliffs, NJ, USA.

[29]

Christiane Fellbaum and George A. Miller. 1998. WordNet: An Electronic Lexical Database. A Bradford Book, Cambridge, MA, USA.

[30]

Eureka Foong, Steven P Dow, Brian P Bailey, and Elizabeth M Gerber. 2017. Online feedback exchange: A framework for understanding the socio-psychological factors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4454–4467.

Digital Library

[31]

Jennifer A Fredricks, Phyllis C Blumenfeld, and Alison H Paris. 2004. School Engagement: Potential of the Concept, State of the Evidence. Review of Educational Research 74, 1 (2004), 59–109.

[32]

Devin Gaffney and J Nathan Matias. 2018. Caveat emptor, computational social science: Large-scale missing data in a widely-published Reddit corpus. PloS one 13, 7, Article e0200162(2018), 13 pages.

[33]

Yujia Gao, Jinu Jang, and Diyi Yang. 2021. Understanding the usage of online media for parenting from infancy to preschool at scale. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 183, 12 pages.

Digital Library

[34]

Shuang Geng, Ben Niu, Yuanyue Feng, and Miaojia Huang. 2020. Understanding the focal points and sentiment of learners in MOOC reviews: A machine learning and SC-LIWC-based approach. British Journal of Educational Technology 51, 5 (2020), 1785–1803.

[35]

Pollyanna Goncalves, Fabrıcio Benevenuto, and Meeyoung Cha. 2013. PANAS-t: A Pychometric Scale for Measuring Sentiments on Twitter. (2013), 11. arXiv:1308.1857

[36]

Crystal Gong, Koustuv Saha, and Stevie Chancellor. 2021. "The Smartest Decision for My Future": Social Media Reveals Challenges and Stress During Post-College Life Transition. Proceedings of the ACM on Human-Computer Interaction 5, Article 298(2021), 29 pages. Issue CSCW2.

Digital Library

[37]

Jodi S Goodman and Robert E Wood. 2004. Feedback specificity, learning opportunities, and learning. Journal of Applied Psychology 89, 5 (2004), 809.

[38]

Qingyu Guo, Siyuan Zhou, Yifeng Wu, Zhenhui Peng, and Xiaojuan Ma. 2022. Understanding and Modeling Viewers’ First Impressions with Images in Online Medical Crowdfunding Campaigns. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 361, 20 pages.

Digital Library

[39]

Wenge Guo, Ye Chen, Jing Lei, and Yan Wen. 2014. The Effects of Facilitating Feedback on Online Learners’ Cognitive Engagement: Evidence from the Asynchronous Online Discussion. Education Sciences 4, 2 (2014), 193–208.

[40]

Karen Handley, Margaret Price, and Jill Millar. 2011. Beyond ‘doing time’: investigating the concept of student engagement with feedback. Oxford Review of Education 37, 4 (2011), 543–560.

[41]

Gillian R Hayes, Gregory D Abowd, John S Davis, Marion L Blount, Maria Ebling, and Elizabeth D Mynatt. 2008. Opportunities for pervasive computing in chronic cancer care. In International Conference on Pervasive Computing. Springer, Berlin, Germany, 262–279.

Digital Library

[42]

Catherine M Hicks, Vineet Pandey, C Ailie Fraser, and Scott Klemmer. 2016. Framing feedback: Choosing review environment features that support high quality peer assessment. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 458–469.

Digital Library

[43]

Clayton Hutto and Eric Gilbert. 2014. Vader: A parsimonious rule-based model for sentiment analysis of social media text. Proceedings of the International AAAI Conference on Web and Social Media 8, 1(2014), 216–225.

[44]

Jacob Jacoby. 1984. Perspectives on information overload. Journal of Coonsumer Research 10, 4 (1984), 432–435.

[45]

Shazia K. Jan, Panos Vlachopoulos, and Mitch Parsell. 2019. Social Network Analysis and Online Learning Communities in Higher Education: A Systematic Literature Review. Online Learning 23, 1 (2019), 249–265.

[46]

Menglin Jia, Zuxuan Wu, Austin Reiter, Claire Cardie, Serge Belongie, and Ser-Nam Lim. 2021. Exploring Visual Engagement Signals for Representation Learning. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV). IEEE, Montreal, QC, Canada, 4186–4197.

[47]

Anders Jonsson. 2013. Facilitating productive use of feedback in higher education. Active Learning in Higher Education 14, 1 (2013), 63–76. SAGE.

[48]

Joy Kim, Maneesh Agrawala, and Michael S Bernstein. 2017. Mosaic: designing online creative communities for sharing works-in-progress. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 246–258.

Digital Library

[49]

Ran Kivetz and Itamar Simonson. 2002. Earning the right to indulge: Effort as a determinant of customer preferences toward frequency program rewards. Journal of Marketing Research 39, 2 (2002), 155–170.

[50]

Yasmine Kotturi, Allie Blaising, Sarah E Fox, and Chinmay Kulkarni. 2021. The Unique Challenges for Creative Small Businesses Seeking Feedback on Social Media. Proceedings of the ACM on Human-Computer Interaction 5, Article 15(2021), 27 pages. Issue CSCW1.

Digital Library

[51]

Yasmine Kotturi and McKayla Kingston. 2019. Why do Designers in the "Wild" Wait to Seek Feedback until Later in their Design Process?. In Proceedings of the SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 541–546.

Digital Library

[52]

Yubo Kou and Colin M Gray. 2017. Supporting distributed critique through interpretation and sense-making in an online creative community. Proceedings of the ACM on Human-Computer Interaction 1, Article 60(2017), 18 pages. Issue CSCW.

Digital Library

[53]

Yubo Kou and Colin M Gray. 2018. “What do you recommend a complete beginner like me to practice” Professional Self-Disclosure in an Online Community. Proceedings of the ACM on Human-Computer Interaction 2, Article 94(2018), 24 pages. Issue CSCW.

[54]

Markus Krause, Tom Garncarz, JiaoJiao Song, Elizabeth M. Gerber, Brian P. Bailey, and Steven P. Dow. 2017. Critique Style Guide: Improving Crowdsourced Design Feedback with a Natural Language Model. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 4627–4639.

Digital Library

[55]

Sneha R. Krishna Kumaran, Deana C. McDonagh, and Brian P. Bailey. 2017. Increasing Quality and Involvement in Online Peer Feedback Exchange. Proceedings of the ACM on Human-Computer Interaction 1, Article 63(2017), 18 pages. Issue CSCW.

Digital Library

[56]

Sneha R. Krishna Kumaran, Wenxuan Wendy Shi, and Brian P Bailey. 2021. Am I Ready to Get Feedback? A Taxonomy of Factors Creators Consider Before Seeking Feedback on In-Progress Creative Work. In Proceedings of the SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, Article 31, 10 pages.

Digital Library

[57]

Hui-Min Lai and Tsung Teng Chen. 2014. Knowledge sharing in interest online communities: A comparison of posters and lurkers. Computers in Human Behavior 35 (2014), 295–306.

[58]

Eun-Jung Lee. 2016. How perceived cognitive needs fulfillment affect consumer attitudes toward the customized product: The moderating role of consumer knowledge. Computers in Human Behavior 64 (2016), 152–162.

Digital Library

[59]

Fritz Lekschas, Spyridon Ampanavos, Pao Siangliulue, Hanspeter Pfister, and Krzysztof Z. Gajos. 2021. Ask Me or Tell Me? Enhancing the Effectiveness of Crowdsourced Design Feedback. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 564, 12 pages.

Digital Library

[60]

Zachary Levonian, Drew Richard Erikson, Wenqi Luo, Saumik Narayanan, Sabirat Rubya, Prateek Vachher, Loren Terveen, and Svetlana Yarosh. 2020. Bridging qualitative and quantitative methods for user modeling: Tracing cancer patient behavior in an online health community. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 14. ACM, New York, NY, USA, 405–416.

[61]

Sannyuya Liu, Shiqi Liu, Zhi Liu, Xian Peng, and Zongkai Yang. 2022. Automated detection of emotional and cognitive engagement in MOOC discussions to predict learning achievement. Computers & Education 181 (2022), 104461.

Digital Library

[62]

Xiaojuan Ma, Li Yu, Jodi L Forlizzi, and Steven P Dow. 2015. Exiting the design studio: Leveraging online participants for early-stage design feedback. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 676–685.

Digital Library

[63]

Dhruv Mahajan, Ross Girshick, Vignesh Ramanathan, Kaiming He, Manohar Paluri, Yixuan Li, Ashwin Bharambe, and Laurens van der Maaten. 2018. Exploring the Limits of Weakly Supervised Pretraining. In Computer Vision – ECCV 2018. Vol. 11206. Springer, Cham, 185–201.

Digital Library

[64]

Jennifer Marlow and Laura Dabbish. 2014. From rookie to all-star: professional development in a graphic design social networking site. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 922–933.

Digital Library

[65]

Rosa M. Mayordomo, Anna Espasa, Teresa Guasch, and Montserrat Martínez-Melo. 2022. Perception of online feedback and its impact on cognitive and emotional engagement with feedback. Education and Information Technologies 27 (2022), 7947–7971.

Digital Library

[66]

Nora McDonald, Sarita Schoenebeck, and Andrea Forte. 2019. Reliability and Inter-rater Reliability in Qualitative Research: Norms and Guidelines for CSCW and HCI Practice. Proceedings of the ACM on Human-Computer Interaction 3, Article 72(2019), 23 pages. Issue CSCW.

Digital Library

[67]

Mary L McHugh. 2012. Interrater reliability: the kappa statistic. Biochemia Medica 22, 3 (2012), 276–282.

[68]

Pedro Manuel Moreno-Marcos, Carlos Alario-Hoyos, Pedro J. Muñoz-Merino, Iria Estévez-Ayres, and Carlos Delgado Kloos. 2018. Sentiment analysis in MOOCs: A case study. In 2018 IEEE Global Engineering Education Conference. IEEE, New York, NY, USA, 1489–1496.

[69]

Tricia J. Ngoon, C. Ailie Fraser, Ariel S. Weingarten, Mira Dontcheva, and Scott Klemmer. 2018. Interactive Guidance Techniques for Improving Creative Feedback. In CHI. ACM, New York, NY, USA, Article 155, 11 pages.

[70]

Thi Thao Duyen T. Nguyen, Thomas Garncarz, Felicia Ng, Laura A. Dabbish, and Steven P. Dow. 2017. Fruitful Feedback: Positive Affective Language and Source Anonymity Improve Critique Reception and Work Outcomes. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 1024–1034.

Digital Library

[71]

Yeonjoo Oh, Suguru Ishizaki, Mark D. Gross, and Ellen Yi-Luen Do. 2013. A theoretical framework of design critiquing in architecture studios. Design Studies 34, 3 (2013), 302–325.

[72]

Jonas Oppenlaender, Elina Kuosmanen, Andrés Lucero, and Simo Hosio. 2021. Hardhats and bungaloos: Comparing crowdsourced design feedback with peer design feedback in the classroom. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 570, 14 pages.

Digital Library

[73]

Reinhard Pekrun, Thomas Goetz, Wolfram Titz, and Raymond P Perry. 2002. Positive emotions in education. In Beyond coping: Meeting goals, visions, and challenges. Oxford University Press, Oxford, UK, 149–173.

[74]

Reinhard Pekrun, Stephanie Lichtenfeld, Herbert W Marsh, Kou Murayama, and Thomas Goetz. 2017. Achievement emotions and academic performance: Longitudinal models of reciprocal effects. Child Development 88, 5 (2017), 1653–1670.

[75]

Reinhard Pekrun and Lisa Linnenbrink-Garcia. 2012. Academic emotions and student engagement. In Handbook of research on student engagement. Springer, Berlin, Germany, 259–282.

[76]

Zhenhui Peng, Qingyu Guo, Ka Wing Tsang, and Xiaojuan Ma. 2020. Exploring the effects of technological writing assistance for support providers in online mental health community. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 566, 15 pages.

Digital Library

[77]

Zhenhui Peng, Xiaojuan Ma, Diyi Yang, Ka Wing Tsang, and Qingyu Guo. 2021. Effects of support-seekers’ community knowledge on their expressed satisfaction with the received comments in mental health communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 536, 12 pages.

Digital Library

[78]

James W Pennebaker, Ryan L Boyd, Kayla Jordan, and Kate Blackburn. 2015. The development and psychometric properties of LIWC2015. Technical Report. The University of Texas at Austin.

[79]

Bercedis Peterson and Frank E Harrell Jr. 1990. Partial proportional odds models for ordinal response variables. Journal of the Royal Statistical Society: Series C (Applied Statistics) 39, 2(1990), 205–217.

[80]

Margaret Price, Karen Handley, Jill Millar, and Berry O’Donovan. 2010. Feedback: all that effort, but what is the effect?Assessment & Evaluation in Higher Education 35, 3 (2010), 277–289.

[81]

Yada Pruksachatkun, Sachin R Pendse, and Amit Sharma. 2019. Moments of change: Analyzing peer-based cognitive support in online mental health forums. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 64, 13 pages.

Digital Library

[82]

Reddit. 2022. r/ArtCrit. https://www.reddit.com/r/ArtCrit/. Retrieved on Sep 1, 2022.

[83]

Reddit. 2022. r/Dance. https://www.reddit.com/r/Dance/. Retrieved on Sep 1, 2022.

[84]

Reddit. 2022. Reddit Platform. https://www.reddit.com/. Retrieved on Sep 1, 2022.

[85]

Reddit. 2022. r/learnart. https://www.reddit.com/r/learnart/. Retrieved on Sep 1, 2022.

[86]

Reddit. 2022. r/MusicCritique. https://www.reddit.com/r/MusicCritique/. Retrieved on Sep 1, 2022.

[87]

Reddit. 2022. r/writing. https://www.reddit.com/r/writing/. Retrieved on Sep 1, 2022.

[88]

Kathryn E Ringland, Arpita Bhattacharya, Kevin Weatherwax, Tessa Eagle, and Christine T Wolf. 2022. ARMY’s Magic Shop: Understanding the Collaborative Construction of Playful Places in Online Communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 126, 19 pages.

Digital Library

[89]

Howard Risatti. 1987. Art Criticism in Discipline-Based Art Education. Journal of Aesthetic Education 21, 2 (1987), 217–25.

[90]

Jerome I. Rotgans and Henk G. Schmidt. 2011. Cognitive engagement in the problem-based learning classroom. Advances in Health Sciences Education 16, 4 (2011), 465–479.

[91]

D. Royce Sadler. 1989. Formative assessment and the design of instructional systems. Instructional Science 18, 2 (1989), 119–144.

[92]

Joan M Sargeant, Karen V Mann, Cees P Van der Vleuten, and Job F Metsemakers. 2009. Reflection: a link between receiving and using assessment feedback. Advances in Health Sciences Education 14, 3 (2009), 399–410.

[93]

Ashish Sharma, Inna W Lin, Adam S Miner, David C Atkins, and Tim Althoff. 2021. Towards facilitating empathic conversations in online mental health support: A reinforcement learning approach. In Proceedings of the Web Conference. ACM, New York, NY, USA, 194–205.

Digital Library

[94]

C Estelle Smith, William Lane, Hannah Miller Hillberg, Daniel Kluver, Loren Terveen, and Svetlana Yarosh. 2021. Effective Strategies for Crowd-Powered Cognitive Reappraisal Systems: A Field Deployment of the Flip* Doubt Web Application for Mental Health. Proceedings of the ACM on Human-Computer Interaction 5, Article 417(2021), 37 pages. Issue CSCW2.

Digital Library

[95]

Ivan Srba and Maria Bielikova. 2016. A comprehensive survey and classification of approaches for community question answering. ACM Transactions on the Web (TWEB) 10, 3, Article 18(2016), 63 pages.

[96]

Bart Thomee, David A Shamma, Gerald Friedland, Benjamin Elizalde, Karl Ni, Douglas Poland, Damian Borth, and Li-Jia Li. 2016. YFCC100M: The new data in multimedia research. Commun. ACM 59, 2 (2016), 64–73.

Digital Library

[97]

Kerrie Unsworth. 2001. Unpacking creativity. Academy of management review 26, 2 (2001), 289–297.

[98]

Don VandeWalle and Larry L Cummings. 1997. A test of the influence of goal orientation on the feedback-seeking process. Journal of Applied Psychology 82, 3 (1997), 390–400.

[99]

Tatiana A Vlahovic, Yi-Chia Wang, Robert E Kraut, and John M Levine. 2014. Support matching and satisfaction in an online breast cancer support community. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 1625–1634.

Digital Library

[100]

Xianzhi Wang, Chaoran Huang, Lina Yao, Boualem Benatallah, and Manqing Dong. 2018. A survey on expert recommendation in community question answering. Journal of Computer Science and Technology 33, 4 (2018), 625–653.

[101]

Naomi E. Winstone, Robert A. Nash, Michael Parker, and James Rowntree. 2017. Supporting Learners’s Agentic Engagement With Feedback: A Systematic Review and a Taxonomy of Recipience Processes. Educational Psychologist 52, 1 (2017), 17–37.

[102]

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, 2020. Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. ACL, Dublin, Ireland, 38–45.

[103]

Y. Wayne Wu and Brian P. Bailey. 2017. Bitter Sweet or Sweet Bitter? How Valence Order and Source Identity Influence Feedback Acceptance. In Proceedings of the SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 137–147.

[104]

Y. Wayne Wu and Brian P. Bailey. 2018. Soften the Pain, Increase the Gain: Enhancing Users’ Resilience to Negative Valence Feedback. Proceedings of the ACM on Human-Computer Interaction 2, Article 186(2018), 20 pages. Issue CSCW.

[105]

Anbang Xu and Brian Bailey. 2012. What do you think? A case study of benefit, expectation, and interaction in a large online critique community. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 295–304.

[106]

Bing Xu, Nian-Shing Chen, and Guang Chen. 2020. Effects of teacher role on student engagement in WeChat-Based online discussion learning. Computers & Education 157, Article 103956(2020), 11 pages.

[107]

Diyi Yang, Robert Kraut, and John M Levine. 2017. Commitment of newcomers and old-timers to online health support communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 6363–6375.

Digital Library

[108]

Diyi Yang, Zheng Yao, and Robert Kraut. 2017. Self-disclosure and channel difference in online health support groups. Proceedings of the International AAAI Conference on Web and Social Media 11, 1 (2017), 704–707.

[109]

Wenjie Yang, Zhiyang Wu, Nga Yiu Mok, and Xiaojuan Ma. 2022. How to Save Lives with Microblogs? Lessons From the Usage of Weibo for Requests for Medical Assistance During COVID-19. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 70, 18 pages.

Digital Library

[110]

Yu-Chun (Grace) Yen. 2017. Enhancing the Usage of Crowd Feedback for Iterative Design. In Proceedings of the SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 513–517.

[111]

Yu-Chun Grace Yen, Steven P. Dow, Elizabeth Gerber, and Brian P. Bailey. 2017. Listen to Others, Listen to Yourself: Combining Feedback Review and Reflection to Improve Iterative Design. In Proceedings of the SIGCHI Conference on Creativity and Cognition. ACM, New York, NY, USA, 158–170.

Digital Library

[112]

Yu-Chun Grace Yen, Joy O Kim, and Brian P Bailey. 2020. Decipher: an interactive visualization tool for interpreting unstructured design feedback from multiple providers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, Article 253, 13 pages.

Digital Library

[113]

Alvin Yuan, Kurt Luther, Markus Krause, Sophie Isabel Vennix, Steven P Dow, and Bjorn Hartmann. 2016. Almost an Expert: The Effects of Rubrics and Expertise on Perceived Value of Crowdsourced Design Critiques. In Proceedings of the ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, New York, NY, USA, 1005–1017.

Digital Library

[114]

Haiyi Zhu, Amy Zhang, Jiping He, Robert E Kraut, and Aniket Kittur. 2013. Effects of peer feedback on contribution: a field experiment in Wikipedia. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, New York, NY, USA, 2253–2262.

Digital Library

[115]

Caleb Ziems, Minzhi Li, Anthony Zhang, and Diyi Yang. 2022. Inducing Positive Perspectives with Text Reframing. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). ACL, Dublin, Ireland, 3682–3700.

Cited By

Guo QYuan KHe CPeng ZMa X(2024)Exploring the Evolvement of Artwork Descriptions in Online Creative Community under the Surge of Generative AI: A Case Study of DeviantArtExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650851(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650851
Kim THan HAdar EKay MChung J(2024)Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language ArtsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642529(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642529

Index Terms

What Makes Creators Engage with Online Critiques? Understanding the Role of Artifacts’ Creation Stage, Characteristics of Community Comments, and their Interactions
1. Human-centered computing
  1. Collaborative and social computing
    1. Empirical studies in collaborative and social computing

Recommendations

Research on the Influence of Synchronous Interactive Class on Student Online Learning Engagement
ICETC '20: Proceedings of the 12th International Conference on Education Technology and Computers

With the development of information technology, online education has been more and more significant. It also has some dilemma, however, such as high dropout rate and low engagement. In this paper, we explored the impacts of the synchronous interactive ...
The relationship between students’ psychological security level, academic engagement and performance variables in the digital educational environment
Abstract
In connection with the situation with COVID-19 almost all universities in the world were transferred to e-learning format, therefore new factors started to influence academic engagement and performance. Psychological security is one of these ...
Perception of online feedback and its impact on cognitive and emotional engagement with feedback
Abstract
Online feedback plays a key role in learning, but this requires that students engage with feedback. Some authors identify students’ perception of feedback as relevant to understanding engagement. To measure the effect that perceived feedback (...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems

April 2023

14911 pages

ISBN:9781450394215

DOI:10.1145/3544548

Editors:
Albrecht Schmidt
LMU Munich, Germany60028717
,
Kaisa Väänänen
Tampere University, Finland60011170
,
Tesh Goyal
Google Research, USA60006191
,
Per Ola Kristensson
University of Cambridge, UK60031101
,
Anicia Peters
University of Namibia, Namibia60072704
,
Stefanie Mueller
Massachusetts Institute of Technology, USA60022195
,
Julie R. Williamson
University of Glasgow, UK60001490
,
Max L. Wilson
University of Nottingham, UK60015138

Copyright © 2023 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

HKUST-WeBank Joint Laboratory Project Grant

Conference

CHI '23

Sponsor:

SIGCHI

CHI '23: CHI Conference on Human Factors in Computing Systems

April 23 - 28, 2023

Hamburg, Germany

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
577
Total Downloads

Downloads (Last 12 months)298
Downloads (Last 6 weeks)17

Reflects downloads up to 13 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Guo QYuan KHe CPeng ZMa X(2024)Exploring the Evolvement of Artwork Descriptions in Online Creative Community under the Surge of Generative AI: A Case Study of DeviantArtExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650851(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650851
Kim THan HAdar EKay MChung J(2024)Authors' Values and Attitudes Towards AI-bridged Scalable Personalization of Creative Language ArtsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642529(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642529

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Table of Conten