Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3544548.3580932acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

CoArgue : Fostering Lurkers’ Contribution to Collective Arguments in Community-based QA Platforms

Published: 19 April 2023 Publication History

Abstract

In Community-Based Question Answering (CQA) platforms, people can participate in discussions about non-factoid topics by marking their stances, providing premises, or arguing for the opinions they support, which forms “collective arguments”. The sustainable development of collective arguments relies on a big contributor base, yet most of the frequent CQA users are lurkers who seldom speak out. With a formative study, we identified detailed obstacles preventing lurkers from contributing to collective arguments. We consequently designed a processing pipeline for extracting and summarizing augmentative elements from question threads. Based on this we built CoArgue, a tool with navigation and chatbot features to support CQA lurkers’ motivation and ability in making contributions. Through a within-subject study (N=24), we found that, compared to a Quora-like baseline, participants perceived CoArgue as significantly more useful in enhancing their motivation and ability to join collective arguments and found the experience to be more engaging and productive.

Supplementary Material

MP4 File (3544548.3580932-video-preview.mp4)
Video Preview
MP4 File (3544548.3580932-talk-video.mp4)
Pre-recorded Video Presentation

References

[1]
Tazin Afrin, Omid Kashefi, Christopher Olshefski, Diane Litman, Rebecca Hwa, and Amanda Godley. 2021. Effective Interfaces for Student-Driven Revision Sessions for Argumentative Writing. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 58, 13 pages. https://doi.org/10.1145/3411764.3445683
[2]
Abeer AlDayel and Walid Magdy. 2021. Stance detection on social media: State of the art and trends. Information Processing & Management 58, 4 (2021), 102597.
[3]
Steven Baker, Jenny Waycott, Romina Carrasco, Ryan M. Kelly, Anthony John Jones, Jack Lilley, Briony Dow, Frances Batchelor, Thuong Hoang, and Frank Vetere. 2021. Avatar-Mediated Communication in Social VR: An In-Depth Exploration of Older Adult Interaction in an Emerging Communication Platform. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 491, 13 pages. https://doi.org/10.1145/3411764.3445752
[4]
Francesco Barbieri, Luis Espinosa Anke, and Jose Camacho-Collados. 2022. XLM-T: Multilingual Language Models in Twitter for Sentiment Analysis and Beyond. In Proceedings of the Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 258–266. https://aclanthology.org/2022.lrec-1.27
[5]
Prakhar Biyani, Sumit Bhatia, Cornelia Caragea, and Prasenjit Mitra. 2012. Thread specific features are helpful for identifying subjectivity orientation of online forum threads. In Proceedings of COLING 2012. 295–310.
[6]
Alexander Bondarenko, Matthias Hagen, Martin Potthast, Henning Wachsmuth, Meriem Beloucif, Chris Biemann, Alexander Panchenko, and Benno Stein. 2020. Touché: First Shared Task on Argument Retrieval. In Advances in Information Retrieval: 42nd European Conference on IR Research, ECIR 2020, Lisbon, Portugal, April 14–17, 2020, Proceedings, Part II (Lisbon, Portugal). Springer-Verlag, Berlin, Heidelberg, 517–523. https://doi.org/10.1007/978-3-030-45442-5_67
[7]
Pavel Braslavski, Denis Savenkov, Eugene Agichtein, and Alina Dubatovka. 2017. What do you mean exactly? Analyzing clarification questions in CQA. In Proceedings of the 2017 conference on conference human information interaction and retrieval. 345–348.
[8]
Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative Research in Psychology 3, 2 (2006), 77–101. https://doi.org/10.1191/1478088706qp063oa arXiv:https://www.tandfonline.com/doi/pdf/10.1191/1478088706qp063oa
[9]
John Brooke. 1996. SUS: A quick and dirty usability scale. Usability evaluation in industry 189 (1996), 4–7.
[10]
Felix Carros, Johanna Meurer, Diana Löffler, David Unbehaun, Sarah Matthies, Inga Koch, Rainer Wieching, Dave Randall, Marc Hassenzahl, and Volker Wulf. 2020. Exploring Human-Robot Interaction with the Elderly: Results from a Ten-Week Case Study in a Care Home. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–12. https://doi.org/10.1145/3313831.3376402
[11]
Jessy Ceha, Ken Jen Lee, Elizabeth Nilsen, Joslin Goh, and Edith Law. 2021. Can a Humorous Conversational Agent Enhance Learning Experience and Outcomes?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 685, 14 pages. https://doi.org/10.1145/3411764.3445068
[12]
Jonathan P. Chang, Charlotte Schluger, and Cristian Danescu-Niculescu-Mizil. 2022. Thread With Caution: Proactively Helping Users Assess and Deescalate Tension in Their Online Discussions. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 545 (nov 2022), 37 pages. https://doi.org/10.1145/3555603
[13]
Fei-Ching Chen and Hsiu-Mei Chang. 2011. Do Lurking Learners Contribute Less? A Knowledge Co-Construction Perspective. In Proceedings of the 5th International Conference on Communities and Technologies (Brisbane, Australia) (C&T ’11). Association for Computing Machinery, New York, NY, USA, 169–178. https://doi.org/10.1145/2103354.2103377
[14]
Rocio Chongtay, Mark Last, and Bettina Berendt. 2018. Responsive News Summarization for Ubiquitous Consumption on Multiple Mobile Devices. In 23rd International Conference on Intelligent User Interfaces (Tokyo, Japan) (IUI ’18). Association for Computing Machinery, New York, NY, USA, 433–437. https://doi.org/10.1145/3172944.3172992
[15]
Benjamin Collier and Julia Bear. 2012. Conflict, criticism, or confidence: an empirical examination of the gender gap in wikipedia contributions. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work (New York, NY, USA, 2012-02-11) (CSCW ’12). Association for Computing Machinery, 383–392. https://doi.org/10.1145/2145204.2145265
[16]
Corinna Cortes and Vladimir Vapnik. 1995. Support-vector networks. Machine learning 20, 3 (1995), 273–297.
[17]
Mihaly Csikzentmihaly. 1990. Flow: The psychology of optimal experience. Vol. 1990. Harper & Row, New York, USA.
[18]
Kushal Dave, Martin Wattenberg, and Michael Muller. 2004. Flash Forums and ForumReader: Navigating a New Kind of Large-Scale Online Discussion. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (Chicago, Illinois, USA) (CSCW ’04). Association for Computing Machinery, New York, NY, USA, 232–241. https://doi.org/10.1145/1031607.1031644
[19]
Roelof A.J. de Vries, Khiet P. Truong, Sigrid Kwint, Constance H.C. Drossaert, and Vanessa Evers. 2016. Crowd-Designed Motivation: Motivational Messages for Exercise Adherence Based on Behavior Change Theory. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2016-05-07) (CHI ’16). Association for Computing Machinery, 297–308. https://doi.org/10.1145/2858036.2858229
[20]
Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina N. Toutanova. 2018. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. https://arxiv.org/abs/1810.04805
[21]
Berkeley J Dietvorst, Joseph P Simmons, and Cade Massey. 2015. Algorithm aversion: people erroneously avoid algorithms after seeing them err.Journal of Experimental Psychology: General 144, 1 (2015), 114.
[22]
Kevin Doherty and Gavin Doherty. 2018. Engagement in HCI: Conception, Theory and Measurement. ACM Comput. Surv. 51, 5, Article 99 (nov 2018), 39 pages. https://doi.org/10.1145/3234149
[23]
Lorik Dumani, Patrick J Neumann, and Ralf Schenkel. 2020. A framework for argument retrieval. In European Conference on Information Retrieval. Springer, 431–445.
[24]
Rosta Farzan, Robert Kraut, Aditya Pal, and Joseph Konstan. 2012. Socializing Volunteers in an Online Community: A Field Experiment. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (Seattle, Washington, USA) (CSCW ’12). Association for Computing Machinery, New York, NY, USA, 325–334. https://doi.org/10.1145/2145204.2145256
[25]
Haakon Faste and Honray Lin. 2012. The Untapped Promise of Digital Mind Maps. Association for Computing Machinery, New York, NY, USA, 1017–1026. https://doi.org/10.1145/2207676.2208548
[26]
Franz Faul, Edgar Erdfelder, Axel Buchner, and Albert-Georg Lang. 2009. Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behavior research methods 41, 4 (2009), 1149–1160.
[27]
Donghui Feng, Erin Shaw, Jihie Kim, and Eduard Hovy. 2006. An Intelligent Discussion-Bot for Answering Student Queries in Threaded Discussions. In Proceedings of the 11th International Conference on Intelligent User Interfaces (Sydney, Australia) (IUI ’06). Association for Computing Machinery, New York, NY, USA, 171–177. https://doi.org/10.1145/1111449.1111488
[28]
Rudolf Flesch. 1943. Marks of readable style; a study in adult education.Teachers College Contributions to Education(1943).
[29]
Rachel L. Franz, Jacob O. Wobbrock, Yi Cheng, and Leah Findlater. 2019. Perception and Adoption of Mobile Accessibility Features by Older Adults Experiencing Ability Changes. In The 21st International ACM SIGACCESS Conference on Computers and Accessibility (New York, NY, USA, 2019-10-24) (ASSETS ’19). Association for Computing Machinery, 267–278. https://doi.org/10.1145/3308561.3353780
[30]
Brendan J Frey and Delbert Dueck. 2007. Clustering by passing messages between data points. science 315, 5814 (2007), 972–976.
[31]
Shogo Fujita, Tomohide Shibata, and Manabu Okumura. 2020. Diverse and Non-redundant Answer Set Extraction on Community QA based on DPPs. In Proceedings of the 28th International Conference on Computational Linguistics. 5309–5320.
[32]
Andrew Gambino and S. Shyam Sundar. 2019. Acceptance of Self-Driving Cars: Does Their Posthuman Ability Make Them More Eerie or More Desirable?. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI EA ’19). Association for Computing Machinery, New York, NY, USA, 1–6. https://doi.org/10.1145/3290607.3312870
[33]
S Geerthik, S Venkatraman, and K Rajiv Gandhi. 2016. Reward rank: A novel approach for positioning user answers in community question answering system. In 2016 International Conference on Information Communication and Embedded Systems (ICICES). IEEE, 1–6.
[34]
Nancy C. Goodwin. 1987. Functionality and Usability. Commun. ACM 30, 3 (March 1987), 229–233. https://doi.org/10.1145/214748.214758
[35]
Theodosis Goudas, Christos Louizos, Georgios Petasis, and Vangelis Karkaletsis. 2014. Argument extraction from news, blogs, and social media. In Hellenic Conference on Artificial Intelligence. Springer, 287–299.
[36]
Maarten Grootendorst. 2020. KeyBERT: Minimal keyword extraction with BERT.https://doi.org/10.5281/zenodo.4461265
[37]
Ali Gürkan, Luca Iandoli, Mark Klein, and Giuseppe Zollo. 2010. Mediating debate through on-line large-scale argumentation: Evidence from the field. Information Sciences 180, 19 (2010), 3686–3702.
[38]
F Maxwell Harper, Daniel Moy, and Joseph A Konstan. 2009. Facts or friends? Distinguishing informational and conversational questions in social Q&A sites. In Proceedings of the sigchi conference on human factors in computing systems. 759–768.
[39]
Joe E Heimlich and Nicole M Ardoin. 2008. Understanding behavior to understand behavior change: A literature review. Environmental education research 14, 3 (2008), 215–237.
[40]
Christopher Hidey, Elena Musi, Alyssa Hwang, Smaranda Muresan, and Kathleen McKeown. 2017. Analyzing the semantic types of claims and premises in an online persuasive forum. In Proceedings of the 4th Workshop on Argument Mining. 11–21.
[41]
Enamul Hoque and Giuseppe Carenini. 2015. ConVisIT: Interactive Topic Modeling for Exploring Asynchronous Online Conversations. In Proceedings of the 20th International Conference on Intelligent User Interfaces(Atlanta, Georgia, USA) (IUI ’15). Association for Computing Machinery, New York, NY, USA, 169–180. https://doi.org/10.1145/2678025.2701370
[42]
Enamul Hoque, Shafiq Joty, Luis Marquez, and Giuseppe Carenini. 2017. CQAVis: Visual Text Analytics for Community Question Answering. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (Limassol, Cyprus) (IUI ’17). Association for Computing Machinery, New York, NY, USA, 161–172. https://doi.org/10.1145/3025171.3025210
[43]
Shafiq Joty, Alberto Barrón-Cedeno, Giovanni Da San Martino, Simone Filice, Lluís Màrquez, Alessandro Moschitti, and Preslav Nakov. 2019. Global thread-level inference for comment classification in community question answering. arXiv preprint arXiv:1911.08755(2019).
[44]
Youwen Kang, Zhida Sun, Sitong Wang, Zeyu Huang, Ziming Wu, and Xiaojuan Ma. 2021. MetaMap: Supporting Visual Metaphor Ideation through Multi-Dimensional Example-Based Exploration. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 427, 15 pages. https://doi.org/10.1145/3411764.3445325
[45]
Alboukadel Kassambara. 2021. rstatix: Pipe-Friendly Framework for Basic Statistical Tests. https://CRAN.R-project.org/package=rstatix R package version 0.7.0.
[46]
Avleen Kaur, C Estelle Smith, and Loren Terveen. 2021. Sway Together, Stay Together: Visualizing Spiritual Support Networks Through the SoulGarden Prototype. In Companion Publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing. 84–88.
[47]
Imrul Kayes, Nicolas Kourtellis, Francesco Bonchi, and Adriana Iamnitchi. 2015. Privacy Concerns vs. User Behavior in Community Question Answering. In Proceedings of the 2015 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining 2015 (Paris, France) (ASONAM ’15). Association for Computing Machinery, New York, NY, USA, 681–688. https://doi.org/10.1145/2808797.2809422
[48]
Irni Eliana Khairuddin and Corina Sas. 2019. An Exploration of Bitcoin Mining Practices: Miners’ Trust Challenges and Motivations. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300859
[49]
Dana Khartabil, Christopher Collins, S Wells, Benjamin Bach, and Jessie Kennedy. 2021. Design and Evaluation of Visualization Techniques to Facilitate Argument Exploration. In Computer Graphics Forum, Vol. 40. Wiley Online Library, 447–465.
[50]
Dana Khartabil, S Wells, and Jessie Kennedy. 2016. Large-scale Argument Visualization (LSAV). In EuroVis (Posters). 65–67.
[51]
Soomin Kim, Jinsu Eun, Joseph Seering, and Joonhwan Lee. 2021. Moderator Chatbot for Deliberative Discussion: Effects of Discussion Structure and Discussant Facilitation. Proc. ACM Hum.-Comput. Interact. 5, CSCW1, Article 87 (apr 2021), 26 pages. https://doi.org/10.1145/3449161
[52]
Maximilian Klein, Jinhao Zhao, Jiajun Ni, Isaac Johnson, Benjamin Mako Hill, and Haiyi Zhu. 2017. Quality Standards, Service Orientation, and Power in Airbnb and Couchsurfing. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 58 (dec 2017), 21 pages. https://doi.org/10.1145/3134693
[53]
Yubo Kou and Colin M. Gray. 2017. Supporting Distributed Critique through Interpretation and Sense-Making in an Online Creative Community. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 60 (dec 2017), 18 pages. https://doi.org/10.1145/3134695
[54]
Yubo Kou and Colin M. Gray. 2018. Towards Professionalization in an Online Community of Emerging Occupation: Discourses among UX Practitioners. In Proceedings of the 2018 ACM Conference on Supporting Groupwork (Sanibel Island, Florida, USA) (GROUP ’18). Association for Computing Machinery, New York, NY, USA, 322–334. https://doi.org/10.1145/3148330.3148352
[55]
John D. Lafferty, Andrew McCallum, and Fernando C. N. Pereira. 2001. Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data. In Proceedings of the Eighteenth International Conference on Machine Learning(ICML ’01). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 282–289.
[56]
Hui-Min Lai and Tsung Teng Chen. 2014. Knowledge sharing in interest online communities: A comparison of posters and lurkers. Computers in Human Behavior 35 (2014), 295–306.
[57]
Heidi Lam and Patrick Baudisch. 2005. Summary Thumbnails: Readable Overviews for Small Screen Web Browsers. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Portland, Oregon, USA) (CHI ’05). Association for Computing Machinery, New York, NY, USA, 681–690. https://doi.org/10.1145/1054972.1055066
[58]
Cliff Lampe, Rick Wash, Alcides Velasquez, and Elif Ozkaya. 2010. Motivations to Participate in Online Communities. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI ’10). Association for Computing Machinery, New York, NY, USA, 1927–1936. https://doi.org/10.1145/1753326.1753616
[59]
Anne Lauscher, Lily Ng, Courtney Napoles, and Joel Tetreault. 2020. Rhetoric, logic, and dialectic: Advancing theory-based argument quality assessment in natural language processing. arXiv preprint arXiv:2006.00843(2020).
[60]
Long T Le, Chirag Shah, and Erik Choi. 2017. Bad users or bad content? Breaking the vicious cycle by finding struggling students in community question-answering. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval. 165–174.
[61]
Mike Lewis, Yinhan Liu, Naman Goyal, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Veselin Stoyanov, and Luke Zettlemoyer. 2020. BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. Association for Computational Linguistics, Online, 7871–7880. https://doi.org/10.18653/v1/2020.acl-main.703
[62]
Ang Li, Zheng Yao, Diyi Yang, Chinmay Kulkarni, Rosta Farzan, and Robert E Kraut. 2020. Successful online socialization: lessons from the Wikipedia education program. Proceedings of the ACM on Human-Computer Interaction 4, CSCW1(2020), 1–24.
[63]
Chin-Yew Lin. 2004. Rouge: A package for automatic evaluation of summaries. In Text summarization branches out. 74–81.
[64]
Chengzhong Liu, Zeyu Huang, Dingdong Liu, Shixu Zhou, Zhenhui Peng, and Xiaojuan Ma. 2022. PlanHelper: Supporting Activity Plan Construction with Answer Posts in Community-Based QA Platforms. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 454 (nov 2022), 26 pages. https://doi.org/10.1145/3555555
[65]
Chengzhong Liu, Shixu Zhou, Yuanhao Zhang, Dingdong Liu, Zhenhui Peng, and Xiaojuan Ma. 2022. Exploring the Effects of Self-Mockery to Improve Task-Oriented Chatbot’s Social Intelligence. In Designing Interactive Systems Conference (Virtual Event, Australia) (DIS ’22). Association for Computing Machinery, New York, NY, USA, 1315–1329. https://doi.org/10.1145/3532106.3533461
[66]
Qiaoling Liu, Tomasz Jurczyk, Jinho Choi, and Eugene Agichtein. 2015. Real-Time Community Question Answering: Exploring Content Recommendation and User Notification Strategies. In Proceedings of the 20th International Conference on Intelligent User Interfaces (Atlanta, Georgia, USA) (IUI ’15). Association for Computing Machinery, New York, NY, USA, 50–61. https://doi.org/10.1145/2678025.2701392
[67]
Xingyu Liu, Patrick Carrington, Xiang ’Anthony’ Chen, and Amy Pavel. 2021. What Makes Videos Accessible to Blind and Visually Impaired People?. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI ’21). Association for Computing Machinery, New York, NY, USA, Article 272, 14 pages. https://doi.org/10.1145/3411764.3445233
[68]
Yuanjie Liu, Shasha Li, Yunbo Cao, Chin-Yew Lin, Dingyi Han, and Yong Yu. 2008. Understanding and summarizing answers in community-based question answering services. In Proceedings of the 22nd International Conference on Computational Linguistics (COLING 2008). 497–504.
[69]
Shuai Ma, Taichang Zhou, Fei Nie, and Xiaojuan Ma. 2022. Glancee: An Adaptable System for Instructors to Grasp Student Learning Status in Synchronous Online Classes. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI ’22). Association for Computing Machinery, New York, NY, USA, Article 313, 25 pages. https://doi.org/10.1145/3491102.3517482
[70]
Xiaojuan Ma, Emily Yang, and Pascale Fung. 2019. Exploring Perceived Emotional Intelligence of Personality-Driven Virtual Agents in Handling User Challenges. In The World Wide Web Conference (San Francisco, CA, USA) (WWW ’19). Association for Computing Machinery, New York, NY, USA, 1222–1233. https://doi.org/10.1145/3308558.3313400
[71]
Jakub Macina, Ivan Srba, Joseph Jay Williams, and Maria Bielikova. 2017. Educational question routing in online student communities. In Proceedings of the eleventh ACM conference on recommender systems. 47–55.
[72]
Diane Maloney-Krichmar and Jenny Preece. 2005. A Multilevel Analysis of Sociability, Usability, and Community Dynamics in an Online Health Community. ACM Trans. Comput.-Hum. Interact. 12, 2 (jun 2005), 201–232. https://doi.org/10.1145/1067860.1067864
[73]
Rob McCarney, James Warner, Steve Iliffe, Robbert Van Haselen, Mark Griffin, and Peter Fisher. 2007. The Hawthorne Effect: a randomised, controlled trial. BMC medical research methodology 7, 1 (2007), 1–8.
[74]
Leland McInnes. 2018. Performance comparison of dimension reduction implementations. https://umap-learn.readthedocs.io/en/latest/performance.html
[75]
Leland McInnes. 2018. Using UMAP for clustering. https://umap-learn.readthedocs.io/en/latest/clustering.html
[76]
David W McMillan. 1996. Sense of community. Journal of community psychology 24, 4 (1996), 315–325.
[77]
Christian Meurisch, Cristina A. Mihale-Wilson, Adrian Hawlitschek, Florian Giger, Florian Müller, Oliver Hinz, and Max Mühlhäuser. 2020. Exploring User Expectations of Proactive AI Systems. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 4, Article 146 (dec 2020), 22 pages. https://doi.org/10.1145/3432193
[78]
Jaya Narain, Tina Quach, Monique Davey, Hae Won Park, Cynthia Breazeal, and Rosalind Picard. 2020. Promoting Wellbeing with Sunny, a Chatbot That Facilitates Positive Messages within Social Groups. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI EA ’20). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/3334480.3383062
[79]
Lily Ng, Anne Lauscher, Joel Tetreault, and Courtney Napoles. 2020. Creating a domain-diverse corpus for theory-based argument quality assessment. arXiv preprint arXiv:2011.01589(2020).
[80]
Suphakit Niwattanakul, Jatsada Singthongchai, Ekkachai Naenudorn, and Supachanun Wanapu. 2013. Using of Jaccard coefficient for keywords similarity. In Proceedings of the international multiconference of engineers and computer scientists, Vol. 1. 380–384.
[81]
Blair Nonnecke and Jenny Preece. 2000. Lurker Demographics: Counting the Silent. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (The Hague, The Netherlands) (CHI ’00). Association for Computing Machinery, New York, NY, USA, 73–80. https://doi.org/10.1145/332040.332409
[82]
Heather O’Brien. 2016. Theoretical Perspectives on User Engagement. Springer International Publishing, Cham, 1–26. https://doi.org/10.1007/978-3-319-27446-1_1
[83]
Heather L. O’Brien and Elaine G. Toms. 2008. What is User Engagement? A Conceptual Framework for Defining User Engagement with Technology. J. Am. Soc. Inf. Sci. Technol. 59, 6 (apr 2008), 938–955.
[84]
Harri Oinas-Kukkonen. 2013. A foundation for the study of behavior change support systems. Personal and ubiquitous computing 17, 6 (2013), 1223–1235.
[85]
Nigini Oliveira, Michael Muller, Nazareno Andrade, and Katharina Reinecke. 2018. The Exchange in StackExchange: Divergences between Stack Overflow and Its Culturally Diverse Participants. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 130 (nov 2018), 22 pages. https://doi.org/10.1145/3274399
[86]
Thomas Olsson. 2014. Layers of User Expectations of Future Technologies: An Early Framework. In CHI ’14 Extended Abstracts on Human Factors in Computing Systems (Toronto, Ontario, Canada) (CHI EA ’14). Association for Computing Machinery, New York, NY, USA, 1957–1962. https://doi.org/10.1145/2559206.2581225
[87]
Adi Omari, David Carmel, Oleg Rokhlenko, and Idan Szpektor. 2016. Novelty based ranking of human answers for community questions. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 215–224.
[88]
Ina O’Murchu, John G Breslin, and Stefan Decker. 2004. Online Social and Business Networking Communities. In ECAI Workshop on Application of Semantic Web Technologies to Web Communities, Vol. 107.
[89]
Deokgun Park, Simranjit Sachar, Nicholas Diakopoulos, and Niklas Elmqvist. 2016. Supporting Comment Moderators in Identifying High Quality Online News Comments. Association for Computing Machinery, New York, NY, USA, 1114–1125. https://doi.org/10.1145/2858036.2858389
[90]
Sunjeong Park and Youn-kyung Lim. 2020. Investigating User Expectations on the Roles of Family-Shared AI Speakers. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376450
[91]
Sharoda A Paul, Lichan Hong, and Ed H Chi. 2012. Who is authoritative? understanding reputation mechanisms in quora. arXiv preprint arXiv:1204.3724(2012).
[92]
F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.
[93]
Zhenhui Peng, Yuzhi Liu, Hanqi Zhou, Zuyu Xu, and Xiaojuan Ma. 2022. CReBot: Exploring interactive question prompts for critical paper reading. 167 (2022), 102898. https://doi.org/10.1016/j.ijhcs.2022.102898
[94]
Laura R. Pina, Carmen Gonzalez, Carolina Nieto, Wendy Roldan, Edgar Onofre, and Jason C. Yip. 2018. How Latino Children in the U.S. Engage in Collaborative Online Information Problem Solving with Their Families. Proc. ACM Hum.-Comput. Interact. 2, CSCW, Article 140 (nov 2018), 26 pages. https://doi.org/10.1145/3274409
[95]
Pavlin G Poličar, Martin Stražar, and Blaž Zupan. 2019. openTSNE: a modular Python library for t-SNE dimensionality reduction and embedding. BioRxiv (2019), 731877.
[96]
Alec Radford, Karthik Narasimhan, Tim Salimans, Ilya Sutskever, 2018. Improving language understanding by generative pre-training. (2018).
[97]
S. Rafaeli, G. Ravid, and V. Soroka. 2004. De-lurking in virtual communities: a social communication network approach to measuring the effects of social and cultural capital. In 37th Annual Hawaii International Conference on System Sciences, 2004. Proceedings of the. 10 pp.–. https://doi.org/10.1109/HICSS.2004.1265478
[98]
Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics. https://arxiv.org/abs/1908.10084
[99]
Amanda Ross and Victor L Willson. 2017. Paired samples T-test. In Basic and advanced statistical tests. Springer, 17–19.
[100]
Dana Rotman, Jennifer Golbeck, and Jennifer Preece. 2009. The Community is Where the Rapport is – on Sense and Structure in the Youtube Community. In Proceedings of the Fourth International Conference on Communities and Technologies (University Park, PA, USA) (C&T ’09). Association for Computing Machinery, New York, NY, USA, 41–50. https://doi.org/10.1145/1556460.1556467
[101]
Pradeep K Roy, Jyoti P Singh, Abdullah M Baabdullah, Hatice Kizgin, and Nripendra P Rana. 2018. Identifying reputation collectors in community question answering (CQA) sites: Exploring the dark side of social media. International Journal of Information Management 42 (2018), 25–35.
[102]
Sherry Ruan, Liwei Jiang, Justin Xu, Bryce Joe-Kun Tham, Zhengneng Qiu, Yeshuang Zhu, Elizabeth L. Murnane, Emma Brunskill, and James A. Landay. 2019. QuizBot: A Dialogue-Based Adaptive Learning System for Factual Knowledge. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300587
[103]
Tetsuya Sakai. 2017. The probability that your hypothesis is correct, credible intervals, and effect sizes for IR evaluation. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 25–34.
[104]
Amit Sarkar and G. Srinivasaraghavan. 2018. Contextual Web Summarization: A Supervised Ranking Approach. In Companion Proceedings of the The Web Conference 2018 (Lyon, France) (WWW ’18). International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, 105–106. https://doi.org/10.1145/3184558.3186951
[105]
Christian Severin Sauer and Thomas Roth-Berghofer. 2012. Solution Mining for Specific Contextualised Problems: Towards an Approach for Experience Mining. In Proceedings of the 21st International Conference on World Wide Web (Lyon, France) (WWW ’12 Companion). Association for Computing Machinery, New York, NY, USA, 729–738. https://doi.org/10.1145/2187980.2188193
[106]
Benjamin Saunders, Julius Sim, Tom Kingstone, Shula Baker, Jackie Waterfield, Bernadette Bartlam, Heather Burroughs, and Clare Jinks. 2018. Saturation in Qualitative Research: Exploring Its Conceptualization and Operationalization. 52, 4 (2018), 1893–1907. https://doi.org/10.1007/s11135-017-0574-8 29937585
[107]
Samuel Sanford Shapiro and Martin B Wilk. 1965. An analysis of variance test for normality (complete samples). Biometrika 52, 3/4 (1965), 591–611.
[108]
Donghoon Shin, Subeen Park, Esther Hehsun Kim, Soomin Kim, Jinwook Seo, and Hwajung Hong. 2022. Exploring the Effects of AI-Assisted Emotional Support Processes in Online Mental Health Community. In Extended Abstracts of the 2022 CHI Conference on Human Factors in Computing Systems (New Orleans, LA, USA) (CHI EA ’22). Association for Computing Machinery, New York, NY, USA, Article 300, 7 pages. https://doi.org/10.1145/3491101.3519854
[109]
Yoshiyuki Shoji, Sumio Fujita, Akira Tajima, and Katsumi Tanaka. 2015. Who stays longer in community qa media?-user behavior analysis in cqa. In International Conference on Social Informatics. Springer, 33–48.
[110]
Alison Smith-Renner, Ron Fan, Melissa Birchfield, Tongshuang Wu, Jordan Boyd-Graber, Daniel S. Weld, and Leah Findlater. 2020. No Explainability without Accountability: An Empirical Study of Explanations and Feedback in Interactive ML. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3313831.3376624
[111]
Hongya Song, Zhaochun Ren, Shangsong Liang, Piji Li, Jun Ma, and Maarten de Rijke. 2017. Summarizing answers in non-factoid community question-answering. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. 405–414.
[112]
Ivan Srba and Maria Bielikova. 2015. Askalot: community question answering as a means for knowledge sharing in an educational organization. In Proceedings of the 18th ACM conference companion on computer supported cooperative work & social computing. 179–182.
[113]
Ivan Srba and Maria Bielikova. 2016. A comprehensive survey and classification of approaches for community question answering. ACM Transactions on the Web (TWEB) 10, 3 (2016), 1–63.
[114]
Ivan Srba, Marek Grznar, and Maria Bielikova. 2015. Utilizing non-qa data to improve questions routing for users with low qa activity in cqa. In Proceedings of the 2015 IEEE/ACM international conference on advances in social networks analysis and mining 2015. 129–136.
[115]
Christian Stab and Iryna Gurevych. 2014. Identifying argumentative discourse structures in persuasive essays. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 46–56.
[116]
Victor J Strecher, Brenda McEvoy DeVellis, Marshall H Becker, and Irwin M Rosenstock. 1986. The role of self-efficacy in achieving health behavior change. Health education quarterly 13, 1 (1986), 73–92.
[117]
Gail M Sullivan and Richard Feinn. 2012. Using effect size—or why the P value is not enough. Journal of graduate medical education 4, 3 (2012), 279–282.
[118]
Na Sun, Patrick Pei-Luen Rau, and Liang Ma. 2014. Understanding lurkers in online communities: A literature review. Computers in Human Behavior 38 (2014), 110–117.
[119]
Shweta Suran, Vishwajeet Pattanaik, and Dirk Draheim. 2020. Frameworks for collective intelligence: A systematic literature review. ACM Computing Surveys (CSUR) 53, 1 (2020), 1–36.
[120]
Idan Szpektor, Yoelle Maarek, and Dan Pelleg. 2013. When relevance is not enough: Promoting diversity and freshness in personalized question recommendation. In Proceedings of the 22nd international conference on World Wide Web. 1249–1260.
[121]
Feng Tian, Xiangmin Fan, Junjun Fan, Yicheng Zhu, Jing Gao, Dakuo Wang, Xiaojun Bi, and Hongan Wang. 2019. What Can Gestures Tell? Detecting Motor Impairment in Early Parkinson’s from Common Touch Gestural Interactions. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3290605.3300313
[122]
Sunny Tian, Amy X. Zhang, and David Karger. 2021. A System for Interleaving Discussion and Summarization in Online Collaboration. Proc. ACM Hum.-Comput. Interact. 4, CSCW3, Article 241 (jan 2021), 27 pages. https://doi.org/10.1145/3432940
[123]
Maciej Tomczak and Ewa Tomczak. 2014. The need to report effect size estimates revisited. An overview of some recommended measures of effect size. Trends in sport sciences 1, 21 (2014), 19–25.
[124]
Thiemo Wambsganss, Tobias Kueng, Matthias Soellner, and Jan Marco Leimeister. 2021. ArgueTutor: An adaptive dialog-based learning system for argumentation skills. In Proceedings of the 2021 CHI conference on human factors in computing systems. 1–13.
[125]
Thiemo Wambsganss, Christina Niklaus, Matthias Cetto, Matthias Söllner, Siegfried Handschuh, and Jan Marco Leimeister. 2020. AL: an adaptive learning support system for argumentation skills. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–14.
[126]
Baoxun Wang, Xiaolong Wang, Cheng-Jie Sun, Bingquan Liu, and Lin Sun. 2010. Modeling semantic relevance for question-answer pairs in web social communities. In Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics. 1230–1238.
[127]
Gang Wang, Konark Gill, Manish Mohanlal, Haitao Zheng, and Ben Y Zhao. 2013. Wisdom in the social crowd: an analysis of quora. In Proceedings of the 22nd international conference on World Wide Web. 1341–1352.
[128]
Furu Wei, Shixia Liu, Yangqiu Song, Shimei Pan, Michelle X. Zhou, Weihong Qian, Lei Shi, Li Tan, and Qiang Zhang. 2010. TIARA: A Visual Exploratory Text Analytic System. In Proceedings of the 16th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (Washington, DC, USA) (KDD ’10). Association for Computing Machinery, New York, NY, USA, 153–162. https://doi.org/10.1145/1835804.1835827
[129]
Stephan Weibelzahl, Alexandros Paramythis, and Judith Masthoff. 2020. Evaluation of Adaptive Systems. In Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization (Genoa, Italy) (UMAP ’20). Association for Computing Machinery, New York, NY, USA, 394–395. https://doi.org/10.1145/3340631.3398668
[130]
Rainer Winkler, Sebastian Hobert, Antti Salovaara, Matthias Söllner, and Jan Marco Leimeister. 2020. Sara, the Lecturer: Improving Learning in Online Education with a Scaffolding-Based Conversational Agent. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI ’20). Association for Computing Machinery, New York, NY, USA, 1–14. https://doi.org/10.1145/3313831.3376781
[131]
Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Rémi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander M. Rush. 2020. Transformers: State-of-the-Art Natural Language Processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations. Association for Computational Linguistics, Online, 38–45. https://www.aclweb.org/anthology/2020.emnlp-demos.6
[132]
Robert F Woolson. 2007. Wilcoxon signed-rank test. Wiley encyclopedia of clinical trials(2007), 1–3.
[133]
Meng Xia, Mingfei Sun, Huan Wei, Qing Chen, Yong Wang, Lei Shi, Huamin Qu, and Xiaojuan Ma. 2019. PeerLens: Peer-inspired Interactive Learning Path Planning in Online Question Pool. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2019-05-02) (CHI ’19). Association for Computing Machinery, 1–12. https://doi.org/10.1145/3290605.3300864
[134]
Meng Xia, Qian Zhu, Xingbo Wang, Fei Nie, Huamin Qu, and Xiaojuan Ma. 2022. Persua: A Visual Interactive System to Enhance the Persuasiveness of Arguments in Online Discussion. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 319 (nov 2022), 30 pages. https://doi.org/10.1145/3555210
[135]
Kun Yu, Shlomo Berkovsky, Ronnie Taib, Jianlong Zhou, and Fang Chen. 2019. Do I Trust My Machine Teammate? An Investigation from Perception to Decision. In Proceedings of the 24th International Conference on Intelligent User Interfaces (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 460–468. https://doi.org/10.1145/3301275.3302277
[136]
Sha Yuan, Yu Zhang, Jie Tang, Wendy Hall, and Juan Bautista Cabotà. 2020. Expert finding in community question answering: a review. Artificial Intelligence Review 53, 2 (2020), 843–874.
[137]
Amy X Zhang, Bryan Culbertson, and Praveen Paritosh. 2017. Characterizing online discussion using coarse discourse sequences. In Eleventh International AAAI Conference on Web and Social Media.
[138]
Jingqing Zhang, Yao Zhao, Mohammad Saleh, and Peter Liu. 2020. Pegasus: Pre-training with extracted gap-sentences for abstractive summarization. In International Conference on Machine Learning. PMLR, 11328–11339.
[139]
Zhi-Min Zhou, Man Lan, Zheng-Yu Niu, and Yue Lu. 2012. Exploiting user profile information for answer ranking in cqa. In Proceedings of the 21st international conference on World Wide Web. 767–774.

Cited By

View all
  • (2024)Engage Wider Audience or Facilitate Quality Answers? a Mixed-methods Analysis of Questioning Strategies for Research Sensemaking on a Community Q&A SiteProceedings of the ACM on Human-Computer Interaction10.1145/36373278:CSCW1(1-31)Online publication date: 26-Apr-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems
April 2023
14911 pages
ISBN:9781450394215
DOI:10.1145/3544548
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 19 April 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. CQA Platforms
  2. Collective Arguments
  3. Lurker Support

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Funding Sources

  • General Research Fund (GRF), Hong Kong

Conference

CHI '23
Sponsor:

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)611
  • Downloads (Last 6 weeks)101
Reflects downloads up to 23 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Engage Wider Audience or Facilitate Quality Answers? a Mixed-methods Analysis of Questioning Strategies for Research Sensemaking on a Community Q&A SiteProceedings of the ACM on Human-Computer Interaction10.1145/36373278:CSCW1(1-31)Online publication date: 26-Apr-2024

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Full Text

View this article in Full Text.

Full Text

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media