Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Bridging Fluency Disparity between Native and Nonnative Speakers in Multilingual Multiparty Collaboration Using a Clarification Agent

Published: 18 October 2021 Publication History

Abstract

Multiparty collaboration using a common language is often challenging for nonnative speakers (NNS). Conversation can move forward rapidly, with terms and references unfamiliar to NNS often going unexplained because NNS do not request clarification due to cognitive overload or face concerns. Language difficulties may further lead to NNS having a low level of participation in a conversation, which could be a loss for multilingual teams. To help NNS resolve potential confusions due to unfamiliar language use without risking face concerns, we created a conversation agent that asked clarification questions intended to help NNS follow and participate in multiparty conversations. We conducted a within-subjects laboratory experiment with 17 triads of 2 NS and 1 NNS, who performed a series of collaborative tasks under three conditions: a) no agent, b) a high-level agent that resembles a NNS with good command of English, and c) a low-level agent that resembles a NNS with poor English skills. Results suggest that NS made significantly more clarifications in both agent conditions than without an agent. In the high-level agent condition, NNS reported an increase in understanding after the agent's interruption and spoke significantly more. Further, NNS evaluated their communication competence in English highest in the low-level agent condition and lowest in the control condition. Our findings suggest several directions to improve the tool to better facilitate multilingual multiparty communication.

References

[1]
Albert Bandura. 1977. Social Learning Theory. Englewood Cliffs, NJ: Prentice-Hall.
[2]
Albert Bandura. 1989. Human Agency in Social Cognitive Theory. American Psychologist. 44, 9: 1175--1184.
[3]
Melissa Baralt and Laura Gurzynski-Weiss. 2011. Comparing learners' state anxiety during task-based interaction in computer-mediated and face-to-face communication. Language Teaching Research 15, 2: 201--229. https://doi.org/10.1177/0265532210388717
[4]
Hart Blanton. 2013. Evaluating the self in the context of another: The three-selves model of social comparison assimilation and contrast. Cognitive social psychology. Psychology Press: 79--91.
[5]
Xun Cao, Naomi Yamashita, Toru Ishida. 2016. Investigating the impact of automated transcripts on non-native speakers' listening comprehension. Proceedings of the 18th ACM International Conference on Multimodal Interaction (Tokyo Japan, Oct. 2016), 121--128. https://doi.org/10.1145/2993148.2993161
[6]
Jean Carletta, Amy Isard, Stephen Isard, Jacqueline C. Kowtko, Gwyneth Doherty-Sneddon, and Anne H. Anderson. 1997. The reliability of a dialogue structure coding scheme. Computational Linguistics, Association for Computational Linguistics.
[7]
Patrick Chambres and Pierre -Jean Marescaux. 1998. Fictitious social position of competence, and performance in a foreign-language interaction situation: An experimental approach. European Journal of Psychology of Education 13, 3: 411--430.
[8]
Herbert H. Clark and Susan E. Brennan. 2001. Grounding in communication. In L.B. Resnick, J.M. Levine & S.D. Teasley (Eds.) Perspectives on Socially Shared Cognition (pp. 127--149). Washington, DC: American Psychological Association.
[9]
Herbert H. Clark and Edward F. Schaefer. 1989. Contributing to discourse. Cognitive Science, 13(2), 259--294.
[10]
Sunny Consolvo, David W. McDonald, and James A. Landay. 2009. Theory-driven design strategies for technologies that support behavior change in everyday life. Proceedings of SIGCHI Conference on Human Factors in Computing Systems . ACM. https://doi.org/10.1145/1518701.1518766
[11]
Peter. J. Costa, (2014). Truncated outlier filtering. Journal of Biopharmaceutical Statistics, 24(5), 1115--1129. https://doi.org/10.1080/10543406.2014.926366
[12]
Pino Cutrone. 2014. A cross-cultural examination of the backchannel behavior of Japanese and Americans: Considerations for Japanese EFL learners. Intercultural Pragmatics, 11(1): 83--120. https://doi.org/10.1515/ip-2014-0004
[13]
Joan Morris DiMicco, Anna Pandolfo, and Walter Bender. 2004. Influencing group participation with a shared display. In Proceedings of the 2004 ACM conference on Computer supported cooperative work (CSCW '04). ACM, New York, NY, USA, 614--623.
[14]
Wen Duan, Naomi Yamashita, and Susan R. Fussell. 2019. Increasing Native Speakers' Awareness of the Need to Slow Down in Multilingual Conversations Using a Real-Time Speech Speedometer. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 171 (November 2019), 25 pages.
[15]
Wen Duan, Naomi Yamashita, Sun Young Hwang, and Susan R. Fussell. 2018. "Let Me Ask Them to Clarify If You Don' t Want To"- A Clarification Agent for Nonnative Speakers. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems: 1--6. https://doi.org/10.1145/3170427.3188600
[16]
Wen Duan and Susan R. Fussell. 2021. Understanding and Identifying Design Opportunities for Facilitating Humorous Interactions in Multilingual Multicultural Contexts. Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama Japan, May 2021), 1--6. https://doi.org/10.1145/3411763.3451668
[17]
Echenique, A. et al. 2014. Effects of video and text support on grounding in multilingual multiparty audio conferencing. In Proceedings of the 5th ACM international conference on Collaboration across boundaries: culture, distance & technology - CABS '14 (Kyoto, Japan, 2014), 73--81. https://doi.org/10.1145/2631488.2631497
[18]
Arash Eshghi. and Patrick G.T. Healey. 2016. Collective Contexts in Conversation: Grounding by Proxy. Cognitive Science. 40, 2 (Mar. 2016), 299--324.
[19]
Russell H. Fazio. (1990). A practical guide to the use of response latency in social psychological research. In C. Hendrick & M. S. Clark (Eds.), Review of personality and social psychology: Vol. 11. Research methods in personality and social psychology (pp. 74--97). Newbury Park, CA: Sage.
[20]
Alan J. Feely and Anne-Wil Harzing. 2003. Language management in multinational companies. Cross-Cultural Management: An International Journal: 10, 2: 37--52. https://doi.org/10.1108/13527600310797586
[21]
Leon Festinger. 1954. A theory of social comparison processes. Human Relations, 7: 117--140.
[22]
BJ Fogg and Clifford Nass. 1997. How Users Reciprocate to Computers: An experiment that demonstrates behavior change. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '97. https://doi.org/10.1145/1120212.1120419
[23]
Cindy Gallois, Tania Ogay, and Howard Giles. 2005. Communication accommodation theory: A look back and a look ahead. In W.B. Gudykunst (Ed.) Theorizing about Intercultural Communication: 121--148. Thousand Oaks: Sage.
[24]
Ge Gao, Bin Xu, David Hau, Zheng Yao, Dan Cosley, and Susan R. Fussell. 2015. Two is Better Than One": Improving Multilingual Collaboration by Giving Two Machine Translation Outputs. CSCW '15 Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing: 852--863. https://doi.org/10.1145/2675133.2675197
[25]
Ge Gao, Naomi Yamashita, Ari Hautasaari, Andy Echenique, and Susan R. Fussell. 2014. Effects of public vs. private automated transcripts on multiparty communication between native and non-native English speakers. Proceedings of the 2014 ACM Conference on Human Factors in Computing Systems: 843--852. https://doi.org/10.1145/2556288.2557303
[26]
Ge Gao, Naomi Yamashita, Ari Hautasaari, and Susan R. Fussell. 2015. Improving multilingual collaboration by displaying how non-native speakers use automated transcripts and bilingual dictionaries. In Proc. CHI 2015, 3463--3472. https://doi.org/10.1145/2702123.2702498
[27]
J. P. Gerber, Ladd Wheeler, and Jerry Suls. 2018. A social comparison theory meta-analysis 60+ years on. Psychological Bulletin 144, 2: 177--197. https://doi.org/10.1037/bul0000127
[28]
Barney G. Glaser and Anselm L. Strauss. 1967. The Discovery of Grounded Theory: strategies for qualitative research. Aldine Publishing Company, Hawthorne, NY.
[29]
Sandra G. Hart and Lowell E. Staveland. 1998. Development of NASA-TLX: Results of empirical and theoretical research. Advances in Psychology, 52: 139--183.
[30]
Anne-Wil Harzing and Alan J. Feely. 2008. The language barrier and its implications for HQ-subsidiary relationships. Cross Cultural Management: An International Journal, 15(1): 49--61. https://doi.org/10.1108/13527600810848827
[31]
Helen Ai He, Naomi Yamashita, Chat Wacharamanotham, Andrea B. Horn, Jenny Schmid, and Elaine M. Huang. 2017. Two Sides to Every Story: Mitigating Intercultural Conflict through Automated Feedback and Shared Self-Reflections in Global Virtual Teams. PACM Human-Computer Interaction CSCW, Article 51 (December 2017) 1: 21 pages.
[32]
Pamela J. Hinds, Tsedal B. Neeley, and Catherine Durnell Cramton. 2014. Language as a lightning rod: Power contests, emotion regulation, and subgroup dynamics in global teams. Journal of International Business Studies, 45(5): 536--561. https://doi.org/10.1057/jibs.2013.62
[33]
Isbister, K. et al. 2000. Helper agent: designing an assistant for human-human interaction in a virtual meeting space. Proceedings of the SIGCHI conference on Human factors in computing systems CHI '00 (The Hague, The Netherlands, 2000), 57--64. https://doi.org/10.1145/332040.332407
[34]
Kim, S. et al. 2020. Bot in the Bunch: Facilitating Group Chat Discussion by Improving Efficiency and Participation with a Chatbot. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu HI USA, Apr. 2020), 1--13. https://doi.org/10.1145/3313831.3376785
[35]
Han Z. Li. 1999. Grounding and information communication in intercultural and intracultural dyadic discourse. Discourse Processes 28, 3: 195--215. https://doi.org/10.1080/01638539909545081
[36]
Han Z. Li, Young-ok Yum, Robin Yates, Laura Aguilera, Ying Mao, and Yue Zheng. 2005. Interruption and Involvement in Discourse: Can Intercultural Interlocutors be Trained? Journal of lntercultural Communication Research, 34(4): 233--254.
[37]
Peter D. Macintyre, Richard Clément, Zoltán Dörnyei, and Kimberly A. Noels. 1998. Conceptualizing Willingness to Communicate in a L2: A Situational Model of L2 Confidence and Affiliation. The Modern Language Journal 82, 4: 545--562. https://doi.org/10.1111/j.1540--4781.1998.tb05543.x
[38]
Peter D. Macintyre. 2007. Willingness to Communicate in the Second Language: Understanding the Decision to Speak as a Volitional Process. The Modern Language Journal 91, 4: 564--576. https://doi.org/10.1111/j.1540--4781.2007.00623.x
[39]
Joseph Edward McGrath. 1984. Groups: interaction and performance. Prentice-Hall, Englewood Cliffs, NJ.
[40]
Brian E. Mennecke, Joseph S. Valacich, and Bradley C. Wheeler. 2000. The Effects of Media and Task on User Performance: A Test of the Task-Media Fit Hypothesis. Group Decision and Negotiation, 9(6): 507--529. https://doi.org/10.1023/A:1008770106779
[41]
Sarah Mercer. 2011. Towards an understanding of language learner self-concept. Springer, Dordrecht.
[42]
Nicole Mills, Frank Pajares, and Carol Herron. 2006. A Reevaluation of the Role of Anxiety: Self-Efficacy, Anxiety, and Their Relation to Reading and Listening Proficiency. Foreign Language Annals 39, 2: 276--295. https://doi.org/10.1111/j.1944--9720.2006.tb02266.x
[43]
Clifford Nass, B.J. Fogg, and Youngme Moon. 1996. Can computers be teammates? International Journal of Human-Computer Studies 45, 6: 669--678. https://doi.org/10.1006/ijhc.1996.0073
[44]
Clifford Nass and Eun-Ju Lee. 1998. Does the ethnicity of a computer agent matter? An experimental comparison of human-computer interaction and computer-mediated communication. Proceedings of the 1998 Workshop on Embodied Conversational Characters.
[45]
Clifford Nass, Youngme Moon, and Paul Carney. 1999. Are People Polite to Computers? Responses to Computer-Based Interviewing Systems. Journal of Applied Social Psychology 29, 5: 1093--1109. https://doi.org/10.1111/j.1559--1816.1999.tb00142.x
[46]
Clifford Nass, Youngme Moon, B. J. Fogg, Byron Reeves, and Chris Dryer. 1995. Can computer personalities be human personalities? Conference companion on Human factors in computing systems - CHI '95, ACM Press, 228--229. https://doi.org/10.1006/ijhc.1995.1042
[47]
Clifford Nass, Jonathan Steuer, and Ellen R. Tauber. 1994. Computers are social actors. Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '94, ACM.
[48]
Tsedal B. Neeley, Pamela J. Hinds, and Catherine D. Cramton. 2012. The (Un)Hidden Turmoil of Language in Global Collaboration. Organizational Dynamics 41, 3: 236--244.
[49]
Mei-hua Pan, Naomi Yamashita, and Hao-chuan Wang. 2017. Task Rebalancing : Improving Multilingual Communication with Native Speakers - Generated Highlights on Automated Transcripts. Proc. CSCW 2017: 310--321. https://doi.org/10.1145/2998181.2998304
[50]
Aveni Valerie A. Pellegrino. 2005. Study Abroad and Second Language Use: Constructing the Self. Cambridge University Press.
[51]
Damian J. Rivers. 2011. Evaluating the self and the other: Imagined intercultural contact within a ?native-speaker' dependent foreign language context. International Journal of Intercultural Relations 35, 6: 842--852. https://doi.org/10.1016/j.ijintrel.2011.08.003
[52]
Pamela Rogerson-Revell. 2008. Participation and performance in international business meetings. English for Specific Purposes 27, 3: 338--360. https://doi.org/10.1016/j.esp.2008.02.003
[53]
Peter Henry Rossi, & Steven L. Nock. (1982). Measuring social judgments: The factorial survey approach. SAGE publications, Incorporated.
[54]
Harvey Sacks, Emanuel A. Schegloff, and Gail Jefferson. 1974. A Simplest Systematics for the Organization of Turn-Taking for Conversation. Language, 50(4), 696.
[55]
Joseph Seering, Michal Luria, Geoff Kaufman, and Jessica Hammer. 2019. Beyond Dyadic Interactions: Considering Chatbots as Community Members. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 450. https://doi.org/10.1145/3290605.3300680
[56]
Leslie D. Setlock, and Susan R. Fussell. 2010. What's it worth to you?: the costs and affordances of CMC tools to asian and american users. Proceedings of the 2010 ACM conference on Computer supported cooperative work - CSCW '10 (Savannah, Georgia, USA, 2010), 341--350. https://doi.org/10.1145/1718918.1718979
[57]
Yohtaro Takano and A. Noda. 1993. A temporary decline of thinking ability during foreign language processing. Journal of Cross-Cultural Psychology, 24, 4: 445--462. https://doi.org/10.1177/0022022193244005
[58]
Yohtaro Takano and Akiko Noda. 1995. Interlanguage Dissimilarity Enhances the Decline of Thinking Ability During Foreign Language Processing. Language Learning 45, 4: 657--681. https://doi.org/10.1111/j.1467--1770.1995.tb00457.x.
[59]
Miyuki Takino. 2017. Power in International Business Communication and Linguistic Competence: Analyzing the Experiences of Nonnative Business People Who Use English as a Business Lingua Franca (BELF). International Journal of Business Communication:
[60]
Zsuzsa Tóth. 2011. Foreign language anxiety and advanced EFL learners: an interview study. WoPaLP, 5(19).
[61]
Traeger, M.L. et al. 2020. Vulnerable robots positively shape human conversational dynamics in a human--robot team. Proceedings of the National Academy of Sciences. (Mar. 2020), 201910402.
[62]
Hao-Chuan Wang and Susan R. Fussell. 2010. Groups in groups: conversational similarity in online multicultural multiparty brainstorming. Proceedings of the 2010 ACM conference on Computer supported cooperative work - CSCW '10 (Savannah, Georgia, USA, 2010), 351--360. https://doi.org/10.1145/1718918.1718980.
[63]
Jean. Wong. 2000. The token "yeah" in nonnative speaker English conversation. Research on Language and Social Interaction 33, 1: 39--67. https://doi.org/10.1207/S15327973RLSI3301_2.
[64]
Bin Xu, Ge Gao, Susan R. Fussell, and Dan Cosley. 2014. Improving machine translation by showing two outputs. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: 3743--3746. https://doi.org/10.1145/2556288.2557171
[65]
Naomi Yamashita, Andy Echenique, Toru Ishida, and Ari Hautasaari. 2013. Lost in Transmittance: How Transmission Lag Enhances and Deteriorates Multilingual Collaboration. ACM Conference on Computer Supported Cooperative Work Social Computing Social Computing: 923--934. https://doi.org/10.1145/2441776.2441881
[66]
Chien Wen Yuan, Leslie D. Setlock, Dan Cosley, and Susan R. Fussell. 2013. Understanding Informal Communication in Multilingual Contexts. In CSCW'13: 909--922. https://doi.org/10.1145/2441776.2441880

Cited By

View all
  • (2024)SealMates: Improving Communication in Video Conferencing using a Collective Behavior-Driven AvatarProceedings of the ACM on Human-Computer Interaction10.1145/36373958:CSCW1(1-23)Online publication date: 26-Apr-2024
  • (2024)A Taxonomy for Human-LLM Interaction Modes: An Initial ExplorationExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650786(1-11)Online publication date: 11-May-2024
  • (2024)The Sound of Support: Gendered Voice Agent as Support to Minority Teammates in Gender-Imbalanced TeamProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642202(1-22)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. Bridging Fluency Disparity between Native and Nonnative Speakers in Multilingual Multiparty Collaboration Using a Clarification Agent
        Index terms have been assigned to the content through auto-classification.

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image Proceedings of the ACM on Human-Computer Interaction
        Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW2
        CSCW2
        October 2021
        5376 pages
        EISSN:2573-0142
        DOI:10.1145/3493286
        Issue’s Table of Contents
        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 18 October 2021
        Published in PACMHCI Volume 5, Issue CSCW2

        Permissions

        Request permissions for this article.

        Check for updates

        Author Tags

        1. computer-mediated communication
        2. conversation agent
        3. multilingual teams
        4. nonnative speakers

        Qualifiers

        • Research-article

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • Downloads (Last 12 months)130
        • Downloads (Last 6 weeks)16
        Reflects downloads up to 02 Oct 2024

        Other Metrics

        Citations

        Cited By

        View all
        • (2024)SealMates: Improving Communication in Video Conferencing using a Collective Behavior-Driven AvatarProceedings of the ACM on Human-Computer Interaction10.1145/36373958:CSCW1(1-23)Online publication date: 26-Apr-2024
        • (2024)A Taxonomy for Human-LLM Interaction Modes: An Initial ExplorationExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650786(1-11)Online publication date: 11-May-2024
        • (2024)The Sound of Support: Gendered Voice Agent as Support to Minority Teammates in Gender-Imbalanced TeamProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642202(1-22)Online publication date: 11-May-2024
        • (2023)Nonverbal Human Signals Can Help Autonomous Agents Infer Human Preferences for Their BehaviorProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598652(307-316)Online publication date: 30-May-2023
        • (2023)MeetScript: Designing Transcript-based Interactions to Support Active Participation in Group Video MeetingsProceedings of the ACM on Human-Computer Interaction10.1145/36101967:CSCW2(1-32)Online publication date: 4-Oct-2023
        • (2023)Investigating AI Teammate Communication Strategies and Their Impact in Human-AI Teams for Effective TeamworkProceedings of the ACM on Human-Computer Interaction10.1145/36100727:CSCW2(1-31)Online publication date: 4-Oct-2023
        • (2023)Methodological Middle Spaces: Addressing the Need for Methodological Innovation to Achieve Simultaneous Realism, Control, and Scalability in Experimental Studies of AI-Mediated CommunicationProceedings of the ACM on Human-Computer Interaction10.1145/35795067:CSCW1(1-28)Online publication date: 16-Apr-2023
        • (2023)EaseOut: A Cross-Cultural Study of the Impact of a Conversation Agent on Leaving Video Meetings EarlyHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42283-6_17(297-318)Online publication date: 28-Aug-2023
        • (2022)RF-GaitWireless Communications & Mobile Computing10.1155/2022/36384362022Online publication date: 1-Jan-2022
        • (2022)Perceptions of the Helpfulness of Unexpected Agent AssistanceProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3561915(41-50)Online publication date: 5-Dec-2022
        • Show More Cited By

        View Options

        Get Access

        Login options

        Full Access

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media