extended-abstract

Non-Native Speaker Generation and Perception for Mixed-Cultural Settings

Authors:

David Obremski,

Jean-Luc Lugrin,

Philipp Schaper,

Birgit LugrinAuthors Info & Claims

IVA '19: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents

Pages 105 - 107

https://doi.org/10.1145/3308532.3329427

Published: 01 July 2019 Publication History

Get Access

Abstract

This paper presents an experiment evaluating the effects of virtual agents' language proficiency on whether they are perceived as a native speakers or not. Our first results indicate that beyond 10% word order mistakes and 25% infinitive mistakes, virtual agents are perceived as non-native speakers, even though their appearance and non-verbal behaviour were not altered. We believe these thresholds constitute interesting guidelines possibly simplifying the design of non-native speaker simulations.

References

[1]

R. Aylett, L. Hall, S. Tazzyman, B. Endrass, E. André, C. Ritter, A. Nazir, A. Paiva, G.J. Hofstede, and A. Kappas. 2014. Werewolves, Cheats, and Cultural Sensitivity. In Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS 2014). IFAAMAS, 1085--1092.

Digital Library

Google Scholar

[2]

Markus Bader and Jana Haeussler. 2010. Word order in German: A corpus study. Lingua, Vol. 120, 3 (2010), 717 -- 762. Exploring the Left Periphery.

Crossref

Google Scholar

[3]

Tamás Csehó. 2009. Zum Einfluss des Foreigner Talk auf die Entstehung des Migrantendeutsch. Germanistische Studien, Vol. 7 (2009), 153--168.

Google Scholar

[4]

B. Endrass, E. André, M. Rehm, and Y. Nakano. 2013. Investigating Culture-related Aspects of Behavior for Virtual Characters . Autonomous Agents and Multi-Agent Systems, Vol. 27, 2 (2013), 277--304.

Crossref

Google Scholar

[5]

F. Iacobelli and J. Cassell. 2007. Ethnic Identity and Engagement in Embodied Conversational Agents. In 7th Int. Conf. on Intelligent Virtual Agents (IVA '07). Springer, 57--63.

Digital Library

Google Scholar

[6]

B. Lugrin, B. Eckstein, K. Bergmann, and C. Heindl. 2018. Adapted Foreigner-directed Communication Towards Virtual Agents. In 18th Int. Conf. on Intelligent Virtual Agents (IVA '18). ACM, 59--64.

Digital Library

Google Scholar

[7]

E. Nouri and D. Traum. 2014. Generative models of cultural decision making for virtual agents based on user's reported values. In 14th Int. Conf. on Intelligent Virtual Agents (IVA '14. 310--315.

Google Scholar

Cited By

View all

Obremski DAkuffo OLücke LSemineth MTomiczek SWeichert HLugrin BAgmon NAn BRicci AYeoh W(2023)Reducing Racial Bias by Interacting with Virtual Agents: An Intervention in Virtual RealityProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598707(747-755)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3598707
Obremski DBrucker EFriedrich PLugrin BLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)Behavioural Adaptation Towards Foreign Virtual Agents in VR - the Impact of Non-Native SpeechProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607313(1-3)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607313
Obremski DLugrin BLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)A System for Building Wizard-of-Oz-based Interactive Scenarios with Mixed-Cultural Intelligent Virtual AgentsProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607288(1-4)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607288
Show More Cited By

Index Terms

Non-Native Speaker Generation and Perception for Mixed-Cultural Settings
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Mixed-Cultural Speech for Intelligent Virtual Agents - the Impact of Different Non-Native Accents Using Natural or Synthetic Speech in the English Language
HAI '22: Proceedings of the 10th International Conference on Human-Agent Interaction

This paper presents an exploratory study investigating the impact of non-native accented speech on the perception of Intelligent Virtual Agents (IVAs). In an online study, native English speakers watched a video of an IVA holding a monologue whilst ...
Native speaker perceptions of (non-)native prominence patterns

The proficiency of Spanish learners of Dutch affects perceptions by Dutch listeners.They judge accentedness and nativeness more severely than comprehensibility, and can assess nativeness based solely on pitch accent distributions used to mark focus.They ...
The Lombard intelligibility benefit of native and non-native speech for native and non-native listeners
Highlights
- We compared native English and non-native (Dutch) Lombard and plain speech.
- ...
Abstract
Speech produced in noise (Lombard speech) is more intelligible than speech produced in quiet (plain speech). Previous research on the Lombard intelligibility benefit focused almost entirely on how native speakers produce and perceive ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

IVA '19: Proceedings of the 19th ACM International Conference on Intelligent Virtual Agents

July 2019

282 pages

ISBN:9781450366724

DOI:10.1145/3308532

General Chairs:
Catherine Pelachaud
CNRS-ISIR, Sorbonne Universite, France
,
Jean-Claude Martin
CNRS-LIMSI, Universite Paris Saclay, France
,
Program Chairs:
Hendrik Buschmeier
Bielefeld University, Germany
,
Gale Lucas
University of Southern California, USA
,
Stefan Kopp
Bielefeld University, Germany

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2019

Check for updates

Author Tags

Qualifiers

Extended-abstract

Conference

IVA '19

Sponsor:

SIGAI

IVA '19: ACM International Conference on Intelligent Virtual Agents

July 2 - 5, 2019

Paris, France

Acceptance Rates

IVA '19 Paper Acceptance Rate 15 of 63 submissions, 24%;

Overall Acceptance Rate 53 of 196 submissions, 27%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
166
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Obremski DAkuffo OLücke LSemineth MTomiczek SWeichert HLugrin BAgmon NAn BRicci AYeoh W(2023)Reducing Racial Bias by Interacting with Virtual Agents: An Intervention in Virtual RealityProceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems10.5555/3545946.3598707(747-755)Online publication date: 30-May-2023
https://dl.acm.org/doi/10.5555/3545946.3598707
Obremski DBrucker EFriedrich PLugrin BLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)Behavioural Adaptation Towards Foreign Virtual Agents in VR - the Impact of Non-Native SpeechProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607313(1-3)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607313
Obremski DLugrin BLugrin BLatoschik Mvon Mammen SKopp SPécune FPelachaud C(2023)A System for Building Wizard-of-Oz-based Interactive Scenarios with Mixed-Cultural Intelligent Virtual AgentsProceedings of the 23rd ACM International Conference on Intelligent Virtual Agents10.1145/3570945.3607288(1-4)Online publication date: 19-Sep-2023
https://dl.acm.org/doi/10.1145/3570945.3607288
Obremski DFriedrich PSchaper PLugrin B(2023)Effects of Social Ingroup Cues on Empathy Towards an Intelligent Virtual Agent With a Mixed-Cultural Background2023 11th International Conference on Affective Computing and Intelligent Interaction (ACII)10.1109/ACII59096.2023.10388206(1-8)Online publication date: 10-Sep-2023
https://doi.org/10.1109/ACII59096.2023.10388206
Obremski DHering HFriedrich PLugrin B(2022)Exploratory Study on the Perception of Intelligent Virtual Agents With Non-Native Accents Using Synthetic and Natural Speech in GermanProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556608(15-24)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556608
Obremski DLugrin B(2022)Mixed-Cultural Speech for Mixed-Cultural Users - Natural vs. Synthetic Speech for Virtual AgentsProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3563910(290-292)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3527188.3563910
Obremski DHering HFriedrich PLugrin B(2022)Mixed-Cultural Speech for Intelligent Virtual Agents - the Impact of Different Non-Native Accents Using Natural or Synthetic Speech in the English LanguageProceedings of the 10th International Conference on Human-Agent Interaction10.1145/3527188.3561921(67-75)Online publication date: 5-Dec-2022
https://dl.acm.org/doi/10.1145/3527188.3561921
Lugrin BRehm M(2021)Culture for Socially Interactive AgentsThe Handbook on Socially Interactive Agents10.1145/3477322.3477336(463-494)Online publication date: 10-Sep-2021
https://dl.acm.org/doi/10.1145/3477322.3477336
Obremski DLugrin JSchaper PLugrin B(2021)Non-native speaker perception of Intelligent Virtual Agents in two languages: the impact of amount and type of grammatical mistakesJournal on Multimodal User Interfaces10.1007/s12193-021-00369-9Online publication date: 7-Mar-2021
https://doi.org/10.1007/s12193-021-00369-9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Mixed-Cultural Speech for Intelligent Virtual Agents - the Impact of Different Non-Native Accents Using Natural or Synthetic Speech in the English Language

Native speaker perceptions of (non-)native prominence patterns

The Lombard intelligibility benefit of native and non-native speech for native and non-native listeners

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations