It was analyzed whether an embodied conversational agent (ECA) has specific advantages when emplo... more It was analyzed whether an embodied conversational agent (ECA) has specific advantages when employed with privacy invading technologies such as a biometric security system. The study compares the effects of an ECA interface with the effects of conventional text-based ...
Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation so... more Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation sog. anthropomorpher Schnittstellen. Fokussiert werden dabei Ansätze zur Implementierung nonverbaler Verhaltenskomponenten. Unterschieden werden in diesem ...
Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-media... more Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-mediated communications and reports on two studies demonstrating the person perception effects of varying durations of directed gaze. The avatar platform allows to transmit ...
This article addresses methodological issues in the description and evaluation of nonverbal behav... more This article addresses methodological issues in the description and evaluation of nonverbal behavior (NVB) in cross-cultural studies. Videos containing cultural samples of NVB are of little use when analyzing the effects of NVB across cultures. Since video recordings confuse visible behavior with the physical appearances of the actors, they are likely to activate stereotypes derived from hints about an actor’s culture and ethnicity that override the effects of the observed NVB. As a solution for this problem, we suggest here a unified computerized method for the transcription and experimental simulation of NVB. This approach makes use of advanced 3-D animation tools to generate detailed protocols of NVB that can be used to generate culture-free stimulus materials using standardized virtual characters.
Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes,... more Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes, but so far, beneficial effects have not been consistently demonstrated. The ambiguous results might partly be due to the strong emphasis on cognitive outcomes, which is characteristic for research in teaching and learning. The paper suggests a shift of attention to socio-emotional and relational variables, which might be considered as relevant moderator variables in learning or even as learning outcomes per se, for example, in social learning. In order to achieve this goal, we suggest a systematic account of the results from social psychology and in particular from nonverbal communication research, and findings from studies on the social effects of embodied agents in general. This perspective will include (1) a distinction between static and dynamic aspects of embodiment, such as the visual appearance of agents and their nonverbal behavior, and (2) a more systematic approach concerning the functions of embodiment and nonverbal behavior, such as modeling, discourse and dialogue functions, and socio-emotional effects. A further argument addresses the necessity of complementing outcome measures by process measures, which are sensitive to the tasks and the changing situational demands that occur during learning processes and tutor-learner interaction.
A new approach for the use of computer animation in experimental nonverbal research is introduced... more A new approach for the use of computer animation in experimental nonverbal research is introduced. The method was evaluated in a pilot study comparing video recordings of movement in dyadic interactions with computer animations based on transcripts of the behavior, to determine whether similar impression effects could be obtained. At the core of our development is a software tool allowing for the conversion of so-called position time-series protocols of movement into animation scripts for a professional computer animation platform. Our software combines computer-assisted movement transcription and editing with state-of-the-art 3-D animation technology. We present empirical evidence indicating remarkable overall correspondence between video recordings and computer animations. Due to the lack of facial activity in the computer animations, a decline in visual attention for the face area could be observed, which did not, however, affect the impression ratings.
It was analyzed whether an embodied conversational agent (ECA) has specific advantages when emplo... more It was analyzed whether an embodied conversational agent (ECA) has specific advantages when employed with privacy invading technologies such as a biometric security system. The study compares the effects of an ECA interface with the effects of conventional text-based ...
Abstract The paper deals with social presence effects of embodiment in collaborative net-communic... more Abstract The paper deals with social presence effects of embodiment in collaborative net-communications. Social presence was measured by an extended questionnaire including an item set on emotional closeness of the partners. Principal component analysis ...
The paper introduces a novel methodology for the computer simulation of gaze behavior in net-base... more The paper introduces a novel methodology for the computer simulation of gaze behavior in net-based interactions. 38 female participants interacted using a special avatar platform, allowing for the real-time transmission of nonverbal behavior (head and body movement, gestures, gaze) as captured by motion trackers, eye tracking devices and data gloves. During interaction eye movement and gaze direction of one partner was substituted by computer simulated data. Simulated duration of directed gaze (looking into the face of the vis-a-vis) was varied lasting 2 seconds in one condition and 4 seconds in the other. Mutual person perception (impression ratings) and individual experience of social presence (short questionnaire) were measured as dependent variables. The results underline the validity of the computer animation approach. Consistent with the literature the longer gaze duration was found to cause significantly better evaluations of the interaction partners and higher levels of co-presence.
Gary Bente & Nicole C. Krämer Department of Psychology, University of Cologne Ber... more Gary Bente & Nicole C. Krämer Department of Psychology, University of Cologne Bernhard-Feilchenfeld-Str. 11, D-50969 Köln bente@ uni-koeln. de; nicole. kraemer@ uni-koeln. de Keywords: avatar-based communication, nonverbal communication
Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation so... more Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation sog. anthropomorpher Schnittstellen. Fokussiert werden dabei Ansätze zur Implementierung nonverbaler Verhaltenskomponenten. Unterschieden werden in diesem ...
Impression effects of videotaped dyadic interactions were compared with 3D-computer animations ba... more Impression effects of videotaped dyadic interactions were compared with 3D-computer animations based on movement transcripts of the same interactions to determine whether similar effects could be obtained. One minute sequences of movement behavior taken from three different dyadic interactions were transcribed using the Bernese Coding System (BCS). Descriptive data were converted into animation scripts for professional animation software. Original video documents and computer animations were shown to separate groups of observers and their socio-emotional impressions were assessed on a standard adjective checklist. Only marginal differences were found between the two presentation modes. On the contrary, the data point to remarkable similarities in the impression ratings in both conditions, indicating that most of the relevant social information available to observers in the video recordings was also conveyed by computer animations. Overall, the data suggest that the systematic use of computer animation techniques in nonverbal research deserves further scientific attention.
Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-media... more Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-mediated communications and reports on two studies demonstrating the person perception effects of varying durations of directed gaze. The avatar platform allows to transmit ...
This article addresses methodological issues in the description and evaluation of nonverbal behav... more This article addresses methodological issues in the description and evaluation of nonverbal behavior (NVB) in cross-cultural studies. Videos containing cultural samples of NVB are of little use when analyzing the effects of NVB across cultures. Since video recordings confuse visible behavior with the physical appearances of the actors, they are likely to activate stereotypes derived from hints about an actor’s culture and ethnicity that override the effects of the observed NVB. As a solution for this problem, we suggest here a unified computerized method for the transcription and experimental simulation of NVB. This approach makes use of advanced 3-D animation tools to generate detailed protocols of NVB that can be used to generate culture-free stimulus materials using standardized virtual characters.
First, the specific characteristics of user, task and device were identified as primary determina... more First, the specific characteristics of user, task and device were identified as primary determinants of user acceptance. Second, gender, expert status and cultural background were expected to have a significant influence on attitudes towards biometric devices and their perceived ...
Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes,... more Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes, but so far, beneficial effects have not been consistently demonstrated. The ambiguous results might partly be due to the strong emphasis on cognitive outcomes, which is characteristic for research in teaching and learning. The paper suggests a shift of attention to socio-emotional and relational variables, which might be considered as relevant moderator variables in learning or even as learning outcomes per se, for example, in social learning. In order to achieve this goal, we suggest a systematic account of the results from social psychology and in particular from nonverbal communication research, and findings from studies on the social effects of embodied agents in general. This perspective will include (1) a distinction between static and dynamic aspects of embodiment, such as the visual appearance of agents and their nonverbal behavior, and (2) a more systematic approach concerning the functions of embodiment and nonverbal behavior, such as modeling, discourse and dialogue functions, and socio-emotional effects. A further argument addresses the necessity of complementing outcome measures by process measures, which are sensitive to the tasks and the changing situational demands that occur during learning processes and tutor-learner interaction.
A new approach for the use of computer animation in experimental nonverbal research is introduced... more A new approach for the use of computer animation in experimental nonverbal research is introduced. The method was evaluated in a pilot study comparing video recordings of movement in dyadic interactions with computer animations based on transcripts of the behavior, to determine whether similar impression effects could be obtained. At the core of our development is a software tool allowing for the conversion of so-called position time-series protocols of movement into animation scripts for a professional computer animation platform. Our software combines computer-assisted movement transcription and editing with state-of-the-art 3-D animation technology. We present empirical evidence indicating remarkable overall correspondence between video recordings and computer animations. Due to the lack of facial activity in the computer animations, a decline in visual attention for the face area could be observed, which did not, however, affect the impression ratings.
It was analyzed whether an embodied conversational agent (ECA) has specific advantages when emplo... more It was analyzed whether an embodied conversational agent (ECA) has specific advantages when employed with privacy invading technologies such as a biometric security system. The study compares the effects of an ECA interface with the effects of conventional text-based ...
Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation so... more Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation sog. anthropomorpher Schnittstellen. Fokussiert werden dabei Ansätze zur Implementierung nonverbaler Verhaltenskomponenten. Unterschieden werden in diesem ...
Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-media... more Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-mediated communications and reports on two studies demonstrating the person perception effects of varying durations of directed gaze. The avatar platform allows to transmit ...
This article addresses methodological issues in the description and evaluation of nonverbal behav... more This article addresses methodological issues in the description and evaluation of nonverbal behavior (NVB) in cross-cultural studies. Videos containing cultural samples of NVB are of little use when analyzing the effects of NVB across cultures. Since video recordings confuse visible behavior with the physical appearances of the actors, they are likely to activate stereotypes derived from hints about an actor’s culture and ethnicity that override the effects of the observed NVB. As a solution for this problem, we suggest here a unified computerized method for the transcription and experimental simulation of NVB. This approach makes use of advanced 3-D animation tools to generate detailed protocols of NVB that can be used to generate culture-free stimulus materials using standardized virtual characters.
Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes,... more Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes, but so far, beneficial effects have not been consistently demonstrated. The ambiguous results might partly be due to the strong emphasis on cognitive outcomes, which is characteristic for research in teaching and learning. The paper suggests a shift of attention to socio-emotional and relational variables, which might be considered as relevant moderator variables in learning or even as learning outcomes per se, for example, in social learning. In order to achieve this goal, we suggest a systematic account of the results from social psychology and in particular from nonverbal communication research, and findings from studies on the social effects of embodied agents in general. This perspective will include (1) a distinction between static and dynamic aspects of embodiment, such as the visual appearance of agents and their nonverbal behavior, and (2) a more systematic approach concerning the functions of embodiment and nonverbal behavior, such as modeling, discourse and dialogue functions, and socio-emotional effects. A further argument addresses the necessity of complementing outcome measures by process measures, which are sensitive to the tasks and the changing situational demands that occur during learning processes and tutor-learner interaction.
A new approach for the use of computer animation in experimental nonverbal research is introduced... more A new approach for the use of computer animation in experimental nonverbal research is introduced. The method was evaluated in a pilot study comparing video recordings of movement in dyadic interactions with computer animations based on transcripts of the behavior, to determine whether similar impression effects could be obtained. At the core of our development is a software tool allowing for the conversion of so-called position time-series protocols of movement into animation scripts for a professional computer animation platform. Our software combines computer-assisted movement transcription and editing with state-of-the-art 3-D animation technology. We present empirical evidence indicating remarkable overall correspondence between video recordings and computer animations. Due to the lack of facial activity in the computer animations, a decline in visual attention for the face area could be observed, which did not, however, affect the impression ratings.
It was analyzed whether an embodied conversational agent (ECA) has specific advantages when emplo... more It was analyzed whether an embodied conversational agent (ECA) has specific advantages when employed with privacy invading technologies such as a biometric security system. The study compares the effects of an ECA interface with the effects of conventional text-based ...
Abstract The paper deals with social presence effects of embodiment in collaborative net-communic... more Abstract The paper deals with social presence effects of embodiment in collaborative net-communications. Social presence was measured by an extended questionnaire including an item set on emotional closeness of the partners. Principal component analysis ...
The paper introduces a novel methodology for the computer simulation of gaze behavior in net-base... more The paper introduces a novel methodology for the computer simulation of gaze behavior in net-based interactions. 38 female participants interacted using a special avatar platform, allowing for the real-time transmission of nonverbal behavior (head and body movement, gestures, gaze) as captured by motion trackers, eye tracking devices and data gloves. During interaction eye movement and gaze direction of one partner was substituted by computer simulated data. Simulated duration of directed gaze (looking into the face of the vis-a-vis) was varied lasting 2 seconds in one condition and 4 seconds in the other. Mutual person perception (impression ratings) and individual experience of social presence (short questionnaire) were measured as dependent variables. The results underline the validity of the computer animation approach. Consistent with the literature the longer gaze duration was found to cause significantly better evaluations of the interaction partners and higher levels of co-presence.
Gary Bente & Nicole C. Krämer Department of Psychology, University of Cologne Ber... more Gary Bente & Nicole C. Krämer Department of Psychology, University of Cologne Bernhard-Feilchenfeld-Str. 11, D-50969 Köln bente@ uni-koeln. de; nicole. kraemer@ uni-koeln. de Keywords: avatar-based communication, nonverbal communication
Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation so... more Zusammenfassung Der Beitrag behandelt psychologische Aspekte bei der Gestaltung und Evaluation sog. anthropomorpher Schnittstellen. Fokussiert werden dabei Ansätze zur Implementierung nonverbaler Verhaltenskomponenten. Unterschieden werden in diesem ...
Impression effects of videotaped dyadic interactions were compared with 3D-computer animations ba... more Impression effects of videotaped dyadic interactions were compared with 3D-computer animations based on movement transcripts of the same interactions to determine whether similar effects could be obtained. One minute sequences of movement behavior taken from three different dyadic interactions were transcribed using the Bernese Coding System (BCS). Descriptive data were converted into animation scripts for professional animation software. Original video documents and computer animations were shown to separate groups of observers and their socio-emotional impressions were assessed on a standard adjective checklist. Only marginal differences were found between the two presentation modes. On the contrary, the data point to remarkable similarities in the impression ratings in both conditions, indicating that most of the relevant social information available to observers in the video recordings was also conveyed by computer animations. Overall, the data suggest that the systematic use of computer animation techniques in nonverbal research deserves further scientific attention.
Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-media... more Abstract The paper introduces a platform for experimental analysis of social gaze in avatar-mediated communications and reports on two studies demonstrating the person perception effects of varying durations of directed gaze. The avatar platform allows to transmit ...
This article addresses methodological issues in the description and evaluation of nonverbal behav... more This article addresses methodological issues in the description and evaluation of nonverbal behavior (NVB) in cross-cultural studies. Videos containing cultural samples of NVB are of little use when analyzing the effects of NVB across cultures. Since video recordings confuse visible behavior with the physical appearances of the actors, they are likely to activate stereotypes derived from hints about an actor’s culture and ethnicity that override the effects of the observed NVB. As a solution for this problem, we suggest here a unified computerized method for the transcription and experimental simulation of NVB. This approach makes use of advanced 3-D animation tools to generate detailed protocols of NVB that can be used to generate culture-free stimulus materials using standardized virtual characters.
First, the specific characteristics of user, task and device were identified as primary determina... more First, the specific characteristics of user, task and device were identified as primary determinants of user acceptance. Second, gender, expert status and cultural background were expected to have a significant influence on attitudes towards biometric devices and their perceived ...
Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes,... more Numerous studies have evaluated the effects of pedagogical agents on students’ learning outcomes, but so far, beneficial effects have not been consistently demonstrated. The ambiguous results might partly be due to the strong emphasis on cognitive outcomes, which is characteristic for research in teaching and learning. The paper suggests a shift of attention to socio-emotional and relational variables, which might be considered as relevant moderator variables in learning or even as learning outcomes per se, for example, in social learning. In order to achieve this goal, we suggest a systematic account of the results from social psychology and in particular from nonverbal communication research, and findings from studies on the social effects of embodied agents in general. This perspective will include (1) a distinction between static and dynamic aspects of embodiment, such as the visual appearance of agents and their nonverbal behavior, and (2) a more systematic approach concerning the functions of embodiment and nonverbal behavior, such as modeling, discourse and dialogue functions, and socio-emotional effects. A further argument addresses the necessity of complementing outcome measures by process measures, which are sensitive to the tasks and the changing situational demands that occur during learning processes and tutor-learner interaction.
A new approach for the use of computer animation in experimental nonverbal research is introduced... more A new approach for the use of computer animation in experimental nonverbal research is introduced. The method was evaluated in a pilot study comparing video recordings of movement in dyadic interactions with computer animations based on transcripts of the behavior, to determine whether similar impression effects could be obtained. At the core of our development is a software tool allowing for the conversion of so-called position time-series protocols of movement into animation scripts for a professional computer animation platform. Our software combines computer-assisted movement transcription and editing with state-of-the-art 3-D animation technology. We present empirical evidence indicating remarkable overall correspondence between video recordings and computer animations. Due to the lack of facial activity in the computer animations, a decline in visual attention for the face area could be observed, which did not, however, affect the impression ratings.
Uploads
Papers by Gary Bente