research-article

Using subjective and physiological measures to evaluate audience-participating movie experience

Authors:

Akinobu Maejima,

Shigeo MorishimaAuthors Info & Claims

AVI '08: Proceedings of the working conference on Advanced visual interfaces

Pages 49 - 56

https://doi.org/10.1145/1385569.1385580

Published: 28 May 2008 Publication History

Abstract

In this paper we subjectively and physiologically investigate the effects of the audiences' 3D virtual actor in a movie on their movie experience, using the audience-participating movie DIM as the object of study. In DIM, the photo-realistic 3D virtual actors of audience are constructed by combining current computer graphics (CG) technologies and can act different roles in a pre-rendered CG movie. To facilitate the investigation, we presented three versions of a CG movie to an audience---a Traditional version, its Self-DIM (SDIM) version with the participation of the audience's virtual actor, and its Self-Friend-DIM (SFDIM) version with the co-participation of the audience and his friends' virtual actors. The results show that the participation of audience's 3D virtual actors indeed cause increased subjective sense of presence and engagement, and emotional reaction; moreover, SFDIM performs significantly better than SDIM, due to increased social presence. Interestingly, when watching the three movie versions, subjects experienced not only significantly different galvanic skin response (GSR) changes on average---changing trend over time, and number of fluctuations---but they also experienced phasic GSR increase when watching their own and friends' virtual 3D actors appearing on the movie screen. These results suggest that the participation of the 3D virtual actors in a movie can improve interaction and communication between audience and the movie.

References

[1]

Szilas, N. 2005. The future of interactive drama. Creativity & Cognition Studios Press.

[2]

Mateas, M. and Stern, A. 2003. Facade: An Experiment in Building a Fully-Realized Interactive Drama. In Proceedings of Game Developers Conference 2003.

[3]

Cavazza, M., Charles, F. and Mead, S. J. 2002. Interacting with virtual characters in interactive storytelling. In Proceedings of the first international joint conference on Autonomous agents and multi-agent systems: part 1, 318--325.

Digital Library

[4]

Morishima, S., Maejima, A., Wemler, S., Machida, T. and Takebayashi, M. 2005. Future Cast System. In Proceedings of International Conference on Computer Graphics and Interactive Techniques.

Digital Library

[5]

Pagulayan, R. J., Keeker, K., Wixon, D., Romero, R. and Fuller, T. 2003. User-centered design in games. The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications, 883--906.

Digital Library

[6]

Blythe, M. A. 2004. Funology: From Usability to Enjoyment. Kluwer Academic Publishers.

Digital Library

[7]

Lazzaro, N. 2004. Why we play games: 4 keys to more emotion. In Proceedings of Game Developers Conference 2004.

[8]

Marshall, D. C. and Rossman, D. G. B. 2006. Designing Qualitative Research. Sage Publications.

[9]

Fisher, C. and Sanderson, P. 2005. Exploratory sequential data analysis: exploring continuous observational data. Interactions, 3, 2, 25--34.

Digital Library

[10]

Andreassi, J. L. 2000. Psychophysiology: Human Behavior and Physiological Response. Lawrence Erlbaum Associates.

[11]

Lombard, M. and Ditton. 1997. T. At the heart of it all: The concept of presence. Journal of Computer-Mediated Communication, 3, 2, 20.

[12]

Biocca, F. 1997. The Cyborg's Dilemma: Progressive Embodiment in Virtual Environments. Journal of Computer-Mediated Communication, 3, 2.

[13]

Kelso, M., Weyhrauch, P. and Bates, J. 1992. Dramatic presence. Presence: Teleoperators & Virtual Environments 2(1).

[14]

Lang, P. J. 1995. The emotion probe. American Psychologist, 50, 5, 372--385.

[15]

Mandryk, R. L., Inkpen, K. M. and Calvert, T. W. 2006. Using psychophysiological techniques to measure user experience with entertainment technologies. Behaviour & Information Technology, 25, 2, 141--158.

[16]

Boucsein, W. 1992. Electrodermal Activity. Plenum Press, New York.

[17]

Ward, R. D. and Marsden, P. H. 2003. Physiological responses to different WEB page designs. International Journal of Human-Computer Studies, 59, 1--2, 199--212.

Digital Library

[18]

Wilson, G. and Sasse, M. A. 2000. Do users always know what's good for them? Utilizing physiological responses to assess media quality. In Proceedings of HCI 2000.

[19]

Wilson, G. M. and Sasse, M. A. 2000. Investigating the Impact of Audio Degradations on Users: Subjective vs. Objective Assessment Methods. In Proceedings of OZCHI 2004.

[20]

Mandryk, R. L., Atkins, M. S. and Inkpen, K. M. 2006. A continuous and objective evaluation of emotional experience with interactive play environments. In Proceedings of the SIGCHI conference on Human Factors in computing systems, 1027--1036.

Digital Library

[21]

Meehan, M., Insko, B., Whitton, M. and Brooks Jr, F. P. 2002. Physiological measures of presence in stressful virtual environments. In Proceedings of the 29^th annual conference on Computer graphics and interactive techniques, 645--652.

Digital Library

[22]

Papillo, J. F. and Shapiro, D. 1990.The cardiovascular system. Cambridge University Press.

[23]

Ravaja, N. 2004. Contributions of Psychophysiology to Media Research: Review and Recommendations. Media Psychology, 6, 2, 193--235.

[24]

Weber, E. J., Van der Molen, M. W. and Molenaar, P. C. 1994. Heart rate and sustained attention during childhood: age changes in anticipatory heart rate, primary bradycardia, and respiratory sinus arrhythmia. Psychophysiology, 31, 2, 164--174.

[25]

Lessiter, J., Freeman, J., Keogh, E. and Davidoff, J. 2001. A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory. Presence: Teleoperators & Virtual Environments, 10, 3, 282--297.

Digital Library

[26]

Lang, P. J. 1980. Behavioral treatment and bio-behavioral assessment: Computer applications. In J. B. Sidowski, J. H. Johnson, & T. A. Williams (Eds.), Technology in mental health care delivery systems. Norwood, NJ: Ablex Publishing.

[27]

Vorderer, P., Wirth, W., Saari, T., Gouveia, F. R., Biocca, F., Jäncke, F., Böcking, S., Hartmann, T., Klimmt, C. and Schramm, H. 2003. Constructing Presence: Towards a two-level model of the formation of Spatial Presence. Unpublished report to the European Community, Project Presence: MEC (IST-2001-37661). Hannover, Munich, Helsinki, Porto, Zurich.

[28]

Gatchel, R. J., Gaas, E., King, J. M. and McKinney, M. E. 1977. Effects of arousal level and below-zero habituation training on the spontaneous recovery and dishabituation of the orienting response. Physiological Psychology, 5, 257--260.

Cited By

Jiang LHao Y(2020)Applying Machine Learning to Predict Film Daily Audience Data: System and Dataset2020 3rd International Conference on Artificial Intelligence and Big Data (ICAIBD)10.1109/ICAIBD49809.2020.9137462(11-16)Online publication date: May-2020
https://doi.org/10.1109/ICAIBD49809.2020.9137462
Yu QChe XMa SPan SYang YXing WWang X(2018)A Hybrid User Experience Evaluation Method for Mobile GamesIEEE Access10.1109/ACCESS.2018.28594406(49067-49079)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2859440
Wang CCesar PRoto VHäkkilä JVäänänen-Vainio-Mattila KJuhlin OOlsson THvannberg E(2014)Do we react in the same manner?Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2639201(501-510)Online publication date: 26-Oct-2014
https://dl.acm.org/doi/10.1145/2639189.2639201
Show More Cited By

Index Terms

Using subjective and physiological measures to evaluate audience-participating movie experience
1. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Preliminary evaluation of the audience-driven movie
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

In this paper we introduce an audience-driven theater experience, DIM Movie, in which audience participates in a pre-created CG movie as its roles, and report the subjective and physiological evaluations for the audience experience offered by DIM movie. ...
“Dive into the Movie” Audience-Driven Immersive Experience in the Story

“ Dive into the Movie (DIM)” is a name of project to aim to realize a world innovative entertainment system which can provide an immersion experience into the story by giving a chance to audience to share an impression with his family or friends by ...
Using Physiological Measures to Evaluate User Experience of Mobile Applications
11th International Conference on Engineering Psychology and Cognitive Ergonomics - Volume 8532

Measurements of user experience UX in traditional human-computer interaction studies mostly rely on task performance and self-report data. Recent research has showed that physiological measures are good indicators of cognitive involvement and emotional ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

AVI '08: Proceedings of the working conference on Advanced visual interfaces

May 2008

483 pages

ISBN:9781605581415

DOI:10.1145/1385569

General Chair:
Stefano Levialdi
Sapienza, Università di Roma, Roma, Italy

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI Italy: SIGCHI Italy
SIGMM: ACM Special Interest Group on Multimedia
SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 May 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

AVI '08

Sponsor:

SIGCHI Italy
SIGMM
SIGCHI

AVI '08: The International Conference on Advanced Visual Interfaces

May 28 - 30, 2008

Napoli, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
636
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)5

Reflects downloads up to 14 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jiang LHao Y(2020)Applying Machine Learning to Predict Film Daily Audience Data: System and Dataset2020 3rd International Conference on Artificial Intelligence and Big Data (ICAIBD)10.1109/ICAIBD49809.2020.9137462(11-16)Online publication date: May-2020
https://doi.org/10.1109/ICAIBD49809.2020.9137462
Yu QChe XMa SPan SYang YXing WWang X(2018)A Hybrid User Experience Evaluation Method for Mobile GamesIEEE Access10.1109/ACCESS.2018.28594406(49067-49079)Online publication date: 2018
https://doi.org/10.1109/ACCESS.2018.2859440
Wang CCesar PRoto VHäkkilä JVäänänen-Vainio-Mattila KJuhlin OOlsson THvannberg E(2014)Do we react in the same manner?Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational10.1145/2639189.2639201(501-510)Online publication date: 26-Oct-2014
https://dl.acm.org/doi/10.1145/2639189.2639201
Pölönen MSalmimaa MAaltonen VHäkkinen JTakatalo J(2012)Subjective measures of presence and discomfort in viewers of color‐separation‐based stereoscopic cinemaJournal of the Society for Information Display10.1889/JSID17.5.45917:5(459-466)Online publication date: 18-Jun-2012
https://doi.org/10.1889/JSID17.5.459
Wu DWu TSingh HPadilla SAtkinson DBianchi-Berthouze NChantler MBaurley S(2011)The affective experience of handling digital fabricsProceedings of the 4th international conference on Affective computing and intelligent interaction - Volume Part I10.5555/2062780.2062828(427-436)Online publication date: 9-Oct-2011
https://dl.acm.org/doi/10.5555/2062780.2062828
Wu DWu TSingh HPadilla SAtkinson DBianchi-Berthouze NChantler MBaurley S(2011)The Affective Experience of Handling Digital Fabrics: Tactile and Visual Cross-Modal EffectsAffective Computing and Intelligent Interaction10.1007/978-3-642-24600-5_46(427-436)Online publication date: 2011
https://doi.org/10.1007/978-3-642-24600-5_46
Perttula ATuomi PSuominen MKoivisto AMultisilta JLugmayr AFranssila HSotamaa OSafran CAaltonen T(2010)Users as sensorsProceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments10.1145/1930488.1930497(41-48)Online publication date: 6-Oct-2010
https://dl.acm.org/doi/10.1145/1930488.1930497

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents