That's AWESOME: Awareness While Experiencing and Surfing On Movies through Emotions
Authors: 
Teresa Chambel, Patrícia Arriaga, 
Manuel J. Fonseca, Thibault Langlois, Octavian Postolache, Cláudia Ribeiro, Nuno Piçarra, Soraia M. Alarcão, Ana JorgeAuthors Info & Claims
Pages 110 - 117
Abstract
This paper presents the AWESOME research project: Awareness While Experiencing and Surfing On Movies through Emotions, which focused on the role of emotions in movies, aiming to enhance viewers' emotional awareness while searching, accessing and watching movies. The project addressed challenges such as capturing viewers' emotional responses, and analyzing movie content based on subtitles, audio, and video. Through a multimethod approach and combining distinct measurements, the project gained insights into viewers' emotions, developed algorithms for estimating emotions, and created interactive tools to annotate and access movies based on emotions. User satisfaction with the tools provided further evidence about the relevance of taking emotions into account and providing an effective support. Through this paper, we present an overview about the motivations underlying the AWESOME project, its main goals, tasks and contributions, and highlight directions for future work.
References
[1]
Soraia M. Alarcão, and Manuel J. Fonseca. 2018. Identifying emotions in images from valence and arousal ratings. Multimedia Tools and Applications, Springer, 77(13). 17413-35.
[2]
Patrícia Arriaga, Joana Alexandre, Octavian Postolache, Manuel J. Fonseca, Thibault Langlois, and Teresa Chambel. 2020. Why do we watch? The role of emotion gratifications and individual differences in predicting rewatchability and movie recommendation. Behavioral Sciences, 10 (8), 1-11.
[3]
Anne Bartsch. 2012. Emotional Gratification in Entertainment Experience. Why Viewers of Movies and Television Series Find it Rewarding to Experience Emotions, Media Psychology, 15:3, 267-302.
[4]
Carla Bernardino, Hugo A. Ferreira, and Teresa Chambel. 2016. Towards Media for Wellbeing. In Proceedings of ACM TVX 2016, 171-177.
[5]
Francisco Caldeira, João Lourenço, Nuno T. Silva, and Teresa Chambel. 2022. Towards Multimodal Search and Visualization of Movies Based on Emotions. Proceedings of ACM IMX 2022, 349-356.
[6]
Francisco Caldeira, João Lourenço, and Teresa Chambel. 2023. Happy or Sad, Smiling or Drawing: Multimodal Search and Visualisation of Movies Based on Emotions Along Time. VISIGRAPP/HUCAPP 2023, 85-97. Best Paper Award.
[7]
Pedro Carvalho, and Teresa Chambel. 2019. EmoJar: Collecting and Reliving Happy and Memorable Media Moments. ACM TVX 2019, 262-272.
[8]
Teresa Chambel, Eva Oliveira, and Pedro Martins. 2011. Being Happy, Healthy and Whole Watching Movies that Affect our Emotions. Proceedings of ACII 2011, Springer: Berlin Heidelberg. 35-45.
[9]
Teresa Chambel, and Pedro Carvalho. 2020. Memorable and Emotional Media Moments: reminding yourself of the good things!, VISIGRAPP/ HUCAPP 2020, 86-98. Best Paper Award.
[10]
Bárbara Nogueira da Costa, Octavian Postolache, and John Araujo. 2020. Sustained Attention Detection System in Learning Environments. EPE 2020, Iasi, Romania, 609-615.
[11]
Alan S. Cowen, and Dacher Keltner. 2017. Self-report captures 27 distinct categories of emotion bridged by continuous gradients. Proceedings of the national academy of sciences, 114(38), E7900-E7909.
[12]
Paul Ekman. 1992. Are there basic emotions? Psychological Review, 99(3), 550–553.
[13]
Filipe Galvão, Soraia M. Alarcão, and Manuel J. Fonseca. 2021. Predicting Exact Valence and Arousal Values from EEG. MDPI Sensors, May, 21(10): 3414.
[14]
Nuno Gil, Nuno Silva, Eduardo Duarte, Pedro Martins, Thibault Langlois, and Teresa Chambel. 2012. Going Through the Clouds: Search Overview and Browsing of Movies. Academic MindTrek 2012, Tampere, Finland, Oct 3-5, ACM, 158-165.
[15]
Silvana M. Graça. 2022. Emovideo : automatic prediction of emotional responses to videos using its cinematic features. Master in Engenharia informática, FCUL. https://repositorio.ul.pt/handle/10451/53904
[16]
Sophie H. Janicke-Bowles, Thomas Schubert, and Johanna K. Blomster. 2021. Kama Muta as a Eudaimonic Entertainment Experience. In Peter Vorderer, and Christoph Klimmt (Eds.), The Oxford Handbook of Entertainment Theory, 403–418. Oxford University Press.
[17]
Ana Jorge, Nuno Correia, and Teresa Chambel. 2021. Design Guidance for Interactive Visualization of Movies and Videos in Time and Space. In: Martins, N., Brandão, D. (eds) Advances in Design and Digital Communication. Digicom 2020. Springer Series in Design and Innovation, vol 12. Cham, Switzerland: Springer, 102-113.
[18]
Thibault Langlois, Teresa Chambel, Eva Oliveira, Paula Carvalho, Gonçalo Marques, and André Falcão. 2010. VIRUS: Video Information Retrieval Using Subtitles. Academic MindTrek 2010, Tampere, Finland, Oct 6-8, ACM, 197-200.
[19]
Francisco Mendonça. 2021. AudioMood: Classificação de emoções em bandas sonoras de filmes usando Redes Neuronais. Master in Informática, FCUL. https://repositorio.ul.pt/handle/10451/49347
[20]
Acácio Moreira, and Teresa Chambel. 2019. This Music Reminds Me of a Movie, or Is It an Old Song? An Interactive Audiovisual Journey to Find out, Explore and Play. VISIGRAPP/GRAPP 2019, 145-158.
[21]
Lino Nunes, Cláudia Ribeiro, and Teresa Chambel. 2022. Emotional and Engaging Movie Annotation with Gamification. VISIGRAPP/HUCAPP 2022, 262-272.
[22]
João Oliveira. 2019. EmoStatus - Estimating the emotional state of people using electrodermal activity. Master in Engenharia Informática, FCUL. https://repositorio.ul.pt/handle/10451/40576
[23]
João Oliveira, Soraia M. Alarcão, Teresa Chambel, and Manuel J. Fonseca. 2023. metaFERA: A Meta-Framework for Real-Time Emotion Recognition from Physiological Signals. Multimedia Tools and Applications, Springer, 1-31.
[24]
Nuno Piçarra, Níbia Silva, Teresa Chambel, and Patrícia Arriaga. 2021. What movie will I watch today? The role of online review ratings, reviewers’ comments, and user's gratification style. Projections, the Journal for Movies and Mind, 15 (3), 24-46.
[25]
Nuno Piçarra, Eduardo Reis, Teresa Chambel., and Patrícia Arriaga. 2022. Searching, Navigating, and Recommending Movies through Emotions: A Scoping Review. Human Behavior and Emerging Technologies, vol. 2022, Article ID 7831013, 24 pages. (pre-registered at OSF)
[26]
Gonçalo Ribeiro, Octavian Postolache, and Francisco Ferrero Martin. 2022. A Practical Approach to Health Status Monitoring Based on Heart Rate and Respiratory Rate Assessment. IEEE MeMeA 2022, Messina, Italy.
[27]
Mariana J. Rodrigues, Octavian Postolache, and Francisco Cercas. 2022. The Influence of Music Stimulation on Heart Rate Variability: Preliminary Results. IEEE MeMeA (2022), Messina, Italy.
[28]
Válber C. Roza, Octavian Postolache, Voicu Z. Groza, and José D. Pereira. 2019. Emotions Assessment on Simulated Flights. IEEE MeMeA 2019, Istanbul, Turkey.
[29]
Válber C. Roza, and Octavian Postolache. 2019. Multimodal Approach for Emotion Recognition Based on Simulated Flight Experiments, Sensors, 19(24), 5516, (2019).
[30]
Vasco Serra, and Teresa Chambel. 2020. Quote Surfing in Music and Movies with an Emotional Flavor. VISIGRAPP/HUCAPP 2020, 75-85.
[31]
Janis H. Zickfeld, Patrícia Arriaga, Sara V. Santos, Thomas W. Schubert, and Beate Seibt. 2020. Tears of joy, aesthetic chills, and heartwarming feelings: Physiological correlates of Kama Muta. Psychophysiology, (2020).
Index Terms
- That's AWESOME: Awareness While Experiencing and Surfing On Movies through Emotions
Recommendations
Happy or Sad, Smiling or Drawing with Multimodal Search and Visualisation of Movies Based on Emotions Along Time
IMXw '23: Proceedings of the 2023 ACM International Conference on Interactive Media Experiences WorkshopsMovies have always had a very important role in society, and have become a powerful vehicle for culture, education, leisure and even propaganda (Shah, 2011). One of the main reasons is their ability to awaken the emotions of their viewers, to influence ...
Primacy effect of emotions in social stories: User engagement behaviors with breast cancer narratives on Facebook
AbstractAmid emerging information and communication technologies with unique affordances for storytelling and story sharing, most studies in narrative communication still focus on narratives delivered through traditional mediums. There has ...
Highlights- Negative sentiments in the initial position of a cancer story enhance user engagement on Facebook.
Sharing emotions: determining films’ evoked emotional experience from their online reviews
AbstractOnline reviews are broadly believed to reflect consumers’ opinions towards the reviewed items. In this work, we postulate that online reviews for experience goods also reflect something very different, the reviewer’s emotions while experiencing ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
June 2023
143 pages
ISBN:9798400708459
DOI:10.1145/3604321
Copyright © 2023 Owner/Author.
This work is licensed under a Creative Commons Attribution International 4.0 License.
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 27 October 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
- FCT
- Fundação para a Ciência e a Tecnologia (FCT)
- LASIGE Research Unit
Conference
IMXw '23
IMXw '23: ACM International Conference on Interactive Media Experiences Workshops
June 12 - 15, 2023
Nantes, France
Acceptance Rates
Overall Acceptance Rate 69 of 245 submissions, 28%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 240Total Downloads
- Downloads (Last 12 months)227
- Downloads (Last 6 weeks)44
Reflects downloads up to 26 Nov 2024
Other Metrics
Citations
View Options
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML FormatLogin options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in