short-paper

Multimodal Sentiment Analysis for Automatic Estimation of Polarity Tension of TV News in TV Newscasts Videos

Authors:

Moisés Pereira,

Flávio Luis Cardeal Pádua,

Adriano Cesar Machado Pereira,

Giani David Silva,

Fabrício Benevenuto de SouzaAuthors Info & Claims

WebMedia '15: Proceedings of the 21st Brazilian Symposium on Multimedia and the Web

Pages 157 - 160

https://doi.org/10.1145/2820426.2820461

Published: 27 October 2015 Publication History

Get Access

Abstract

This paper presents a multimodal approach to perform content-based sentiment analysis in TV newscasts videos in order to assist in the automatic estimation of polarity tension of TV news. The proposed approach aims to contribute to the semiodiscoursive study relative to the construction of ethos of those TV shows. In order to achieve this goal, it is proposed the application of computational methods of state-of-the-art that, through the processing of newscasts' videos of interest, perform the automatic emotion recognition in facial expressions. Moreover, they extract modulations in the participants' speech (e.g., news anchors, reporters, among others) and apply sentiment analysis techniques in their text obtained from closed caption, therefore making possible to estimate the emotional tension level in the enunciation of the TV news. In order to evaluate the accuracy and the applicability of the system, we use an actual dataset composed by 358 videos from three Brazilian newscasts. The experimental results are promising, which indicate the potential of the approach to support the analysis of TV newscasts discourse.

References

[1]

Begoña, G. S. M.; Fidalgo, M. R. and Santos, M. C. G. 2010. Analysing the Development of TV News Programmes: from Information to Dramatization. Revista Latina de Comunicación Social, 65, p. 126--145.

Google Scholar

[2]

Goffman, E. 1981. The Lecture. Forms of Talk. Pennsylvania: University of Pennsylvania Press, p. 162--195.

Google Scholar

[3]

Pereira, M. H. R.; Pádua, F. L. C.; David-Silva, G. 2015. Multimodal Approach for Automatic Emotion Recognition Applied to the Tension Levels Study in TV Newscasts. Brazilian Journalism Research, v. 11, n. 1.

Google Scholar

[4]

Charaudeau, P. 2006. Discours Journalistique et Positionnements Énonciatifs. Frontières et Dérives. Revue SEMEN, n. 22, Énonciation et responsabilité dans les médias, Presses Universitaires de Franche-Comté, Besançon.

Google Scholar

[5]

Pereira, M. H. R.; Souza, C. L.; Pádua, F. L. C.; David-Silva, G.; Assis, G. T.; Pereira, A. C. M. 2014. SAPTE: A Multimedia Information System to Support the Discourse Analysis and Information Retrieval of Television Programs. Multimedia Tools and Applications, 74(2): 1--15.

Google Scholar

[6]

Pantti, M. 2010. The Value of Emotion: An Examination of Television Journalists? Notions on Emotionality. European Journal of Communication, 25(2): 168--181.

Crossref

Google Scholar

[7]

David-Silva, G. 2005. Informação Televisiva: uma Encenação da Realidade (Comparação entre Telejornais Brasileiros e Franceses). Doctoral's Thesis in Linguistic Study - UFMG, Belo Horizonte, Brazil.

Google Scholar

[8]

Araújo, M.; Gonçalves, P.; Cha, M.; Benevenuto, F. 2014. iFeel: A System that Compares and Combines Sentiment Analysis Methods. Proceedings of the World Wide Web Conference (WWW'14). Seoul, Korea.

Digital Library

Google Scholar

[9]

Reis, J.; Benevenuto, F.; Vaz de Melo, P.; Prates, R.; Kwak, H. and An, J. 2015. Breaking the News: First Impressions Matter on Online News. Proceedings of the 9th International AAAI Conference on Web-Blogs and Social Media. Oxford.

Google Scholar

[10]

Maynard, D.; Dupplaw, D.; Hare, J. 2013. Multimodal Sentiment Analysis of Social Media. BCS SGAI Workshop on Social Media Analysis. p. 44--55.

Google Scholar

[11]

Stegmeier, J. 2012. Toward a computer-aided methodology for discourse analysis. Stellenbosch Papers in Linguistics, v. 41, p. 91--114, 2012.

Google Scholar

[12]

Bartlett, M. S., Littlewort, Gwen; Frank, M.; Lainscsek, C.; Fasel, Ian and Movellan, J. 2006. Fully Automatic Facial Action Recognition in Spontaneous Behavior. 7th International Conference on Automatic Face and Gesture Recognition, IEEE, p. 223--230.

Digital Library

Google Scholar

[13]

Florian E.; Weninger, F.; Gross, F. and Schuller, B. 2013. Recent Developments in openSMILE, the Munich Open-Source Multimedia Feature Extractor. ACM Multimedia (MM), Proceedings of the 21st ACM International Conference on Multimedia, Barcelona, p. 835--838.

Digital Library

Google Scholar

[14]

Littlewort, G.; Bartlett, M. S.; Fasel, Ian; Susskind, J. and Movellan, J. 2004. Dynamics of Facial Expression Extracted Automatically from Video. CVPRW'04. Conference on Computer Vision and Pattern Recognition Workshop, IEEE.

Digital Library

Google Scholar

Cited By

View all

Kaur RKautish S(2022)Multimodal Sentiment AnalysisResearch Anthology on Implementing Sentiment Analysis Across Multiple Disciplines10.4018/978-1-6684-6303-1.ch098(1846-1870)Online publication date: 10-Jun-2022
https://doi.org/10.4018/978-1-6684-6303-1.ch098
Cárcamo-Ulloa LMellado CBlaña-Romero CSáez-Trumper D(2022)Galileo, a data platform for viewing news on social networksEl Profesional de la información10.3145/epi.2022.sep.12Online publication date: 3-Oct-2022
https://doi.org/10.3145/epi.2022.sep.12
Kaur RKautish S(2019)Multimodal Sentiment AnalysisInternational Journal of Service Science, Management, Engineering, and Technology10.4018/IJSSMET.201904010310:2(38-58)Online publication date: 1-Apr-2019
https://doi.org/10.4018/IJSSMET.2019040103
Show More Cited By

Index Terms

Multimodal Sentiment Analysis for Automatic Estimation of Polarity Tension of TV News in TV Newscasts Videos

Recommendations

ShapeShifting TV: interactive screen media narratives

This paper presents a paradigm, called ShapeShifting TV, for the realisation of interactive TV narratives or, more generally, of interactive screen-media narratives. These are productions whose narrations respond on the fly (i.e. in real time) to ...
Interactive TV narratives: Opportunities, progress, and challenges

This article is motivated by the question whether television should do more than simply offer interactive services alongside (and separately from) traditional linear programs, in the context of its dominance being seriously challenged and threatened by ...
Community TV: a new dimension for immersive social networking
MoMM '08: Proceedings of the 6th International Conference on Advances in Mobile Computing and Multimedia

The TV sector is facing many drastic changes and is witnessing a rapid transformation. New technologies such as interactive TV, High Definition TV, very high capacity Personal Video Recorder (HD-DVB, Blu-Ray mobile storage), Home Theatre Systems, Video ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

WebMedia '15: Proceedings of the 21st Brazilian Symposium on Multimedia and the Web

October 2015

266 pages

ISBN:9781450339599

DOI:10.1145/2820426

General Chairs:
Marco Antônio Pinheiro de Cristo
UFAM, Brazil
,
David Fernandes de Oliveira
UFAM, Brazil
,
Program Chairs:
Adriano C. Machado Pereira
UFMG, Brazil
,
Fabricio Benevenuto
UFMG, Brazil
,
Marcelo Moreno
UFJF, Brazil
,
Valter Roesler
UFRGS, Brazil

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

FAPEMIG
CNPq
CEFET-MG

Conference

Webmedia '15

Sponsor:

CYTED
SBC
FAPEAM
CNPq
CGIBR
CAPES

Webmedia '15: 21st Brazilian Symposium on Multimedia and the Web

October 27 - 30, 2015

Manaus, Brazil

Acceptance Rates

WebMedia '15 Paper Acceptance Rate 21 of 61 submissions, 34%;

Overall Acceptance Rate 270 of 873 submissions, 31%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
131
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Kaur RKautish S(2022)Multimodal Sentiment AnalysisResearch Anthology on Implementing Sentiment Analysis Across Multiple Disciplines10.4018/978-1-6684-6303-1.ch098(1846-1870)Online publication date: 10-Jun-2022
https://doi.org/10.4018/978-1-6684-6303-1.ch098
Cárcamo-Ulloa LMellado CBlaña-Romero CSáez-Trumper D(2022)Galileo, a data platform for viewing news on social networksEl Profesional de la información10.3145/epi.2022.sep.12Online publication date: 3-Oct-2022
https://doi.org/10.3145/epi.2022.sep.12
Kaur RKautish S(2019)Multimodal Sentiment AnalysisInternational Journal of Service Science, Management, Engineering, and Technology10.4018/IJSSMET.201904010310:2(38-58)Online publication date: 1-Apr-2019
https://doi.org/10.4018/IJSSMET.2019040103
Ullah MIslam MAzman NZaki Z(2017)An overview of Multimodal Sentiment Analysis research: Opportunities and Difficulties2017 IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR)10.1109/ICIVPR.2017.7890858(1-6)Online publication date: 2017
https://doi.org/10.1109/ICIVPR.2017.7890858

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

ShapeShifting TV: interactive screen media narratives

Interactive TV narratives: Opportunities, progress, and challenges

Community TV: a new dimension for immersive social networking