short-paper

Open access

Video Games as a Corpus: Sentiment Analysis using Fallout New Vegas Dialog

Authors:

Mika Hämäläinen,

Khalid Alnajjar,

Thierry PoibeauAuthors Info & Claims

FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games

Article No.: 56, Pages 1 - 4

https://doi.org/10.1145/3555858.3555930

Published: 04 November 2022 Publication History

All formats PDF

Abstract

We present a method for extracting a multilingual sentiment annotated dialog data set from Fallout New Vegas. The game developers have preannotated every line of dialog in the game in one of the 8 different sentiments: anger, disgust, fear, happy, neutral, pained, sad and surprised. The game has been translated into English, Spanish, German, French and Italian. We conduct experiments on multilingual, multilabel sentiment analysis on the extracted data set using multilingual BERT, XLMRoBERTa and language specific BERT models. In our experiments, multilingual BERT outperformed XLMRoBERTa for most of the languages, also language specific models were slightly better than multilingual BERT for most of the languages. The best overall accuracy was 54% and it was achieved by using multilingual BERT on Spanish data. The extracted data set presents a challenging task for sentiment analysis. We have released the data, including the testing and training splits, openly on Zenodo. The data set has been shuffled for copyright reasons.

References

[1]

Khalid Alnajjar. 2021. When Word Embeddings Become Endangered. Multilingual Facilitation(2021).

[2]

Jeremy Barnes, Robin Kurtz, Stephan Oepen, Lilja Øvrelid, and Erik Velldal. 2021. Structured Sentiment Analysis as Dependency Graph Parsing. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics. Online.

[3]

Thérese Bergsma, Judith van Stegeren, and Mariët Theune. 2020. Creating a sentiment lexicon with game-specific words for analyzing NPC dialogue in the elder scrolls V: Skyrim. In Workshop on Games and Natural Language Processing.

[4]

Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, and Veselin Stoyanov. 2020. Unsupervised Cross-lingual Representation Learning at Scale. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 8440–8451.

[5]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics. Minneapolis, Minnesota, 4171–4186.

[6]

Mika Hämäläinen and Khalid Alnajjar. 2019. Creative Contextual Dialog Adaptation in an Open World RPG. In Proceedings of the 14th International Conference on the Foundations of Digital Games (San Luis Obispo, California, USA) (FDG ’19).

Digital Library

[7]

Shuhua Monica Liu and Jiun-Hung Chen. 2015. A multi-label classification based approach for sentiment classification. Expert Systems with Applications 42, 3 (2015), 1083–1093.

Digital Library

[8]

Yinhan Liu, Myle Ott, Naman Goyal, Jingfei Du, Mandar Joshi, Danqi Chen, Omer Levy, Mike Lewis, Luke Zettlemoyer, and Veselin Stoyanov. 2019. RoBERTa: A Robustly Optimized BERT Pretraining Approach. ArXiv abs/1907.11692(2019).

[9]

F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825–2830.

Digital Library

[10]

Teemu Pöyhönen, Mika Hämäläinen, and Khalid Alnajjar. 2022. Multilingual Persuasion Detection: Video Games as an Invaluable Data Source for NLP. The Proceedings of DiGRA 2022(2022).

[11]

Jie Tao and Xing Fang. 2020. Toward multi-label sentiment analysis: a transfer learning based approach. Journal of Big Data 7, 1 (2020), 1–26.

[12]

Grigorios Tsoumakas, Ioannis Katakis, and Ioannis Vlahavas. 2010. Random k-labelsets for multilabel classification. IEEE transactions on knowledge and data engineering 23, 7(2010), 1079–1089.

[13]

Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush. 2020. Transformers: State-of-the-Art Natural Language Processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing. 38–45.

[14]

Linyi Yang, Jiazheng Li, Padraig Cunningham, Yue Zhang, Barry Smyth, and Ruihai Dong. 2021. Exploring the Efficacy of Automatically Generated Counterfactuals for Sentiment Analysis. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics. Online, 306–316.

[15]

Xiaocui Yang, Shi Feng, Yifei Zhang, and Daling Wang. 2021. Multimodal Sentiment Detection Based on Multi-channel Graph Neural Networks. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). 328–339.

[16]

Selim F Yilmaz, E Batuhan Kaynak, Aykut Koç, Hamdi Dibeklioğlu, and Suleyman Serdar Kozat. 2021. Multi-Label Sentiment Analysis on 100 Languages With Dynamic Weighting for Label Imbalance. IEEE Transactions on Neural Networks and Learning Systems (2021).

[17]

Emily Öhman. 2021. The Validity of Lexicon-based Sentiment Analysis in Interdisciplinary Research. In Proceedings of the Workshop on Natural Language Processing for Digital Humanities.

Cited By

da Rocha Franco Ade Carvalho Wda Silva JMaia Jde Castro M(2024)Managing and controlling digital role-playing game elements: A current state of affairsEntertainment Computing10.1016/j.entcom.2024.10070851(100708)Online publication date: Sep-2024
https://doi.org/10.1016/j.entcom.2024.100708

Index Terms

Video Games as a Corpus: Sentiment Analysis using Fallout New Vegas Dialog
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Natural language generation
  2. Machine learning
    1. Machine learning approaches
      1. Neural networks

Recommendations

An automatic non-English sentiment lexicon builder using unannotated corpus

Sentiment lexicons in the English language are widely accessible while in many other languages, these resources are extremely deficient. Current techniques and methods for sentiment analysis focus mainly on the English language, whereas other languages ...
Automatic Indonesian Sentiment Lexicon Curation with Sentiment Valence Tuning for Social Media Sentiment Analysis
Special issue on Deep Learning for Low-Resource Natural Language Processing, Part 1 and Regular Papers

A novel Indonesian sentiment lexicon (SentIL -- Sentiment Indonesian Lexicon) is created with an automatic pipeline; from creating sentiment seed words, adding new words with slang words, emoticons, and from the given dictionary and sentiment corpus, ...
Investigating Metaphorical Language in Sentiment Analysis: A Sense-to-Sentiment Perspective

Intuition dictates that figurative language and especially metaphorical expressions should convey sentiment. It is the aim of this work to validate this intuition by showing that figurative language (metaphors) appearing in a sentence drive the polarity ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

FDG '22: Proceedings of the 17th International Conference on the Foundations of Digital Games

September 2022

664 pages

ISBN:9781450397957

DOI:10.1145/3555858

Copyright © 2022 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives International 4.0 License.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2022

Check for updates

Author Tags

Qualifiers

Short-paper
Research
Refereed limited

Funding Sources

Ella and Georg Ehrnrooth Foundation
Nokia Foundation
Society of Swedish Literature in Finland

Conference

FDG22

FDG22: 17th International Conference on the Foundations of Digital Games

September 5 - 8, 2022

Athens, Greece

Acceptance Rates

Overall Acceptance Rate 152 of 415 submissions, 37%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
357
Total Downloads

Downloads (Last 12 months)237
Downloads (Last 6 weeks)31

Reflects downloads up to 25 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

da Rocha Franco Ade Carvalho Wda Silva JMaia Jde Castro M(2024)Managing and controlling digital role-playing game elements: A current state of affairsEntertainment Computing10.1016/j.entcom.2024.10070851(100708)Online publication date: Sep-2024
https://doi.org/10.1016/j.entcom.2024.100708

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents