Nothing Special   »   [go: up one dir, main page]

skip to main content
10.1145/3631700.3665232acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
short-paper
Open access

Collecting and Implementing Ethical Guidelines for Emotion Recognition in an Educational Metaverse

Published: 28 June 2024 Publication History

Abstract

The metaverse represents a persistent, online 3D universe where people can interact, socialize, and work toward common goals. Education represents a key application domain, as it has the potential to enhance experiential learning and collaboration between learners and between learners and educators. However, challenges to the widespread adoption of educational metaverses persist. This paper focuses on emotional isolation, i.e., the feeling of emotional disconnection or loneliness, which can hinder learners’ motivation and participation. Machine learning-enabled emotional recognition systems have the potential to address this challenge, offering educators with feedback on the emotional states of learners within the metaverse. Yet, the integration of emotion recognition systems raises ethical concerns regarding consent, privacy, and algorithmic bias. In this short paper, we conduct a first step toward extracting ethical considerations from the literature on the use of emotion recognition in the educational metaverse. Then, we report these guidelines and finally implement one of the most critical —i.e., protection of privacy— within SENEM, an educational metaverse platform available in the literature. Through this research, we aim to raise awareness within the research community and promote responsible deployment of emotion recognition technology in educational metaverses, aiming to create a supportive and inclusive learning environment for all students.

References

[1]
Abdulrahman Alreshidi and Mohib Ullah. 2020. Facial emotion recognition using hybrid features. In Informatics, Vol. 7. MDPI, 6.
[2]
Alice Baird and Björn Schuller. 2020. Considerations for a more ethical approach to data in AI: On data representation and infrastructure. Frontiers in big Data 3 (2020), 25.
[3]
Maciej Behnke, Stanislaw Saganowski, Łukasz D. Kaczmarek, and Przernysław Kazienko. 2023. Emotions Studied by Computer Scientists and Psychologists — A Complementary Perspective. In 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops). 206–211. https://doi.org/10.1109/PerComWorkshops56833.2023.10150393
[4]
Maciej Behnke, Stanislaw Saganowski, Dominika Kunc, and Przemysław Kazienko. 2022. Ethical considerations and checklist for affective research with wearables. IEEE Transactions on Affective Computing (2022).
[5]
Felipe Zago Canal, Tobias Rossi Müller, Jhennifer Cristine Matias, Gustavo Gino Scotton, Antonio Reis de Sa Junior, Eliane Pozzebon, and Antonio Carlos Sobieranski. 2022. A survey on facial emotion recognition techniques: A state-of-the-art literature review. Information Sciences 582 (2022), 593–617.
[6]
Stephen Cavanagh. 1997. Content analysis: concepts, methods and applications.Nurse researcher 4, 3 (1997), 5–16.
[7]
Dario Di Dario, Umberto Bilotti, Maurizio Sibilio, Carmine Gravino, and Fabio Palomba. 2023. Toward a Secure Educational Metaverse: A Tale of Blockchain Design for Educational Environments. In 2023 49th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). 159–166. https://doi.org/10.1109/SEAA60479.2023.00032
[8]
Janine Delahunty, Irina Verenikina, and Pauline Jones. 2014. Socio-emotional connections: Identity, belonging and learning in online interactions. A literature review. Technology, Pedagogy and Education 23, 2 (2014), 243–265.
[9]
Dionisio et al.2013. 3D virtual worlds and the metaverse: Current status and future possibilities. ACM Computing Surveys (CSUR) 45, 3 (2013), 1–38.
[10]
Thippa Reddy Gadekallu, Weizheng Wang, Gokul Yenduri, Pasika Ranaweera, Quoc-Viet Pham, Daniel Benevides da Costa, Madhusanka Liyanage, 2023. Blockchain for the metaverse: A review. Future Generation Computer Systems 143 (2023), 401–419.
[11]
Ian J Goodfellow, Dumitru Erhan, Pierre Luc Carrier, Aaron Courville, Mehdi Mirza, Ben Hamner, Will Cukierski, Yichuan Tang, David Thaler, Dong-Hyun Lee, 2013. Challenges in representation learning: A report on three machine learning contests. In Neural Information Processing: 20th International Conference, ICONIP 2013, Daegu, Korea, November 3-7, 2013. Proceedings, Part III 20. Springer, 117–124.
[12]
Brij B. Gupta, Akshat Gaurav, Kwok Tai Chui, and Varsha Arya. 2024. Deep Learning-Based Facial Emotion Detection in the Metaverse. In 2024 IEEE International Conference on Consumer Electronics (ICCE). 1–6. https://doi.org/10.1109/ICCE59016.2024.10444217
[13]
Javier Hernandez, Josh Lovejoy, Daniel McDuff, Jina Suh, Tim O’Brien, Arathi Sethumadhavan, Gretchen Greene, Rosalind Picard, and Mary Czerwinski. 2021. Guidelines for Assessing and Minimizing Risks of Emotion Recognition Applications. In 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII). 1–8. https://doi.org/10.1109/ACII52823.2021.9597452
[14]
Gee-Sern Hsu, Wen-Fong Huang, and Moi Hoon Yap. 2019. Edge-embedded multi-dropout framework for real-time face alignment. Ieee Access 8 (2019), 6032–6044.
[15]
Ritik Jain, Aashi Goyal, and Kalaichelvi Venkatesan. 2022. Real-time eyeglass detection using transfer learning for non-standard facial data.International Journal of Electrical & Computer Engineering (2088-8708) 12, 4 (2022).
[16]
Amelia Katirai. 2023. Ethical considerations in emotion recognition technologies: a review of the literature. AI and Ethics (2023), 1–22.
[17]
Staffs Keele 2007. Guidelines for performing systematic literature reviews in software engineering.
[18]
Bokyung Kye, Nara Han, Eunji Kim, Yeonjeong Park, and Soyoung Jo. 2021. Educational applications of metaverse: possibilities and limitations. Journal of educational evaluation for health professions 18 (2021).
[19]
Yante Li, Jinsheng Wei, Yang Liu, Janne Kauttonen, and Guoying Zhao. 2022. Deep learning for micro-expression recognition: A survey. IEEE Transactions on Affective Computing 13, 4 (2022), 2028–2046.
[20]
Viviana Pentangelo, Dario Di Dario, Stefano Lambiase, Filomena Ferrucci, Carmine Gravino, and Fabio Palomba. 2024. Senem: A Novel Software Engineering-Enabled Educational Metaverse. Available at SSRN: https://ssrn.com/abstract=4635985 or http://dx.doi.org/10.2139/ssrn.4635985 (2024).
[21]
Sumitra Pokhrel and Roshan Chhetri. 2021. A literature review on impact of COVID-19 pandemic on teaching and learning. Higher education for the future 8, 1 (2021), 133–141.
[22]
Georg David Ritterbusch and Malte Rolf Teichmann. 2023. Defining the metaverse: A systematic literature review. IEEE Access (2023).
[23]
Parthana Sarma and Shovan Barma. 2020. Review on stimuli presentation for affect analysis based on EEG. IEEE Access 8 (2020), 51991–52009.
[24]
Zixuan Shangguan, Zhenyu Liu, Gang Li, Qiongqiong Chen, Zhijie Ding, and Bin Hu. 2022. Dual-stream multiple instance learning for depression detection with facial expression videos. IEEE Transactions on Neural Systems and Rehabilitation Engineering 31 (2022), 554–563.
[25]
Luke Stark and Jesse Hoey. 2021. The Ethics of Emotion in Artificial Intelligence Systems. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 782–793. https://doi.org/10.1145/3442188.3445939
[26]
Neal Stephenson. 1992. Snow Crash. Bantam Books, New York, NY, USA.
[27]
Oguzhan Topsakal, Tahir Cetin Akinci, Joshua Murphy, Taylor Lee-James Preston, and Mehmet Mazhar Celikoyar. 2023. Detecting facial landmarks on 3D models based on geometric properties—a review of algorithms, enhancements, additions and open-source implementations. Ieee Access 11 (2023), 25593–25603.
[28]
Vu Tuan Truong, Long Bao Le, and Dusit Niyato. 2023. Blockchain meets metaverse and digital asset management: A comprehensive survey. Ieee Access (2023).
[29]
Guy Zyskind, Oz Nathan, 2015. Decentralizing privacy: Using blockchain to protect personal data. In 2015 IEEE security and privacy workshops. IEEE, 180–184.

Cited By

View all
  • (2024)FRINGE: context-aware FaiRness engineerING in complex software systEmsProceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3674805.3695394(608-612)Online publication date: 24-Oct-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
UMAP Adjunct '24: Adjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization
June 2024
662 pages
ISBN:9798400704666
DOI:10.1145/3631700
This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2024

Check for updates

Author Tags

  1. Educational Metaverse
  2. Ethical Guidelines
  3. Facial Emotion Recognition

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

UMAP '24
Sponsor:

Acceptance Rates

Overall Acceptance Rate 162 of 633 submissions, 26%

Upcoming Conference

UMAP '25

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)212
  • Downloads (Last 6 weeks)94
Reflects downloads up to 18 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)FRINGE: context-aware FaiRness engineerING in complex software systEmsProceedings of the 18th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement10.1145/3674805.3695394(608-612)Online publication date: 24-Oct-2024

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media