research-article

A Duo-generative Approach to Explainable Multimodal COVID-19 Misinformation Detection

Authors:

Dong WangAuthors Info & Claims

WWW '22: Proceedings of the ACM Web Conference 2022

Pages 3623 - 3631

https://doi.org/10.1145/3485447.3512257

Published: 25 April 2022 Publication History

Abstract

This paper focuses on a critical problem of explainable multimodal COVID-19 misinformation detection where the goal is to accurately detect misleading information in multimodal COVID-19 news articles and provide the reason or evidence that can explain the detection results. Our work is motivated by the lack of judicious study of the association between different modalities (e.g., text and image) of the COVID-19 news content in current solutions. In this paper, we present a generative approach to detect multimodal COVID-19 misinformation by investigating the cross-modal association between the visual and textual content that is deeply embedded in the multimodal news content. Two critical challenges exist in developing our solution: 1) how to accurately assess the consistency between the visual and textual content of a multimodal COVID-19 news article? 2) How to effectively retrieve useful information from the unreliable user comments to explain the misinformation detection results? To address the above challenges, we develop a duo-generative explainable misinformation detection (DGExplain) framework that explicitly explores the cross-modal association between the news content in different modalities and effectively exploits user comments to detect and explain misinformation in multimodal COVID-19 news articles. We evaluate DGExplain on two real-world multimodal COVID-19 news datasets. Evaluation results demonstrate that DGExplain significantly outperforms state-of-the-art baselines in terms of the accuracy of multimodal COVID-19 misinformation detection and the explainability of detection explanations.

References

[1]

Firoj Alam, Stefano Cresci, Tanmoy Chakraborty, Fabrizio Silvestri, Dimiter Dimitrov, Giovanni Da San Martino, Shaden Shaar, Hamed Firooz, and Preslav Nakov. 2021. A Survey on Multimodal Disinformation Detection. arXiv preprint arXiv:2103.12541(2021).

[2]

Talha Burki. 2020. The online anti-vaccine movement in the age of COVID-19. The Lancet Digital Health 2, 10 (2020), e504–e505.

[3]

Mingxuan Chen, Xinqiao Chu, and KP Subbalakshmi. 2021. MMCoVaR: Multimodal COVID-19 Vaccine Focused Data Repository for Fake News Detection and a Baseline Architecture for Classification. arXiv preprint arXiv:2109.06416(2021).

[4]

Claudia Deane, Kim Parker, and John Gramlich. 2021. A year of U.S. public opinion on the coronavirus pandemic. https://www.pewresearch.org/2021/03/05/a-year-of-u-s-public-opinion-on-the-coronavirus-pandemic/

[5]

Yashar Deldjoo, Tommaso Di Noia, and Felice Antonio Merra. 2021. A survey on adversarial recommender systems: from attack/defense strategies to generative adversarial networks. ACM Computing Surveys (CSUR) 54, 2 (2021), 1–38.

Digital Library

[6]

Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018).

[7]

Ross Girshick. 2015. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision. 1440–1448.

Digital Library

[8]

Han Guo, Juan Cao, Yazi Zhang, Junbo Guo, and Jintao Li. 2018. Rumor detection with hierarchical social attention network. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 943–951.

Digital Library

[9]

Liz Hamel, Lunna Lopes, Ashley Kirzinger, Grace Sparks, Mellisha Stokes, and Mollyann Brodie. 2021. KFF COVID-19 vaccine monitor: Media and misinformation. https://www.kff.org/coronavirus-covid-19/poll-finding/kff-covid-19-vaccine-monitor-media-and-misinformation/

[10]

Silvan Heller, Luca Rossetto, and Heiko Schuldt. 2018. The ps-battles dataset-an image collection for image manipulation detection. arXiv preprint arXiv:1804.04866(2018).

[11]

Benjamin D Horne, William Dron, Sara Khedr, and Sibel Adali. 2018. Assessing the news landscape: A multi-module toolkit for evaluating the credibility of news. In Companion Proceedings of the The Web Conference 2018. 235–238.

Digital Library

[12]

Dhruv Khattar, Jaipal Singh Goud, Manish Gupta, and Vasudeva Varma. 2019. Mvae: Multimodal variational autoencoder for fake news detection. In The World Wide Web Conference. 2915–2921.

Digital Library

[13]

Ziyi Kou, Lanyu Shang, Yang Zhang, and Dong Wang. 2022. HC-COVID: A Hierarchical Crowdsource Knowledge Graph Approach to Explainable COVID-19 Misinformation Detection. Proceedings of the ACM on Human-Computer Interaction 6, GROUP(2022), 1–25.

Digital Library

[14]

Ziyi Kou, Daniel Zhang, Lanyu Shang, and Dong Wang. 2021. What and Why Towards Duo Explainable Fauxtography Detection under Constrained Supervision. IEEE Transactions on Big Data(2021).

[15]

Ziyi Kou, Daniel Yue Zhang, Lanyu Shang, and Dong Wang. 2020. ExFaux: A Weakly Supervised Approach to Explainable Fauxtography Detection. In 2020 IEEE International Conference on Big Data (Big Data). IEEE, 631–636.

[16]

Leib Litman and Jonathan Robinson. 2020. Conducting online research on Amazon Mechanical Turk and beyond. Sage Publications.

[17]

Yang Liu and Yi-Fang Wu. 2018. Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.

[18]

Jing Ma, Wei Gao, and Kam-Fai Wong. 2019. Detect rumors on twitter by promoting information campaigns with generative adversarial learning. In The World Wide Web Conference. 3049–3055.

Digital Library

[19]

Alexander Mathews, Lexing Xie, and Xuming He. 2018. Semstyle: Learning to generate stylised image captions using unaligned text. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8591–8600.

[20]

Subhabrata Mukherjee, Gerhard Weikum, and Cristian Danescu-Niculescu-Mizil. 2014. People on drugs: credibility of user statements in health communities. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 65–74.

Digital Library

[21]

Kashyap Popat, Subhabrata Mukherjee, Jannik Strötgen, and Gerhard Weikum. 2018. CredEye: A credibility lens for analyzing and explaining misinformation. In Companion Proceedings of the The Web Conference 2018. 155–158.

Digital Library

[22]

Julio CS Reis, André Correia, Fabricio Murai, Adriano Veloso, and Fabrício Benevenuto. 2019. Explainable machine learning for fake news detection. In Proceedings of the 10th ACM conference on web science. 17–26.

Digital Library

[23]

Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497(2015).

[24]

Lanyu Shang, Ziyi Kou, Yang Zhang, and Dong Wang. 2021. A Multimodal Misinformation Detector for COVID-19 Short Videos on TikTok. In 2021 IEEE International Conference on Big Data (Big Data). IEEE, 899–908.

[25]

Lanyu Shang, Christina Youn, Yuheng Zha, Yang Zhang, and Dong Wang. 2021. KnowMeme: A Knowledge-enriched Graph Neural Network Solution to Offensive Meme Detection. In 2021 IEEE 17th International Conference on eScience (eScience). IEEE, 186–195.

[26]

Lanyu Shang, Yang Zhang, Yuheng Zha, Yingxi Chen, Christina Youn, and Dong Wang. 2021. Aomd: An analogy-aware approach to offensive meme detection on social media. Information Processing & Management 58, 5 (2021), 102664.

Digital Library

[27]

Lanyu Shang, Yang Zhang, Daniel Zhang, and Dong Wang. 2020. Fauxward: a graph neural network approach to fauxtography detection using social media comments. Social Network Analysis and Mining 10, 1 (2020), 1–16.

[28]

Elisa Shearer and Amy Mitchell. 2021. News use across social media platforms in 2020. (2021).

[29]

Kai Shu, Limeng Cui, Suhang Wang, Dongwon Lee, and Huan Liu. 2019. defend: Explainable fake news detection. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 395–405.

Digital Library

[30]

Shivangi Singhal, Rajiv Ratn Shah, Tanmoy Chakraborty, Ponnurangam Kumaraguru, and Shin’ichi Satoh. 2019. Spotfake: A multi-modal framework for fake news detection. In 2019 IEEE fifth international conference on multimedia big data (BigMM). IEEE, 39–47.

[31]

Briony Swire-Thompson and David Lazer. 2019. Public health and online misinformation: Challenges and recommendations.Annual Review of Public Health 41 (2019), 433–451.

[32]

Antonela Tommasel. 2019. Friend or foe: Studying user trustworthiness for friend recommendation in the era of misinformation. In 2019 IEEE second international conference on artificial intelligence and knowledge engineering (AIKE). IEEE, 273–276.

[33]

Emily K Vraga and Leticia Bode. 2017. Using expert sources to correct health misinformation in social media. Science Communication 39, 5 (2017), 621–645.

[34]

Dong Wang, Md Tanvir Amin, Shen Li, Tarek Abdelzaher, Lance Kaplan, Siyu Gu, Chenji Pan, Hengchang Liu, Charu C Aggarwal, Raghu Ganti, 2014. Using humans as sensors: an estimation-theoretic perspective. In IPSN-14 proceedings of the 13th international symposium on information processing in sensor networks. IEEE, 35–46.

[35]

Dong Wang, Lance Kaplan, Hieu Le, and Tarek Abdelzaher. 2012. On truth discovery in social sensing: A maximum likelihood estimation approach. In Proceedings of the 11th international conference on Information Processing in Sensor Networks. 233–244.

Digital Library

[36]

Dong Wang, Boleslaw K Szymanski, Tarek Abdelzaher, Heng Ji, and Lance Kaplan. 2019. The age of social sensing. Computer 52, 1 (2019), 36–45.

Digital Library

[37]

Yaqing Wang, Fenglong Ma, Zhiwei Jin, Ye Yuan, Guangxu Xun, Kishlay Jha, Lu Su, and Jing Gao. 2018. Eann: Event adversarial neural networks for multi-modal fake news detection. In Proceedings of the 24th acm sigkdd international conference on knowledge discovery & data mining. 849–857.

Digital Library

[38]

Yuta Yanagi, Ryohei Orihara, Yuichi Sei, Yasuyuki Tahara, and Akihiko Ohsuga. 2020. Fake News Detection with Generated Comments for News Articles. In 2020 IEEE 24th International Conference on Intelligent Engineering Systems (INES). IEEE, 85–90.

[39]

Fan Yang, Shiva K Pentyala, Sina Mohseni, Mengnan Du, Hao Yuan, Rhema Linder, Eric D Ragan, Shuiwang Ji, and Xia Hu. 2019. Xfake: Explainable fake news detector with visualizations. In The World Wide Web Conference. 3600–3604.

Digital Library

[40]

Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019. Defending against neural fake news. arXiv preprint arXiv:1905.12616(2019).

[41]

Daniel Yue Zhang, Lanyu Shang, Biao Geng, Shuyue Lai, Ke Li, Hongmin Zhu, Md Tanvir Amin, and Dong Wang. 2018. Fauxbuster: A content-free fauxtography detector using social media comments. In 2018 IEEE International Conference on Big Data (Big Data). IEEE, 891–900.

[42]

Lu Zhang, Jianming Zhang, Zhe Lin, Huchuan Lu, and You He. 2019. Capsal: Leveraging captioning to boost semantics for salient object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6024–6033.

[43]

Wenjia Zhang, Lin Gui, and Yulan He. 2021. Supervised Contrastive Learning for Multimodal Unreliable News Detection in COVID-19 Pandemic. arXiv preprint arXiv:2109.01850(2021).

[44]

Wei Emma Zhang, Quan Z Sheng, Ahoud Alhazmi, and Chenliang Li. 2020. Adversarial attacks on deep-learning models in natural language processing: A survey. ACM Transactions on Intelligent Systems and Technology (TIST) 11, 3(2020), 1–41.

Digital Library

[45]

Yang Zhang, Xiangyu Dong, Md Tahmid Rashid, Lanyu Shang, Jun Han, Daniel Zhang, and Dong Wang. 2020. Pqa-cnn: Towards perceptual quality assured single-image super-resolution in remote sensing. In 2020 IEEE/ACM 28th International Symposium on Quality of Service (IWQoS). IEEE, 1–10.

[46]

Zhilu Zhang and Mert R Sabuncu. 2018. Generalized cross entropy loss for training deep neural networks with noisy labels. In 32nd Conference on Neural Information Processing Systems (NeurIPS).

Digital Library

[47]

Xinyi Zhou, Apurva Mulay, Emilio Ferrara, and Reza Zafarani. 2020. Recovery: A multimodal repository for covid-19 news credibility research. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management.

Digital Library

[48]

Xinyi Zhou, Jindi Wu, and Reza Zafarani. 2020. SAFE: Similarity-Aware Multi-modal Fake News Detection. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 354–367.

Cited By

Khalili HWimmer M(2024)Towards Improved XAI-Based Epidemiological Research into the Next Potential PandemicLife10.3390/life1407078314:7(783)Online publication date: 21-Jun-2024
https://doi.org/10.3390/life14070783
Naseem UDunn AKhushi MKim JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Vaccine Misinformation Detection in X using Cooperative Multimodal FrameworkProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681422(4034-4042)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681422
Zhu JGao CYin ZLi XKurths JBaeza-Yates RBonchi F(2024)Propagation Structure-Aware Graph Transformer for Robust and Interpretable Fake News DetectionProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3672024(4652-4663)Online publication date: 25-Aug-2024
https://dl.acm.org/doi/10.1145/3637528.3672024
Show More Cited By

Index Terms

A Duo-generative Approach to Explainable Multimodal COVID-19 Misinformation Detection
1. Computing methodologies
2. Information systems
  1. Information retrieval
  2. Information systems applications

Index terms have been assigned to the content through auto-classification.

Recommendations

Are Mutated Misinformation More Contagious? A Case Study of COVID-19 Misinformation on Twitter
WebSci '22: Proceedings of the 14th ACM Web Science Conference 2022

The spread of online misinformation has become a major global risk. Understanding how misinformation propagates on social media is vital. While prior studies suggest that the content factors, such as emotion and topic in texts, are closely related to the ...
Co-spread of Misinformation and Fact-Checking Content During the Covid-19 Pandemic
Social Informatics
Abstract
In the context of the Covid-19 pandemic, the consequences of misinformation are a matter of life and death. Correcting misconceptions and false beliefs are important for injecting reliable information about the outbreak. Fact-checking ...
Demographics and topics impact on the co-spread of COVID-19 misinformation and fact-checks on Twitter
Abstract
Correcting misconceptions and false beliefs are important for injecting reliable information about COVID-19 into public discourse, but what impact does this have on the continued proliferation of misinforming claims? Fact-checking ...
Highlights
- The relation between misinformation and fact-checking during COVID-19 is studied.

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

WWW '22: Proceedings of the ACM Web Conference 2022

April 2022

3764 pages

ISBN:9781450390965

DOI:10.1145/3485447

Editors:
Frédérique Laforest
INSA Lyon, France
,
Raphaël Troncy
EURECOM, France
,
Elena Simperl
King’s College London, UK
,
Deepak Agarwal
Pinterest, USA
,
Aristides Gionis
KTH Royal Institute of Technology, Sweden
,
Ivan Herman
W3C / retired
,
Lionel Médini
Université Lyon 1, France

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 April 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

National Science Foundation

Conference

WWW '22

Sponsor:

SIGWEB

WWW '22: The ACM Web Conference 2022

April 25 - 29, 2022

Virtual Event, Lyon, France

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
831
Total Downloads

Downloads (Last 12 months)147
Downloads (Last 6 weeks)20

Reflects downloads up to 16 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Khalili HWimmer M(2024)Towards Improved XAI-Based Epidemiological Research into the Next Potential PandemicLife10.3390/life1407078314:7(783)Online publication date: 21-Jun-2024
https://doi.org/10.3390/life14070783
Naseem UDunn AKhushi MKim JCai JKankanhalli MPrabhakaran BBoll SSubramanian RZheng LSingh VCesar PXie LXu D(2024)Vaccine Misinformation Detection in X using Cooperative Multimodal FrameworkProceedings of the 32nd ACM International Conference on Multimedia10.1145/3664647.3681422(4034-4042)Online publication date: 28-Oct-2024
https://dl.acm.org/doi/10.1145/3664647.3681422
Zhu JGao CYin ZLi XKurths JBaeza-Yates RBonchi F(2024)Propagation Structure-Aware Graph Transformer for Robust and Interpretable Fake News DetectionProceedings of the 30th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3637528.3672024(4652-4663)Online publication date: 25-Aug-2024
https://dl.acm.org/doi/10.1145/3637528.3672024
Wang JQian SHu JHong R(2024)Comment-Context Dual Collaborative Masked Transformer Network for Fake News DetectionIEEE Transactions on Multimedia10.1109/TMM.2023.333007426(5170-5180)Online publication date: 2024
https://doi.org/10.1109/TMM.2023.3330074
Gong YShang LWang D(2024)Integrating Social Explanations Into Explainable Artificial Intelligence (XAI) for Combating Misinformation: Vision and ChallengesIEEE Transactions on Computational Social Systems10.1109/TCSS.2024.340423611:5(6705-6726)Online publication date: Oct-2024
https://doi.org/10.1109/TCSS.2024.3404236
Yan FZhang MWei BRen KJiang W(2024)SARD: Fake news detection based on CLIP contrastive learning and multimodal semantic alignmentJournal of King Saud University - Computer and Information Sciences10.1016/j.jksuci.2024.10216036:8(102160)Online publication date: Oct-2024
https://doi.org/10.1016/j.jksuci.2024.102160
Zhong SPeng SLiu XZhu LXu XLi T(2024)Ecarnet: enhanced clue-ambiguity reasoning network for multimodal fake news detectionMultimedia Systems10.1007/s00530-023-01256-x30:1Online publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1007/s00530-023-01256-x
Jangra AMukherjee SJatowt ASaha SHasanuzzaman M(2023)A Survey on Multi-modal SummarizationACM Computing Surveys10.1145/358470055:13s(1-36)Online publication date: 13-Jul-2023
https://dl.acm.org/doi/10.1145/3584700
Liao SOkpala ECheng LLi MVishwamitra NHu HLuo FCostello MSingh ASun YAkoglu LGunopulos DYan XKumar ROzcan FYe J(2023)Analysis of COVID-19 Offensive Tweets and Their TargetsProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599773(4473-4484)Online publication date: 6-Aug-2023
https://dl.acm.org/doi/10.1145/3580305.3599773
Wu JHooi BSingh ASun YAkoglu LGunopulos DYan XKumar ROzcan FYe J(2023)DECOR: Degree-Corrected Social Graph Refinement for Fake News DetectionProceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining10.1145/3580305.3599298(2582-2593)Online publication date: 6-Aug-2023
https://dl.acm.org/doi/10.1145/3580305.3599298
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents