Nothing Special   »   [go: up one dir, main page]

skip to main content
review-article

Fake news detection based on explicit and implicit signals of a hybrid crowd: : An approach inspired in meta-learning▪

Published: 30 November 2021 Publication History

Highlights

Crowd Signals approach to detect Fake News has produced promising results.
Crowd Signals approach depends on usually unavailable user explicit opinion.
Our approach (Hybrid Crowd Signals) uses user implicit opinion to detect Fake News.
Implicit opinion is inferred from user behavior in News dissemination (reputation).
Inspired in Meta-Learning, Hybrid Crowd can consider machines explicit opinions.

Abstract

The problem of automatic Fake News detection in digital media of news distribution (DMND - e.g., social networks, online newspaper, etc) has become even more relevant. Among the main detection approaches, the one based on crowd signals from DMND users has stood out by obtaining promising results. In essence, in order to classify a piece of news as fake or not fake, such approach explores the collective sense by combining opinions (signals, i.e., votes about the classification of some news) of a high number of users (crowd), considering the reputations of these users regarding their capacity of identifying Fake News. Although promising, the Crowd Signals approach has a significant limitation: it depends on the explicit user opinion (which is not always available) about the classification of the analyzed news. Such unavailability may be caused by the absence of a functionality in the DMND that collects user opinion about the news, or by the simple option of the users in not giving their opinion. Facing this limitation, the present work raises the hypothesis that it is possible to build models of Fake News detection with a performance comparable to the Crowd Signals based approach, avoiding the dependence on the explicit opinion of DMND users. To validate this hypothesis, the present work proposes HCS, an approach based on crowd signals that considers implicit user opinions instead of the explicit ones. The implicit opinions are inferred from the behavior of users concerning the dissemination of the news analyzed. Inspired in Meta-Learning, the HCS can also use the explicit opinions from machines (news classification models) to complement the implicit user opinions by means of hybrid Crowds. Experiments carried out in five datasets presented significant evidence that confirms the raised hypothesis. Even without considering DMND users’ explicit opinions, HCS was able to achieve results comparable to the ones produced by the Crowd Signals approach. Besides that, the results also revealed a performance improvement of HCS when the implicit opinions of the users were combined with the explicit opinions of machines.

References

[1]
O. Ajao, D. Bhowmik, S. Zargari, Sentiment aware fake news detection on online social networks, in: ICASSP 2019–2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2019, pp. 2507–2511.
[2]
Altan, A., & Karasu, S. (2019). The effect of kernel values in support vector machine to forecasting performance of financial time series and cognitive decision making 4, 17–21.
[3]
A. Altan, S. Karasu, S. Bekiros, Digital currency forecasting with chaotic meta-heuristic bio-inspired signal processing techniques, Chaos Solitons & Fractals 126 (2019) 325–336,.
[4]
Altan, A., Karasu, S., Sarac, Z., & Hacioglu, R. (2017). Prediction of solar radiation based on machine learning methods 2.
[5]
A. Altan, S. Karasu, E. Zio, A new hybrid model for wind speed forecasting combining long short-term memory neural network, decomposition methods and grey wolf optimizer, Applied Soft Computing 100 (2021),.
[6]
Braz, P., & Goldschmidt, R. (2017). Um método para detecção de bots sociais baseado em redes neurais convolucionais aplicadas em mensagens textuais, in: SBSeg 2017, pp. 501–508. 10/11/2017.
[7]
Campan, A., Cuzzocrea, A., & Truta, T.M. (2017). Fighting fake news spread in online social networks: Actual trends and future research directions. In 2017 IEEE International Con on Big Data (Big Data) (pp. 4453–4457).
[8]
Castelo, S., Almeida, T., Elghafari, A., Santos, A., Pham, K., Nakamura, E., & Freire, J. (2019). A topic-agnostic approach for identifying fake news pages. In Companion Proceedings of The 2019 World Wide Web Conference, ACM, New York, NY, USA (pp. 975–980).
[9]
Cazalens, S., Lamarre, P., Leblay, J., Manolescu, I., & Tannier, X. (2018). A content management perspective on fact-checking. In Companion Proceedings of the The Web Con 2018, International World Wide Web Con Steering Committee, Republic and Canton of Geneva, Switzerland (pp. 565–574).
[10]
P.K. Chan, S.J. Stolfo, A comparative evaluation of voting and meta-learning on partitioned data, in: Proceedings of the Twelfth International Conference on International Conference on Machine Learning, Morgan Kaufmann Publishers Inc., San Francisco, CA, USA, 1995, pp. 90–98.
[11]
P.H. Chia, S.J. Knapskog, Re-evaluating the wisdom of crowds in assessing web security, in: Proceedings of the 15th International Con on Financial Cryptography and Data Security, Springer-Verlag, Berlin, Heidelberg, 2012, pp. 299–314,.
[12]
Ciampaglia, G.L., Shiralkar, P., Rocha, L.M., Bollen, J., Menczer, F., & Flammini, A. (2015). Computational fact checking from knowledge networks. PLOS ONE 1, 1–13.
[13]
N. Conroy, V. Rubin, Y. Chen, Automatic deception detection: Methods for finding fake news, Association for Information Science and Technology 52 (2015) 1–4,.
[14]
G. Demartini, D.E. Difallah, U. Gadiraju, M. Catasta, An introduction to hybrid human-machine information systems, Foundations and Trends in Web Science 7 (2017) 1–87,.
[15]
S. Deng, L. Huang, G. Xu, Social network-based service recommendation with trust enhancement, Expert Systems with Applications 41 (2014) 8075–8084,.
[16]
Faceli, K., Lorena, A., Gama, J., & De Carvalho, A. (2011). Inteligência Artificial: uma Abordagem de Aprendizado de Máquina. LTC.  https://books.google.com.br/books?id=4DwelAEACAAJ.
[17]
Farajtabar, M., Yang, J., Ye, X., Xu, H., Trivedi, R., Khalil, E., Li, S., Song, L., & Zha, H. (2017). Fake news mitigation via point process based intervention. In Proceedings of the 34th International Con on Machine Learning - Volume 70, JMLR.org (pp. 1097–1106). http://dl.acm.org/citation.cfm?id=3305381.3305495.
[18]
E. Ferrara, O. Varol, C. Davis, F. Menczer, A. Flammini, The rise of social bots, Communications of the ACM 59 (2016) 96–104,.
[19]
Flintham, M., Karner, C., Bachour, K., Creswick, H., Gupta, N., & Moran, S. (2018). Falling for fake news: Investigating the consumption of news via social media. In Proceedings of the 2018 CHI Con on Human Factors in Computing Systems, ACM, New York, NY, USA (pp. 376:1–376:10).
[20]
Freire, P.M.S., & Goldschmidt, R.R. (2019a). Fake news detection on social media via implicit crowd signals. In Proceedings of the 25th Brazilian Symposium on Multimedia and the Web, ACM, New York, NY, USA (pp. 521–524).
[21]
P.M.S. Freire, R.R. Goldschmidt, Uma introduçá ao combate automático ás fake news em redes sociais virtuais, Tópicos de Gerenciamento de Dados e Informação, SBC, Fortaleza, CE, Brazil (2019) 38–67. http://sbbd.org.br/2019/proceedings/.
[22]
Golbeck, J., Mauriello, M., Auxier, B., Bhanushali, K.H., Bonk, C., Bouzaghrane, M.A., et al. (2018). Fake news vs satire: A dataset and analysis. In Proceedings of the 10th ACM Con on Web Science, ACM, New York, NY, USA (pp. 17–21).
[23]
Goldschmidt, R.R., Passos, E., & Bezerra, E. (2015). Data Mining. Conceitos, técnicas, algoritmos, orientações e aplicações. Elsevier.
[24]
B. Guo, Y. Ding, L. Yao, Y. Liang, Z. Yu, The future of false information detection on social media: New perspectives and trends, ACM Computing Surveys 53 (2020),.
[25]
J. Habermas, Teoria de la acción comunicativa: complementos y estudios prévios, Cátedra, Madrid, 1982.
[26]
F. Hendrikx, K. Bubendorfer, R. Chard, Reputation systems: A survey and taxonomy, Journal of Parallel and Distributed Computing (2015) 184–197.
[27]
S. Karasu, A. Altan, S. Bekiros, W. Ahmad, A new forecasting model with wrapper-based feature selection approach using multi-objective optimization technique for chaotic crude oil time series, Energy 212 (2020).
[28]
Kim, J., Tabibian, B., Oh, A., Schölkopf, B., & Gomez-Rodriguez, M. (2018). Leveraging the crowd to detect and reduce the spread of fake news and misinformation. In Proceedings of the Eleventh ACM International Con on Web Search and Data Mining, ACM, New York, NY, USA (pp. 324–332).
[29]
R. Kohavi, et al., A study of cross-validation and bootstrap for accuracy estimation and model selection, in: Ijcai, Montreal, Canada. researchgate, Montreal, Canada, 1995, pp. 1137–1145.
[30]
Y. Li, J. Gao, C. Meng, Q. Li, L. Su, B. Zhao, W. Fan, J. Han, A survey on truth discovery, ACM SIGKDD Explorations Newsletter 17 (2015) 1–16,.
[31]
Y. Liu, Y. BrookWu, Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks, in: AAAI Con on Artificial Intelligence, 2018, pp. 354–361.
[32]
Y. Liu, S. Xu, Detecting rumors through modeling information propagation networks in a social media environment, IEEE Transactions on Computational Social Systems 3 (2016) 46–62,.
[33]
C. Lofi, K.E. Maarry, Design patterns for hybrid algorithmic-crowdsourcing workflows, in: 2014 IEEE 16th Conference on Business Informatics, 2014, pp. 1–8.
[34]
Ma, J., Gao, W., Wei, Z., Lu, Y., & Wong, K.F. (2015). Detect rumors using time series of social context information on microblogging websites. In Proceedings of the 24th ACM International on Con on Information and Knowledge Management, ACM, New York, NY, USA (pp. 1751–1754).
[35]
Mejova, Y., & Kalimeri, K. (2020). Advertisers jump on coronavirus bandwagon: Politics, news, and business. ArXiv abs/2003.00923.
[36]
R.A. Monteiro, R.L.S. Santos, T.A.S. Pardo, T.A. de Almeida, E.E.S. Ruiz, O.A. Vale, Contributions to the study of fake news in portuguese: New corpus and automatic detection results, Computational Processing of the Portuguese Language, Springer International Publishing (2018) 324–334.
[37]
Moore, T., & Clayton, R. (2008). Financial cryptography and data security. In Tsudik, G. (Ed.), International Conference on Financial Cryptography and Data Security. Springer-Verlag, Berlin, Heidelberg. chapter Evaluating the Wisdom of Crowds in Assessing Phishing Websites (pp. 16–30).
[38]
M.P. Moraes, J. de Oliveira Sampaio, A.C. Charles, Data mining applied in fake news classification through textual patterns, in: Proceedings of the 25th Brazillian Symposium on Multimedia and the Web, Association for Computing Machinery, New York, NY, USA, 2019, pp. 321–324,.
[39]
E. Mustafaraj, P.T. Metaxas, The fake news spreading plague:was it preventable?, Web Science Con (2017) 236–239.
[40]
Nasim, M., Nguyen, A., Lothian, N., Cope, R.,& Mitchell, L. (2018). Real-time detection of content polluters in partially observable twitter networks. In Companion Proceedings of the The Web Con 2018, International World Wide Web Con Steering Committee, Republic and Canton of Geneva, Switzerland (pp. 1331–1339).
[41]
Okano1, E.Y., & Ruiz, E.E.S. (2019). Using linguistic cues to detect fake news on the brazilian portuguese parallel corpus fake.br. In XII Symposium in Information and Human Language Technology and Collocates Events (pp. 181–189).
[42]
Reis, J.C.S., Correia, A., Murai, F., Veloso, A., & Benevenuto, F. (2019). Explainable machine learning for fake news detection. In Proceedings of the 10th ACM Conference on Web Science, ACM, New York, NY, USA (pp. 17–26).
[43]
J.C.S. Reis, A. Correia, F. Murai, A. Veloso, F. Benevenuto, Supervised learning for fake news detection, IEEE Intelligent Systems 34 (2019) 76–81,.
[44]
Ruchansky, N., Seo, S., & Liu, Y. (2017). Csi: A hybrid deep model for fake news detection. In Proceedings of the 2017 ACM on Con on Information and Knowledge Management, ACM, New York, NY, USA (pp. 797–806).
[45]
T. Saikh, B. Haripriya, A. Ekbal, P. Bhattacharyya, A deep transfer learning approach for fake news detection, International Joint Conference on Neural Networks (IJCNN) (2020) 1–8,.
[46]
J. Seo, S.H.S. Choi, The method of trust and reputation systems based on link prediction and clustering, IFIP International Con on Trust Management, in, 2013, pp. 223–230.
[47]
Sethi, R.J. (2017). Crowdsourcing the verification of fake news and alternative facts. In Proceedings of the 28th ACM Con on Hypertext and Social Media, ACM, New York, NY, USA (pp. 315–316). http://doi.acm.org/10.1145/3078714.3078746.
[48]
K. Sharma, F. Qian, H. Jiang, N. Ruchansky, M. Zhang, Y. Liu, Combating fake news: A survey on identification and mitigation techniques, ACM Transaction on Intelligent Systems and Technology 10 (2019) 21:1–21:42,.
[49]
W. Sherchan, S. Nepal, C. Paris, A survey of trust in social networks, ACM Computing Surveys 45 (2013) 47:1–47:33,.
[50]
Shu, K., Cui, L., Wang, S., Lee, D., & Liu, H. (2019a). Defend: Explainable fake news detection. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery, New York, NY, USA (pp. 395–405).
[51]
K. Shu, D. Mahudeswaran, H. Liu, Fakenewstracker: A tool for fake news collection, detection, and visualization, Computational and Mathematical Organization Theory 25 (2019) 60–71,.
[52]
K. Shu, D. Mahudeswaran, S. Wang, D. Lee, H. Liu, Fakenewsnet: A data repository with news content, social context, and spatiotemporal information for studying fake news on social media, Big Data 8 (2020) 171–188.
[53]
K. Shu, A. Sliva, S. Wang, J. Tang, H. Liu, Fake news detection on social media: A data mining perspective, SIGKDD Explorations Newsletter 19 (2017) 22–36,.
[54]
Shu, K., Wang, S., & Liu, H. (2017b). Exploiting tri-relationship for fake news detection. arXiv preprint  arXiv:1712.077098.
[55]
Shu, K., Wang, S., & Liu, H. (2019c). Beyond news contents: The role of social context for fake news detection, in: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, ACM, New York, NY, USA (pp. 312–320).
[56]
da Silva, F.R.M., Freire, P.M.S., de Souza, M.P., de A.B. Plenamente, G., & Goldschmidt, R.R. (2020). Fakenewssetgen: A process to build datasets that support comparison among fake news detection methods, Association for Computing Machinery, New York, NY, USA (pp. 241–248).
[57]
M.P. de Souza, F.R.M. da Silva, P.M.S. Freire, R.R. Goldschmidt, A linguistic-based method that combines polarity, emotion and grammatical characteristics to detect fake news in portuguese, in: Proceedings of the Brazilian Symposium on Multimedia and the Web, Association for Computing Machinery, New York, NY, USA, 2020, pp. 217–224,.
[58]
Tschiatschek, S., Singla, A., Gomez Rodriguez, M., Merchant, A., & Krause, A. (2018). Fake news detection in social networks via crowd signals. In Companion Proceedings of the The Web Con 2018, International World Wide Web Con Steering Committee, Republic and Canton of Geneva, Switzerland (pp. 517–524).
[59]
S. Vavilis, M. Petkovi, N. Zannone, A reference model for reputation systems, Decision Support Systems 61 (2014) 147–154,.
[60]
Vo, N., & Lee, K. (2018). The rise of guardians: Fact-checking url recommendation to combat fake news. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, ACM, New York, NY, USA (pp. 275–284).
[61]
S. Vosoughi, M.N. Mohsenvand, D. Roy, Rumor gauge: Predicting the veracity of rumors on twitter, ACM Transactions on Knowledge Discovery from Data 11 (2017) 50:1–50:36,.
[62]
Wang, P., Angarita, R., & Renna, I. (2018). Is this the era of misinformation yet: Combining social bots and fake news to deceive the masses. In Companion Proceedings of the The Web Con 2018, International World Wide Web Con Steering Committee, Republic and Canton of Geneva, Switzerland (pp. 1557–1561).
[63]
Wang, W.Y. (2017). “liar, liar pants on fire”: A new benchmark dataset for fake news detection. In Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Vancouver, Canada (pp. 422–426).
[64]
Wilcoxon, F. (1992). Individual Comparisons by Ranking Methods. Springer New York, New York, NY.
[65]
Woloszyn, V., & Nejdl, W. (2018). Distrustrank: Spotting false news domains. In Proceedings of the 10th ACM Con on Web Science, ACM, New York, NY, USA (pp. 221–228).
[66]
Wu, L., & Liu, H. (2018). Tracing fake-news footprints: Characterizing social media messages by how they propagate, in: Proceedings of the Eleventh ACM International Con on Web Search and Data Mining, ACM, New York, NY, USA (pp. 637–645).
[67]
Xu, S., Liu, L., Cui, L., & Zheng, Y. (2017). Optimal crowds contest model for crowdsourcing. In Proceedings of the 2Nd International Conference on Crowd Science and Engineering, ACM, New York, NY, USA (pp. 72–76).
[68]
J. Yu, Q. Huang, X. Zhou, Y. Sha, Iarnet: An information aggregating and reasoning network over heterogeneous graph for fake news detection, in: 2020 International Joint Conference on Neural Networks (IJCNN), 2020, pp. 1–9,.
[69]
Zhang, Q., Yilmaz, E., & Liang, S. (2018). Ranking-based method for news stance detection. In Companion Proceedings of the The Web Con 2018, International World Wide Web Con Steering Committee, Republic and Canton of Geneva, Switzerland (pp. 41–42).
[70]
T. Zhang, D. Wang, H. Chen, Z. Zeng, W. Guo, C. Miao, L. Cui, Bdann: Bert-based domain adaptation neural network for multi-modal fake news detection, in: 2020 International Joint Conference on Neural Networks (IJCNN), 2020, pp. 1–8,.
[71]
Zhou, X., & Zafarani, R. (2018). Fake news: A survey of research, detection methods, and opportunities. arXiv preprint   arXiv:1812.00315.
[72]
Zhou, X. & Zafarani, R. (2019). Fake news detection: An interdisciplinary research. In Companion Proceedings of The 2019 World Wide Web Conference, ACM, New York, NY, USA (pp. 1292–1292).
[73]
Zhou, X., Zafarani, R., Shu, K., & Liu, H. (2019). Fake news: Fundamental theories, detection strategies and challenges. Proceedings of the Twelfth ACM International Con on Web Search and Data Mining, ACM, New York, NY, USA (pp. 836–837).

Cited By

View all
  • (2024)Improving Implicit Crowd Signals Based Fake News Detection on Social Media: A Time-Aware Method for Early DetectionProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658278(1-9)Online publication date: 20-May-2024
  • (2024)Early detection of fake news on virtual social networksExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123350247:COnline publication date: 1-Aug-2024
  • (2024)FNNet: a secure ensemble-based approach for fake news detection using blockchainThe Journal of Supercomputing10.1007/s11227-024-06216-480:14(20042-20079)Online publication date: 29-May-2024
  • Show More Cited By

Index Terms

  1. Fake news detection based on explicit and implicit signals of a hybrid crowd: An approach inspired in meta-learning▪
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Please enable JavaScript to view thecomments powered by Disqus.

          Information & Contributors

          Information

          Published In

          cover image Expert Systems with Applications: An International Journal
          Expert Systems with Applications: An International Journal  Volume 183, Issue C
          Nov 2021
          1520 pages

          Publisher

          Pergamon Press, Inc.

          United States

          Publication History

          Published: 30 November 2021

          Author Tags

          1. Fake news detection
          2. Crowd signals
          3. Machine learning

          Qualifiers

          • Review-article

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)0
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 17 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2024)Improving Implicit Crowd Signals Based Fake News Detection on Social Media: A Time-Aware Method for Early DetectionProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658278(1-9)Online publication date: 20-May-2024
          • (2024)Early detection of fake news on virtual social networksExpert Systems with Applications: An International Journal10.1016/j.eswa.2024.123350247:COnline publication date: 1-Aug-2024
          • (2024)FNNet: a secure ensemble-based approach for fake news detection using blockchainThe Journal of Supercomputing10.1007/s11227-024-06216-480:14(20042-20079)Online publication date: 29-May-2024
          • (2024)JEDi - a digital educational game to support student training in identifying portuguese-written fake news: Case studies in high school, undergraduate and graduate scenariosEducation and Information Technologies10.1007/s10639-023-12309-z29:10(11815-11845)Online publication date: 1-Jul-2024
          • (2023)Ensembles to Detect Fake News – An Approach Based on Specialized ClassifiersProceedings of the 29th Brazilian Symposium on Multimedia and the Web10.1145/3617023.3617044(154-158)Online publication date: 23-Oct-2023
          • (2023)Trust-based Recommender System for Fake News MitigationAdjunct Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization10.1145/3563359.3597395(104-109)Online publication date: 26-Jun-2023
          • (2023)Data Science, Machine learning and big data in Digital JournalismExpert Systems with Applications: An International Journal10.1016/j.eswa.2023.119795221:COnline publication date: 1-Jul-2023
          • (2022)A quantitative argumentation-based Automated eXplainable Decision System for fake news detection on social mediaKnowledge-Based Systems10.1016/j.knosys.2022.108378242:COnline publication date: 22-Apr-2022
          • (2022)An intelligent cybersecurity system for detecting fake news in social media websitesSoft Computing - A Fusion of Foundations, Methodologies and Applications10.1007/s00500-022-07080-126:12(5577-5591)Online publication date: 1-Jun-2022
          • (2022)FN2: Fake News DetectioN Based on Textual and Contextual FeaturesInformation and Communications Security10.1007/978-3-031-15777-6_26(472-491)Online publication date: 5-Sep-2022

          View Options

          View options

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media