Nothing Special   »   [go: up one dir, main page]

skip to main content
research-article

Event Classification in Microblogs via Social Tracking

Published: 08 February 2017 Publication History

Abstract

Social media websites have become important information sharing platforms. The rapid development of social media platforms has led to increasingly large-scale social media data, which has shown remarkable societal and marketing values. There are needs to extract important events in live social media streams. However, microblogs event classification is challenging due to two facts, i.e., the short/conversational nature and the incompatible meanings between the text and the corresponding image in social posts, and the rapidly evolving contents. In this article, we propose to conduct event classification via deep learning and social tracking. First, we introduce a Multi-modal Multi-instance Deep Network (M2DN) for microblogs classification, which is able to handle the weakly labeled microblogs data oriented from the incompatible meanings inside microblogs. Besides predicting each microblogs as predefined events, we propose to employ social tracking to extract social-related auxiliary information to enrich the testing samples. We extract a set of candidate-relevant microblogs in a short time window by using social connections, such as related users and geographical locations. All these selected microblogs and the testing data are formulated in a Markov Random Field model. The inference on the Markov Random Field is conducted to update the classification results of the testing microblogs. This method is evaluated on the Brand-Social-Net dataset for classification of 20 events. Experimental results and comparison with the state of the arts show that the proposed method can achieve better performance for the event classification task.

References

[1]
J. Allan, R. Papka, and V. Lavrenko. 1998. On-line new event detection and tracking. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.
[2]
E. Amigó, J. Gonzalo, J. Artiles, and F. Verdejo. 2009. A comparison of extrinsic clustering evaluation metrics based on formal constraints. Information Retrieval 12, 4 (2009), 461--486.
[3]
Sitaram Asur and Bernardo A. Huberman. 2010. Predicting the future with social media. In Proceedings of IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, Vol. 1. IEEE, 492--499.
[4]
Boris Babenko, Ming-Hsuan Yang, and Serge Belongie. 2009. Visual tracking with online multiple instance learning. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 983--990.
[5]
H. Becker, M. Naaman, and L. Gravano. 2010. Learning similarity metrics for event identification in social media. In Proceedings of ACM International Conference on Web Search and Data Mining. 291--300.
[6]
Yoshua Bengio. 2009. Learning deep architectures for AI. Foundations and Trends in Machine Learning (2009).
[7]
Jeff Donahue, Yangqing Jia, Oriol Vinyals, Judy Hoffman, Ning Zhang, Eric Tzeng, and Trevor Darrell. 2013. Decaf: A deep convolutional activation feature for generic visual recognition. arXiv Preprint arXiv:1310.1531
[8]
David Easley and Jon Kleinberg. 2010. Networks, Crowds, and Markets. Cambridge University Press.
[9]
Weiguo Fan and Michael D. Gordon. 2014. The power of social media analytics. Commun. ACM 57, 6 (2014), 74--81.
[10]
Yue Gao, Fanglin Wang, and Tat-Seng Chua Huabo Luan. 2014. Brand data gathering from live social media streams. In Proceedings of ACM Conference on Multimedia Retrieval.
[11]
Yue Gao, Yi Zhen, Haojie Li, and Tat-Seng Chua. 2016. Filtering of brand-related microblogs using social-smooth multiview embedding. IEEE Transactions on Multimedia (2016).
[12]
David Hardoon, Sandor Szedmak, and John Shawe-Taylor. 2004. Canonical correlation analysis: An overview with application to learning methods. Neural Computation 16, 12 (2004), 2639--2664.
[13]
Qi He, Kuiyu Chang, and Ee-Peng Lim. 2007. Analyzing feature trajectories for event detection. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval. 207--214.
[14]
M. Hearst. 2009. Search User Interfaces. Cambridge University Press.
[15]
Alexander T. Ihler, John W. Fisher III, Alan S. Willsky, and David Maxwell Chickering. 2005. Loopy belief propagation: Convergence and effects of message errors. Journal of Machine Learning Research 6, 5 (2005).
[16]
Andreas M. Kaplan and Michael Haenlein. 2010. Users of the world, unite! The challenges and opportunities of social media. Business Horizons 53, 1 (2010), 59--68.
[17]
Andrej Karpathy, George Toderici, Sachin Shetty, Tommy Leung, Rahul Sukthankar, and Li Fei-Fei. 2014. Large-scale video classification with convolutional neural networks. In Proceedings of IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1725--1732.
[18]
Koray Kavukcuoglu, Pierre Sermanet, Y-Lan Boureau, Karol Gregor, Michaël Mathieu, and Yann L. Cun. 2010. Learning convolutional feature hierarchies for visual recognition. In Proceedings of Advances in Neural Information Processing Systems. 1090--1098.
[19]
Jon Kleinberg. 2002. Bursty and hierarchical structure in streams. In Proceedings of the 8th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. 91--101.
[20]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012a. Imagenet classification with deep convolutional neural networks. In Proceedings of Advances in Neural Information Processing Systems. 1097--1105.
[21]
Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012b. ImageNet classification with deep convolutional neural networks. In Proceedings of Advances in Neural Information Processing Systems.
[22]
Svetlana Lazebnik, Cordelia Schmid, and Jean Ponce. 2006. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition, Vol. 2. IEEE, 2169--2178.
[23]
C. D. Manning, P. Raghavan, and H. Schütze. 2008. Introduction to information retrieval. In Cambridge Univ. Press.
[24]
Oded Maron and Aparna Lakshmi Ratan. 1998. Multiple-instance learning for natural scene classification. In Proceedings of International Conference on Machine Learning, Vol. 98. Citeseer, 341--349.
[25]
Megha Pandey and Svetlana Lazebnik. 2011. Scene recognition and weakly supervised object localization with deformable part-based models. In Proceedings of IEEE International Conference on Computer Vision. IEEE, 1307--1314.
[26]
Gabriel Pui, Cheong Fung, Jeffrey Xu Yu, Philip S. Yu, and Hongjun Lu. 2005. Parameter free bursty events detection in text streams. In Proceedings of the International Conference on Very Large Data Bases. 181--192.
[27]
Ning Qian. 1999. On the momentum term in gradient descent learning algorithms. Neural Networks 12, 1 (1999), 145--151.
[28]
Timo Reuter and Philipp Cimiano. 2012. Event-based classification of social media streams. In Proceedings of the 2nd ACM International Conference on Multimedia Retrieval.
[29]
Hassan Sayyadi, Matthew Hurst, and Alexey Maykov. 2009. Event detection and tracking in social streams. In Proceedings of ACM International Conference on Web Search and Data Mining.
[30]
Bharath Sriram, Dave Fuhry, Engin Demir, Hakan Ferhatosmanoglu, and Murat Demirbas. 2010. Short text classification in Twitter to improve information filtering. In Proceedings of the International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 841--842.
[31]
A. Strehl, J. Ghosh, and C. Cardie. 2002. Cluster ensembles - a knowledge reuse framework for combining multiple partitions. Journal of Machine Learning Research 3 (2002), 583--617.
[32]
Bruce Thompson. 2005. Canonical correlation analysis. Encyclopedia of Statistics in Behavioral Science.
[33]
Tijmen Tieleman. 2008. Training restricted Boltzmann machines using approximations to the likelihood gradient. In Proceedings of International Conference on Machine Learning.
[34]
Jian Shu Weng and Bu Sung Lee. 2011. Event detection in Twitter. In Proceedings of International Conference on Weblogs and Social Media.
[35]
Y. Yang, T. Pierce, and J. G. Carbonell. 1998. A study on retrospective and on-line event detection. In Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval.
[36]
Xiangmin Zhou and Lei Chen. 2014. Event detection over twitter social media streams. International Journal on Very Large Data Bases 23, 3 (2014), 381--400.

Cited By

View all
  • (2024)Situation Awareness in AI-Based Technologies and Multimodal Systems: Architectures, Challenges and ApplicationsIEEE Access10.1109/ACCESS.2024.341637012(88779-88818)Online publication date: 2024
  • (2024)Adaptive semantic transfer network for unsupervised 2D image-based 3D model retrievalComputer Vision and Image Understanding10.1016/j.cviu.2023.103858238(103858)Online publication date: Jan-2024
  • (2023)Graph-Based Interactive Matching for Pairs of News ArticlesCognitive Computation10.1007/s12559-023-10208-616:2(507-516)Online publication date: 30-Oct-2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Transactions on Intelligent Systems and Technology
ACM Transactions on Intelligent Systems and Technology  Volume 8, Issue 3
Special Issue: Mobile Social Multimedia Analytics in the Big Data Era and Regular Papers
May 2017
320 pages
ISSN:2157-6904
EISSN:2157-6912
DOI:10.1145/3040485
  • Editor:
  • Yu Zheng
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 08 February 2017
Accepted: 01 June 2016
Revised: 01 June 2016
Received: 01 May 2015
Published in TIST Volume 8, Issue 3

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Event classification
  2. Markov Random Field (MRF)
  3. multi-instance
  4. multi-modal
  5. social tracking

Qualifiers

  • Research-article
  • Research
  • Refereed

Funding Sources

  • National Science and Technology Major Project
  • NSFC
  • The National Key Technology R8D Program
  • MIIT IT funds (Research and application of TCN key technologies) of China

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)31
  • Downloads (Last 6 weeks)1
Reflects downloads up to 22 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Situation Awareness in AI-Based Technologies and Multimodal Systems: Architectures, Challenges and ApplicationsIEEE Access10.1109/ACCESS.2024.341637012(88779-88818)Online publication date: 2024
  • (2024)Adaptive semantic transfer network for unsupervised 2D image-based 3D model retrievalComputer Vision and Image Understanding10.1016/j.cviu.2023.103858238(103858)Online publication date: Jan-2024
  • (2023)Graph-Based Interactive Matching for Pairs of News ArticlesCognitive Computation10.1007/s12559-023-10208-616:2(507-516)Online publication date: 30-Oct-2023
  • (2022)A Review on Methods and Applications in Multimodal Deep LearningACM Transactions on Multimedia Computing, Communications, and Applications10.1145/354557219:2s(1-41)Online publication date: 27-Oct-2022
  • (2021)Multimodal Semantics-Based Supervised Latent Dirichlet Allocation for Event ClassificationIEEE MultiMedia10.1109/MMUL.2021.307791528:4(8-17)Online publication date: 1-Oct-2021
  • (2021)Spectral Clustering of Events in Social Media Flood Images based on Multimodal Analysis2021 7th International Conference on Electrical Energy Systems (ICEES)10.1109/ICEES51510.2021.9383727(648-653)Online publication date: 11-Feb-2021
  • (2021)Wasserstein distance feature alignment learning for 2D image-based 3D model retrievalJournal of Visual Communication and Image Representation10.1016/j.jvcir.2021.103197(103197)Online publication date: Jun-2021
  • (2021)Multi-feature, multi-modal, and multi-source social event detection: A comprehensive surveyInformation Fusion10.1016/j.inffus.2021.10.013Online publication date: Nov-2021
  • (2020)Knowledge-Based Topic Model for Multi-Modal Social Event AnalysisIEEE Transactions on Multimedia10.1109/TMM.2019.295119422:8(2098-2110)Online publication date: Aug-2020
  • (2020)An All-Weather Lane Detection System Based on Simulation Interaction PlatformIEEE Access10.1109/ACCESS.2018.28855688(46121-46130)Online publication date: 2020
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media