Fuzzy commonsense reasoning for multimodal sentiment analysis
I Chaturvedi, R Satapathy, S Cavallari… - Pattern Recognition …, 2019 - Elsevier
Pattern Recognition Letters, 2019•Elsevier
The majority of user-generated content posted online is in the form of text, images and
videos but also physiological signals in games. AffectiveSpace is a vector space of affective
commonsense available for English text but not for other languages nor other modalities
such as electrocardiogram signals. We overcome this limitation by using deep learning to
extract features from each modality and then projecting them to a common AffectiveSpace
that has been clustered into different emotions. Because, in the real world, individuals tend …
videos but also physiological signals in games. AffectiveSpace is a vector space of affective
commonsense available for English text but not for other languages nor other modalities
such as electrocardiogram signals. We overcome this limitation by using deep learning to
extract features from each modality and then projecting them to a common AffectiveSpace
that has been clustered into different emotions. Because, in the real world, individuals tend …
Abstract
The majority of user-generated content posted online is in the form of text, images and videos but also physiological signals in games. AffectiveSpace is a vector space of affective commonsense available for English text but not for other languages nor other modalities such as electrocardiogram signals. We overcome this limitation by using deep learning to extract features from each modality and then projecting them to a common AffectiveSpace that has been clustered into different emotions. Because, in the real world, individuals tend to have partial or mixed sentiments about an opinion target, we use a fuzzy logic classifier to predict the degree of a particular emotion in AffectiveSpace. The combined model of deep convolutional neural networks and fuzzy logic is termed Convolutional Fuzzy Sentiment Classifier. Lastly, because the computational complexity of a fuzzy classifier is exponential with respect to the number of features, we project features to a four dimensional emotion space in order to speed up the classification performance.
Elsevier