Feature-wise Optimization and Performance-weighted Multimodal Fusion for Social Perception Recognition

• Construct modality-shared and modality-specific encoders that effectively learn shared and specific feature representations of modalities.
• Propose an end-to-end multimodal representation and fusion method for multimodal intent ...

Intent recognition is a crucial task in natural language understanding. Current research mainly focuses on task-specific unimodal intent recognition. However, in real-world scenes, human intentions are complex and need to be judged by integrating ...

Emotion Recognition in Conversation (ERC) is the process of automatically detecting and understanding emotions expressed in a conversation, which plays an important role in human–computer interaction. A conversation generates different modality ...

• A novel bi-stream graph learning framework is proposed.
• Capturing intra-modal contextual information by unimodal stream graph learning.
• Capturing inter -modal interaction information by cross-modal stream graph learning.
• ...

The growing trend of sharing opinion videos on social media platforms leads to more and more attention to multimodal sentiment analysis research. A number of approaches in multimodal sentiment analysis have been proposed and continual improved ...