It is our great pleasure to welcome you to the 1st International Workshop on Brain-Computer Interfaces (BCI) for Multimedia Understanding -- BCIMM'24, co-located with ACM Multimedia 2024 in Melbourne. Our workshop strategically aligns with the ACM MM 2024 theme, engaging users with multimedia" and understanding multimedia content. In light of the significant strides made in processing human physiological signals from neuroimaging modalities, BCI emerges as a pivotal framework for modelling human behaviour and cognition patterns. Moreover, it opens avenues for establishing "direct" communication pathways between humans and machines for multimedia applications. Our workshop will share the core aspects of engaging multimedia experiences and provide insights into the cognitive understanding of multimedia content.
Proceeding Downloads
Enhancing End-to-End Autonomous Driving Systems Through Synchronized Human Behavior Data
This paper presents a pioneering exploration into the integration of fine-grained human supervision within the autonomous driving domain to enhance system performance. The current advances in End-to-End autonomous driving normally are data-driven and ...
Joint Contrastive Learning with Feature Alignment for Cross-Corpus EEG-based Emotion Recognition
The integration of human emotions into multimedia applications shows great potential for enriching user experiences and enhancing engagement across various digital platforms. Unlike traditional methods such as questionnaires, facial expressions, and ...
Towards Linguistic Neural Representation Learning and Sentence Retrieval from Electroencephalogram Recordings
Decoding linguistic information from non-invasive brain signals using EEG has gained increasing research attention due to its vast applicational potential. Recently, a number of works have adopted a generative-based framework to decode ...
Online Multi-level Contrastive Representation Distillation for Cross-Subject fNIRS Emotion Recognition
Utilizing functional near-infrared spectroscopy (fNIRS) signals for emotion recognition is a significant advancement in understanding human emotions. However, due to the lack of artificial intelligence data and algorithms in this field, current research ...
EEG-Based Contrastive Learning Models For Object Perception Using Multisensory Image-Audio Stimuli
Multimedia sources such as images and audio commonly activate human senses to perceive objects, but limited research has explored the combined effect of these stimuli on predicting semantic object perception. In this study, we compare the performance of ...
A Case Study on the Effects of Auditory Cues in Influencing Spatial Memory and Representation for a Person Who is Blind
Navigation is a coordinated and goal-oriented movement through the environment, in which vision is an integral part of acquiring spatial information. People with blindness and vision impairment rely on alternative senses to navigate in daily life. ...
Decoding Working Memory Representation Based on single-trial EEG By a Deep Learning Framework
Although current research has made significant progress in decoding working memory (WM) representation information, this area still faces several limitations that cannot be ignored. These limitations mainly include a lack of understanding of the dynamic ...
Brain-Computer Interface Meets Information Retrieval: Perspective on Next-generation Information System
Information retrieval (IR) applications, such as search engines, ChatGPT, and recommender systems, have become essential tools for acquiring knowledge, making decisions, and solving problems. These systems have transformed the web into an external memory ...
Index Terms
- Proceedings of the 1st International Workshop on Brain-Computer Interfaces (BCI) for Multimedia Understanding