Official implementations for paper: DreamTalk: When Expressive Talking Head Generation Meets Diffusion Probabilistic Models

[ECCV 2022] & [IJCV 2024] Official implementation of the paper: Audio-Visual Segmentation (with Semantics)

[ECCV 2024 Oral] EDTalk - Official PyTorch Implementation

Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018

[CVPR 2022] Code for "Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generation"

Co-Separating Sounds of Visual Objects (ICCV 2019)

PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning

Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baseline (CVPR 2023)

A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models (ICASSP 2024)

[2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line

ABAW3 (CVPRW): A Joint Cross-Attention Model for Audio-Visual Fusion in Dimensional Emotion Recognition

Official implementation for AVGN

[CVPR 2023] Collecting Cross-Modal Presence-Absence Evidence for Weakly-Supervised Audio-Visual Event Perception

The unofficial implementation of paper, "Objects that Sound", from ECCV 2018.

IEEE T-BIOM : "Audio-Visual Fusion for Emotion Recognition in the Valence-Arousal Space Using Joint Cross-Attention"

Official Codebase of "Localizing Visual Sounds the Easy Way" (ECCV 2022)

FG2021: Cross Attentional AV Fusion for Dimensional Emotion Recognition

[2023 TPAMI] Contrastive Positive Sample Propagation along the Audio-Visual Event Line

Unified Audio-Visual Perception for Multi-Task Video Localization

Official codebase for "Unveiling the Power of Audio-Visual Early Fusion Transformers with Dense Interactions through Masked Modeling".