Awesome Low-quality Multimodal Learning

By Qingyang Zhang (qingyangzhang@tju.edu.cn) and Yake Wei (yakewei@ruc.edu.cn). Please feel free to contact us if any comments.

Incomplete multimodal learning

Exploring and exploiting uncertainty for incomplete multi-view classification [CVPR 2023]
Deep partial multi-view learning [TPAMI 2022]

What Makes Training Multi-Modal Classification Networks Hard? [CVPR 2020]
Joint Audio-Visual Deepfake Detection [ICCV 2021]
Balanced Multimodal Learning via On-the-fly Gradient Modulation [CVPR 2022]
Characterizing and Overcoming the Greedy Nature of Learning in Multi-modal Deep Neural Networks [ICML 2022]
On Uni-Modal Feature Learning in Supervised Multi-Modal Learning [ICML 2023]
MMCosine: Multi-Modal Cosine Loss Towards Balanced Audio-Visual Fine-Grained Learning [ICASSP 2023]
Quantifying and Enhancing Multi-modal Robustness with Modality Preference [ICLR 2024]
PMR: Prototypical Modal Rebalance for Multimodal Learning [CVPR 2023]
Utilizing Greedy Nature for Multimodal Conditional Image Synthesis in Transformers [TMM 2023]
Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation [arXiv 2023]
Adaptive Mask Co-Optimization for Modal Dependence in Multimodal Learning [ICASSP 2024]
Enhancing Multimodal Cooperation via Fine-grained Modality Valuation [CVPR 2024]
Diagnosing and Re-learning for Balanced Multimodal Learning [ECCV 2024]
MMPareto: Boosting Multimodal Learning with Innocent Unimodal Assistance [ICML 2024]
Quantifying and Enhancing Multi-modal Robustness with Modality Preference [ICLR 2024]

Provable dynamic fusion for low-quality multimodal data [ICML 2023]
Reliable Multimodality Eye Disease Screening via Mixture of Student's t Distributions [MICCA 2023]
Fast Road Segmentation via Uncertainty-aware Symmetric Network [ICRA 2022]
Trustworthy multimodal regression with mixture of normal-inverse gamma distributions [NIPS 2021]
Trusted multi-view deep learning with opinion aggregation [AAAI 2022]
Multimodal dynamics: Dynamical fusion for trustworthy multimodal classification [CVPR 2022]
Reliable Conflictive Multi-View Learning [AAAI 2024 best paper]
Weakly aligned cross-modal learning for multispectral pedestrian detection [CVPR 2019]
Trusted multi-view classification [ICLR 2020]
Trusted multi-view classification with dynamic evidential fusion [TPAMI 2022]
Test-time adaption against multi-modal reliability bias [ICLR 2024]
Predictive Dynamic Fusion [ICML 2024]