Masked Vision and Language Modeling for Multi-modal Representation Learning

In this paper, we study how to use masked signal modeling in vision and language (V+L) representation learning. Instead of developing masked language modeling (MLM) and masked image modeling (MIM) independently, we propose to build joint masked vision and language modeling, where the masked signal o...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Kwon, Gukyeong, Cai, Zhaowei, Ravichandran, Avinash, Bas, Erhan, Bhotika, Rahul, Soatto, Stefano
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computation and Language Computer Science - Computer Vision and Pattern Recognition Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!