DOCmT5: Document-Level Pretraining of Multilingual Language Models

In this paper, we introduce DOCmT5, a multilingual sequence-to-sequence language model pretrained with large scale parallel documents. While previous approaches have focused on leveraging sentence-level parallel data, we try to build a general-purpose pretrained model that can understand and generat...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2022-05
Hauptverfasser:	Chia-Hsuan, Lee, Siddhant, Aditya, Ratnakar, Viresh, Johnson, Melvin
Format:	Artikel
Sprache:	eng
Schlagworte:	Documents Language Machine translation Multilingualism Training
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!