Pre-trained models for natural language processing: A survey

Recently, the emergence of pre-trained models (PTMs) has brought natural language processing (NLP) to a new era. In this survey, we provide a comprehensive review of PTMs for NLP. We first briefly introduce language representation learning and its research progress. Then we systematically categorize...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	Science China. Technological sciences 2020-10, Vol.63 (10), p.1872-1897
Hauptverfasser:	Qiu, XiPeng, Sun, TianXiang, Xu, YiGe, Shao, YunFan, Dai, Ning, Huang, XuanJing
Format:	Artikel
Sprache:	eng
Schlagworte:	Engineering Natural language processing Review Taxonomy
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!