Text generation method and device and language model training method and device

The invention discloses a text generation method and device and a language model training method and device. The method comprises the following steps: acquiring text data; using a language model to generate the text data to obtain a generated text, the language model being obtained by training an in...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: WANG ZIHAN, SONG SHUANGYONG, LIU XINZHANG, WANG CHAO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a text generation method and device and a language model training method and device. The method comprises the following steps: acquiring text data; using a language model to generate the text data to obtain a generated text, the language model being obtained by training an initial language model through first training data and a scoring model, the first training data being training data extracted from training data sets corresponding to the multiple fields according to initial weights of the multiple fields, and the scoring model being a scoring model; the initial weights of the multiple fields are obtained by dynamically adjusting a first scoring result of the initial language model, and the first scoring result is obtained by scoring a target training result of the initial language model through a scoring model. The technical problem of low text generation accuracy is solved. 本发明公开了一种文本生成方法及装置、语言模型的训练方法及装置。其中,该方法包括:获取文本数据;利用语言模型对文本数据进行生成,得到生成文本,其中,语言模型通过第一训练数据和评分模型对初始语言模型进行训练得到,第一训练数