Language model training method and device, language model prediction method and device and electronic equipment

The invention relates to a language model training method and device, a language model prediction method and device and electronic equipment. The language model training method comprises the steps of obtaining a training positive sample and a training negative sample; inputting the training positive...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZENG PEIYANG, LIU ZHENGUO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a language model training method and device, a language model prediction method and device and electronic equipment. The language model training method comprises the steps of obtaining a training positive sample and a training negative sample; inputting the training positive sample and the training negative sample into a to-be-trained language model, and training the to-be-trained language model; under the condition that a loss function value obtained based on an output result of the trained language model is smaller than a preset threshold value, determining the trained language model as a target language model; the target language model is used for predicting the semantic integrity of the to-be-recognized search information. The training negative sample is obtained by deleting and/or replacing at least one search word in the preset search information, that is, the negative label in the training negative sample is obtained by deleting or replacing the search word, so that the negativ