Text processing model training method and device and text processing method and device

The embodiment of the invention provides a text processing model training method and device and a text processing method and device.The text processing model training method comprises the steps that a text entity sequence corresponding to a text sample is constructed, and entity composition units of...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: CHEN YIMING, LIN JINSHU, XU CHUNBO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The embodiment of the invention provides a text processing model training method and device and a text processing method and device.The text processing model training method comprises the steps that a text entity sequence corresponding to a text sample is constructed, and entity composition units of text entities in the text entity sequence are masked according to a preset mask strategy, obtaining a mask text entity sequence; inputting the mask text entity sequence into a text processing model, and performing embedding processing on the mask text entity sequence through an embedding unit in the text processing model to obtain a target embedding vector comprising a unit sequence embedding vector and a text entity embedding vector; performing coding processing on the target embedded vector through a coding unit in the text processing model, and processing a coding processing result through a prediction unit in the text processing model to obtain text prediction information; and performing parameter adjustment o