Text generation method, device and system in low-resource scene

The invention provides a text generation method, device and system in a low-resource scene, and the method comprises the steps: 1, inputting a small number of supervised training samples for a supervised network, inputting a large number of unsupervised training samples for an unsupervised network,...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: DENG TING, JIANG WEIFENG, LIU JUNNAN, TAI ZHENYING, LI JIANXIN, MAO QIANREN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a text generation method, device and system in a low-resource scene, and the method comprises the steps: 1, inputting a small number of supervised training samples for a supervised network, inputting a large number of unsupervised training samples for an unsupervised network, copying two unsupervised documents, and carrying out the dropout of the embedded vectors of the unsupervised documents, so as to obtain two groups of embedded vectors; 2, generating a small neural network of a network parallel integration adapter for the large pre-training text, and forming a pre-training learning assembly based on adapter fine tuning; and step 3, performing consistent learning on the unsupervised network by adopting an adapter-based fine-tuning pre-training learning component for the supervised network and the unsupervised network, performing training and optimization of a text generation model in combination with supervised learning of the supervised network, and performing prediction by using th