Decoding method and device in text generation field, equipment and medium

The embodiment of the invention relates to the technical field of natural language processing, in particular to a decoding method, device, equipment and medium in the field of text generation, different from top-k sampling through a fixed window, in each decoding time step of a decoder, a word with...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: WANG WEI, ZENG ZHIXIAN, CHEN HUANKUN, ZHONG YANTAO, ZHANG QIAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The embodiment of the invention relates to the technical field of natural language processing, in particular to a decoding method, device, equipment and medium in the field of text generation, different from top-k sampling through a fixed window, in each decoding time step of a decoder, a word with a fixed length is not selected as a candidate set during decoding, and the decoding efficiency is improved. Instead, the words with the occurrence probability exceeding a probability threshold value are selected as a candidate set, the candidate set contains core words, it is ensured that the decoded words are screened from the head candidate words, the probability threshold value can be dynamically adjusted along with different probability distributions of the decoded words in each time step, the size of the candidate word set can be dynamically changed, and the probability distribution of the decoded words in each time step is not changed. In this way, coherence of the text generated after decoding can be guarant