Data screening method and device, storage medium and electronic equipment

The invention relates to a data screening method and device, a storage medium and electronic equipment, and the method comprises the steps: carrying out the recognition of to-be-recognized data through a recognition model, generating a first initial label, adding the to-be-recognized data and the co...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: SUN XIUSONG, HE YI, MA ZEJUN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to a data screening method and device, a storage medium and electronic equipment, and the method comprises the steps: carrying out the recognition of to-be-recognized data through a recognition model, generating a first initial label, adding the to-be-recognized data and the corresponding first initial label into a data training set corresponding to the recognition model, and training an identification model based on the data training set, generating the confusion degree of the to-be-screened data through the trained identification model, and determining the to-be-screened data as target data when the confusion degree is greater than a preset confusion degree threshold value. Therefore, it is guaranteed that the repetition rate of the data screened out through iteration each time and an existing data training set is low, the data training set is distributed more evenly, and the recognition model obtained through final training has better generalization performance. 本公开涉及一种数据筛选方法、装置、存储介质及