Fine adjustment data screening method and device, computer equipment and readable storage medium

The invention relates to the field of big data, and particularly discloses a fine tuning data screening method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps that a to-be-labeled data set is obtained, the to-be-labele...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: LIN TINGMAO, HU YINGXI, YU YASHEN, LIU ZHIDAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to the field of big data, and particularly discloses a fine tuning data screening method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps that a to-be-labeled data set is obtained, the to-be-labeled data set comprises data meeting preset data quality requirements, quality scoring is conducted on the to-be-labeled data set, a quality scoring result of the to-be-labeled data set is obtained, a data theme in the to-be-labeled data set is extracted, and the to-be-labeled data set is labeled based on the extracted data theme. The to-be-labeled data set is divided into a plurality of subject data sets, the subject data sets are in one-to-one correspondence with the data subjects, target data with the quality score higher than a preset score threshold value is screened out from each subject data set, the target data in each subject data set is collected, and a fine adjustment data set is obtained. By adopting the m