Fine adjustment data screening method and device, computer equipment and readable storage medium
The invention relates to the field of big data, and particularly discloses a fine tuning data screening method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps that a to-be-labeled data set is obtained, the to-be-labele...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention relates to the field of big data, and particularly discloses a fine tuning data screening method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps that a to-be-labeled data set is obtained, the to-be-labeled data set comprises data meeting preset data quality requirements, quality scoring is conducted on the to-be-labeled data set, a quality scoring result of the to-be-labeled data set is obtained, a data theme in the to-be-labeled data set is extracted, and the to-be-labeled data set is labeled based on the extracted data theme. The to-be-labeled data set is divided into a plurality of subject data sets, the subject data sets are in one-to-one correspondence with the data subjects, target data with the quality score higher than a preset score threshold value is screened out from each subject data set, the target data in each subject data set is collected, and a fine adjustment data set is obtained. By adopting the m |
---|