Data processing method and system

The embodiment of the invention relates to a data processing method and system. A data processing method is provided, comprising: dividing a plurality of content representations into at least one batch of content representations for at least one round of feature clustering iterative computations; th...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: TAO MING, DING SHUNYI, ZHANG LU, ZHANG HAORAN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The embodiment of the invention relates to a data processing method and system. A data processing method is provided, comprising: dividing a plurality of content representations into at least one batch of content representations for at least one round of feature clustering iterative computations; the at least one round of feature clustering iterative calculation is executed, in each round of iteration, a batch of content representations used for the round of iteration are divided into multiple groups of content representations, and the multiple groups of content representations are used for being distributed to the corresponding multiple processing units respectively; distributing a plurality of cluster centers to the plurality of processing units and distributing the plurality of groups of content representations to the corresponding plurality of processing units, wherein each processing unit calculates a similarity measure between each content representation in one group of content representations distribut