Data skew insensitive parallel join scheme
A method for creating a joined data set from a join input data set is disclosed. The method starts by categorizing the join input data set into a high-skew data set and a low-skew data set (302). The low-skew data set is distributed to the plurality of CPUs using a first distribution method (306). T...
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Patent |
| Sprache: | eng ; fre ; ger |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Zusammenfassung: | A method for creating a joined data set from a join input data set is disclosed. The method starts by categorizing the join input data set into a high-skew data set and a low-skew data set (302). The low-skew data set is distributed to the plurality of CPUs using a first distribution method (306). The high-skew data set is distributed to the plurality of CPUs using a second distribution method (304). The plurality of CPUs process the high-skew data set and the low-skew data set to create the joined data set (308). |
|---|