DYNAMIC WORKLOAD TUNING
Techniques are provided for dynamic workload tuning of a data pipeline that includes a plurality of stages, each associated with a respective storage element, a storage element monitor, and a resource manager. In one embodiment, the techniques involve the storage element monitor determining a utiliz...
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Format: | Patent |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| Zusammenfassung: | Techniques are provided for dynamic workload tuning of a data pipeline that includes a plurality of stages, each associated with a respective storage element, a storage element monitor, and a resource manager. In one embodiment, the techniques involve the storage element monitor determining a utilization of a storage element associated with a first stage of the plurality of stages, comparing the utilization of the storage element to a first threshold, generating a signal based on the comparison of the storage element to the first threshold, output the signal; and the resource manager receiving the signal, determining that the signal indicates an increase or decrease of resources for the first stage, and adjusting compute resources for the first stage based on the signal in order to effect a change in the utilization of the storage element. |
|---|