Job processing method, device and system based on big data environment and storage medium
The embodiment of the invention relates to a job processing method, device and system based on a big data environment and a storage medium. The method comprises the steps of collecting big data job information in real time; determining whether a job corresponding to the big data job information meet...
Gespeichert in:
1. Verfasser: | |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The embodiment of the invention relates to a job processing method, device and system based on a big data environment and a storage medium. The method comprises the steps of collecting big data job information in real time; determining whether a job corresponding to the big data job information meets a resource scheduling triggering condition or not according to the big data job information; whenit is determined that the job meets the resource scheduling triggering condition, executing processing operation corresponding to the resource scheduling triggering condition on the job, and the processing operation comprises early warning processing or searching and killing processing. By means of the mode, the situation that under the condition that platform resources are limited, various taskscompete for resources is avoided as much as possible. The overall execution time of various big data tasks is shortened, the SLA aging influence of providing data services for business analysis is avoided, and an enterprise ma |
---|