Job processing method, device and system based on big data environment and storage medium

The embodiment of the invention relates to a job processing method, device and system based on a big data environment and a storage medium. The method comprises the steps of collecting big data job information in real time; determining whether a job corresponding to the big data job information meet...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: YANG ZESEN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The embodiment of the invention relates to a job processing method, device and system based on a big data environment and a storage medium. The method comprises the steps of collecting big data job information in real time; determining whether a job corresponding to the big data job information meets a resource scheduling triggering condition or not according to the big data job information; whenit is determined that the job meets the resource scheduling triggering condition, executing processing operation corresponding to the resource scheduling triggering condition on the job, and the processing operation comprises early warning processing or searching and killing processing. By means of the mode, the situation that under the condition that platform resources are limited, various taskscompete for resources is avoided as much as possible. The overall execution time of various big data tasks is shortened, the SLA aging influence of providing data services for business analysis is avoided, and an enterprise ma