An Open Job Scheduling Service for Large-Scale Data Processing

An Open Job Scheduling Service for Large-Scale Data Processing

Scientific Data Grid (SDG) of Chinese Academy of Sciences aims at integrating distributed scientific data, providing transparent data access mechanism and efficient data analysis, processing and visualization services. SDG Job Scheduler (SDGJS) adopts an open and service-oriented framework. The sche...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhenghua Xue, Jianhui Li, Yuanchun Zhou, Yang Zhang, Geng Shen
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Authentication
Computer architecture
Distributed databases
Grid
Job Schedule
Large-Scale Data
Middleware
Monitoring
Processor scheduling
Statistical analysis
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Scientific Data Grid (SDG) of Chinese Academy of Sciences aims at integrating distributed scientific data, providing transparent data access mechanism and efficient data analysis, processing and visualization services. SDG Job Scheduler (SDGJS) adopts an open and service-oriented framework. The scheduling policy of SDGJS considers both performance of computing nodes and distribution of large data so that it can achieve an efficient job processing. SDGJS has successfully served for some data grid applications.
DOI:10.1109/OCS.2011.11