Garbage collection method and system based on node dependency relationship

The invention provides a garbage collection method and system based on a node dependency relationship, and relates to the technical field of data analysis, and the method provided by the invention comprises the following steps: analyzing a data processing task sequence to obtain a task node sequence...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: YI SHUIHAN, LIU RUIMIN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention provides a garbage collection method and system based on a node dependency relationship, and relates to the technical field of data analysis, and the method provided by the invention comprises the following steps: analyzing a data processing task sequence to obtain a task node sequence; generating a reference count of the data processing task sequence with the dependency relationship; optimizing the data processing task sequence to form a materialized sequence; executing a materialization sequence and carrying out garbage collection; the system provided by the invention comprises a task analysis module, a node materialization module and a garbage collection module. Through the method and the system provided by the invention, garbage collection can be helped in a task sequence with a reference relationship between nodes, and storage resources of computing equipment are saved. 本发明提供一种基于节点依赖关系的垃圾回收方法和系统,涉及数据分析技术领域,本发明提供的方法包括:分析数据处理任务序列得到任务节点序列;生成具有依赖关系的数据处理任务序列的引用计数;优化数据处理任务序列形成物化序列;执行物化序列并进行垃圾回收;本