Garbage collection method and system based on node dependency relationship
The invention provides a garbage collection method and system based on a node dependency relationship, and relates to the technical field of data analysis, and the method provided by the invention comprises the following steps: analyzing a data processing task sequence to obtain a task node sequence...
Gespeichert in:
Hauptverfasser: | , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention provides a garbage collection method and system based on a node dependency relationship, and relates to the technical field of data analysis, and the method provided by the invention comprises the following steps: analyzing a data processing task sequence to obtain a task node sequence; generating a reference count of the data processing task sequence with the dependency relationship; optimizing the data processing task sequence to form a materialized sequence; executing a materialization sequence and carrying out garbage collection; the system provided by the invention comprises a task analysis module, a node materialization module and a garbage collection module. Through the method and the system provided by the invention, garbage collection can be helped in a task sequence with a reference relationship between nodes, and storage resources of computing equipment are saved.
本发明提供一种基于节点依赖关系的垃圾回收方法和系统,涉及数据分析技术领域,本发明提供的方法包括:分析数据处理任务序列得到任务节点序列;生成具有依赖关系的数据处理任务序列的引用计数;优化数据处理任务序列形成物化序列;执行物化序列并进行垃圾回收;本 |
---|