Method and system for optimizing data of FlinkSQL repeated consumption data source

The invention discloses a method and system for optimizing FlinkSQL repeated consumption data source data, and relates to the technical field of financial payment. The method comprises the following steps: when an Flink Job is submitted by an Flink Client, obtaining a generated StreamGraph (StreamGraph); and analyzing whether the generated StreamGraph satisfies a pruning condition, if so, performing pruning optimization on the StreamGraph to generate a new StreamGraph, and submitting the new StreamGraph to a cluster for operation. According to the method and the device, the problem of repeated consumption of data of the data source can be avoided when the FlinkSQL operates a plurality of SQL at the same time. 本发明公开了一种优化FlinkSQL重复消费数据源数据的方法及系统，涉及金融支付技术领域。该方法包括：在Flink Client提交Flink Job时，获取生成的StreamGraph；分析生成的StreamGraph是否满足剪枝条件，若满足，则对StreamGraph进行剪枝优化，生成新的StreamGraph，提交到集群中运行。本发明可实现FlinkSQL同时运行多个SQL时，避免重复消费数据源数据的问题。