MULTI-LEVEL GRAPH PROGRAMMING INTERFACES FOR CONTROLLING IMAGE PROCESSING FLOW ON AI PROCESSING UNIT

A graph application programming interface (API) is used to control an image processing flow. A system receives graph API calls to add nodes to respective subgraphs. The system further receives a given graph API call to add a control flow node to a main graph. The given graph API call identifies the subgraphs as parameters. The main graph includes the control flow node connected to other nodes by edges that are directed and acyclic. A graph compiler compiles the main graph and the subgraphs into corresponding executable code. At runtime, a condition is evaluated before the subgraphs identified in the given graph API call are executed. One or more target devices execute the corresponding executable code to perform operations of an image processing pipeline while skipping execution of one or more of the subgraphs depending on the condition.