Computational graph optimization

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for optimizing execution of operations of a neural network. One of the methods includes obtaining data representing a graph characterizing a plurality of operations of a neural network, where each node of the graph characterizes an operation of the neural network and each edge of the graph characterizes a data dependency between the operations; processing data representing the graph using a graph embedding neural network to generate an embedding of the graph; and processing the embedding of the graph using a policy neural network to generate a respective task output for each of the plurality of optimization tasks, where, for each of a plurality of operations of the neural network, each task output includes a respective decision for the corresponding optimization task. 用于优化神经网络的操作的执行的方法、系统和装置，包括在计算机存储介质上编码的计算机程序。所述方法之一包括：获得表示表征神经网络的多个操作的图的数据，其中，所述图的每个节点表征所述神经网络的操作并且所述图的每个边表征所述操作之间的数据依赖性；使用图嵌入神经网络来处理表示所述图的数据以生成所述图