PROCESSING SEQUENCES USING CONVOLUTIONAL NEURAL NETWORKS

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating of generating a neural network output from an input sequence of audio data. One of the methods includes, for each of the inputs, providing a current input sequence that comprises the input and the inputs preceding the input in the input sequence to a convolutional subnetwork comprising a plurality of dilated convolutional neural network layers, wherein the convolutional subnetwork is configured to, for each of the plurality of inputs: receive the current input sequence for the input, and process the current input sequence to generate an alternative representation for the input; and providing the alternative representations to an output subnetwork, wherein the output subnetwork is configured to receive the alternative representations and to process the alternative representations to generate the neural network output. The method performs an audio data processing task.