Neural network model training system and method

The invention relates to a neural network model training system and method. The system comprises a coordination device and a preset number of computation devices, wherein the coordination device is used for performing synchronous control on the computation devices according to the layers of a neural network model; each computation device is used for processing a node distributed to each computation device in the corresponding layer of the neural network model according to a training sequence of the neural network model and a training sample input to the neural network model under the synchronous control of the coordination device according to the layers of the neural network model, and sending data generated by node processing to a model storage device or the computation device which the next-layer node connected with the node of current device is located at until the training of the input training sample is ended. The neural network model training system and method provided by the invention solve the problem of scale limitation of the neural network model caused by limitation of a single physical device.