Task processing method and device, electronic equipment and storage medium

The invention provides a task processing method, and relates to the technical field of artificial intelligence, in particular to the technical fields of distributed training, large model, pre-training and the like. According to the specific implementation scheme, in response to the fact that it is determined that an ith forward calculation task is executed and reverse input data of a second processing layer is received, a target calculation unit executes a reverse calculation task according to the reverse input data and a forward calculation result corresponding to the jth batch of reverse input data to obtain a reverse calculation result of the second processing layer, the target calculation unit is any calculation unit in the plurality of calculation units; and in response to determining that the execution of the K reverse calculation tasks of the second processing layer related to the current batch of training data is completed, the target calculation unit sends K batch reverse calculation results of the s