Training task optimization system, training task optimization method and non-transitory computer readable medium for operating the same

A training task optimization system includes a processor. The processor is configured to receive training environment information of a training task. The training environment information at least carries information corresponding to training samples in the training task. The processor is configured to calculate a memory distribution for the training task based on memory factors, the training samples and a neural network, and select a mini-batch size that is fit to the memory distribution. In response to the training environment information, the processor is configured to output the mini-batch size for execution of the training task.