LEARNING APPARATUS, LEARNING METHOD, AND NON-TRANSITORY COMPUTER-READABLE STORAGE MEDIUM

A learning apparatus comprises one or more hardware processors, and one or more memories storing one or more programs configured to be executed by the one or more hardware processors, the one or more programs including instructions for, performing learning of a second learning model having an arrangement that is at least partially the same as an arrangement of a first learning model by distillation learning using an output of the first learning model, and dynamically changing, during the learning of the second learning model, at least one of a parameter of the first learning model, the arrangement of the first learning model, a parameter of the second learning model, and the arrangement of the second learning model.