LEARNING APPARATUS, LEARNING METHOD, AND RECORDING MEDIUM

LEARNING APPARATUS, LEARNING METHOD, AND RECORDING MEDIUM

Teacher and student models output inference results for training data. A loss calculation unit calculates a total loss using at least one of (1) a loss obtained by multiplying a difference between a true value and a student model output by a weight increasing as a confidence of the teacher model out...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: ISHII, Asuka
Format: Patent
Sprache:eng
Schlagworte:
CALCULATING
COMPUTING
COUNTING
IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
PHYSICS
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:Teacher and student models output inference results for training data. A loss calculation unit calculates a total loss using at least one of (1) a loss obtained by multiplying a difference between a true value and a student model output by a weight increasing as a confidence of the teacher model output is lower, (2) a loss obtained by multiplying a difference between the true value and the student model output by a weight increasing as a difference between the true value and the teacher model output is greater, and (3) a loss obtained by multiplying a difference between the teacher and student model outputs by weights increasing as the difference between the teacher and student model outputs is greater and increasing as the difference between the true value and the teacher model output is smaller. An update part updates parameters of the student model based on the total loss.