Cosine Similarity Knowledge Distillation for Individual Class Information Transfer

Previous logits-based Knowledge Distillation (KD) have utilized predictions about multiple categories within each sample (i.e., class predictions) and have employed Kullback-Leibler (KL) divergence to reduce the discrepancy between the student and teacher predictions. Despite the proliferation of KD...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Ham, Gyeongdo, Kim, Seonghak, Lee, Suin, Lee, Jae-Hyeok, Kim, Daeshik
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computer Vision and Pattern Recognition
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!