Comparing Rewinding and Fine-tuning in Neural Network Pruning

ICLR 2020 Many neural network pruning algorithms proceed in three steps: train the network to completion, remove unwanted structure to compress the network, and retrain the remaining structure to recover lost accuracy. The standard retraining technique, fine-tuning, trains the unpruned weights from...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Renda, Alex, Frankle, Jonathan, Carbin, Michael
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Learning Statistics - Machine Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!