Pool of Experts: Realtime Querying Specialized Knowledge in Massive Neural Networks

In spite of the great success of deep learning technologies, training and delivery of a practically serviceable model is still a highly time-consuming process. Furthermore, a resulting model is usually too generic and heavyweight, and hence essentially goes through another expensive model compressio...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2021-07
Hauptverfasser:	Kim, Hakbin, Dong-Wan, Choi
Format:	Artikel
Sprache:	eng
Schlagworte:	Cognitive tasks Computer Science - Artificial Intelligence Computer Science - Databases Computer Science - Learning Deep learning Distillation Embedded systems Lightweight Machine learning Neural networks Real time Training
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!