Demand Layering for Real-Time DNN Inference with Minimized Memory Usage

When executing a deep neural network (DNN), its model parameters are loaded into GPU memory before execution, incurring a significant GPU memory burden. There are studies that reduce GPU memory usage by exploiting CPU memory as a swap device. However, this approach is not applicable in most embedded...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Ji, Mingoo, Yi, Saehanseul, Koo, Changjin, Ahn, Sol, Seo, Dongjoo, Dutt, Nikil, Kim, Jong-Chan
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!