Query Time Optimized Deep Learning Based Video Inference System

This is a project report about how we tune Focus[1], a video inference system that provides low cost and low latency, through two phases. In this report, we will decrease the query time by saving the middle layer output of the neural network. This is a trade-off strategy that involves using more spa...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-02
Hauptverfasser:	Shen, Mingren, Dong, Shuoxuan, He, Xiuyuan
Format:	Artikel
Sprache:	eng
Schlagworte:	Inference Neural networks
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!