Training a Vision Transformer from scratch in less than 24 hours with 1 GPU

Transformers have become central to recent advances in computer vision. However, training a vision Transformer (ViT) model from scratch can be resource intensive and time consuming. In this paper, we aim to explore approaches to reduce the training costs of ViT models. We introduce some algorithmic...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Irandoust, Saghar, Durand, Thibaut, Rakhmangulova, Yunduz, Zi, Wenjie, Hajimirsadeghi, Hossein
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computer Vision and Pattern Recognition
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!