Res-Tuning: A Flexible and Efficient Tuning Paradigm via Unbinding Tuner from Backbone

Parameter-efficient tuning has become a trend in transferring large-scale foundation models to downstream applications. Existing methods typically embed some light-weight tuners into the backbone, where both the design and the learning of the tuners are highly dependent on the base model. This work...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2023-10
Hauptverfasser:	Jiang, Zeyinzi, Mao, Chaojie, Huang, Ziyuan, Ao Ma, Lv, Yiliang, Shen, Yujun, Zhao, Deli, Zhou, Jingren
Format:	Artikel
Sprache:	eng
Schlagworte:	Back propagation Tuners Tuning Weight reduction
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!