SUPERMERGE: An Approach For Gradient-Based Model Merging

Large language models, such as ChatGPT, Claude, or LLaMA, are gigantic, monolithic, and possess the superpower to simultaneously support thousands of tasks. However, high-throughput applications often prefer smaller task-specific models because of their lower latency and cost. One challenge of using...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Yang, Haoyu, Zhang, Zheng, Sathe, Saket
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Artificial Intelligence Computer Science - Computation and Language
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!