Mixture-of-Skills: Learning to Optimize Data Usage for Fine-Tuning Large Language Models

Large language models (LLMs) are typically fine-tuned on diverse and extensive datasets sourced from various origins to develop a comprehensive range of skills, such as writing, reasoning, chatting, coding, and more. Each skill has unique characteristics, and these datasets are often heterogeneous a...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Wu, Minghao, Vu, Thuy-Trang, Qu, Lizhen, Haffari, Gholamreza
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computation and Language
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!