ELAD: Explanation-Guided Large Language Models Active Distillation

The deployment and application of Large Language Models (LLMs) is hindered by their memory inefficiency, computational demands, and the high costs of API inferences. Traditional distillation methods, which transfer the capabilities of LLMs to smaller models, often fail to determine whether the knowl...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-02
Hauptverfasser:	Zhang, Yifei, Pan, Bo, Chen, Ling, Hu, Yuntong, Zhao, Liang
Format:	Artikel
Sprache:	eng
Schlagworte:	Annotations Computer Science - Artificial Intelligence Computer Science - Computation and Language Distillation Flaw detection Large language models Reasoning
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!