Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study

Teaching to improve student models (e.g., knowledge distillation) is an extensively studied methodology in LLMs. However, for humans, teaching improves not only students but also teachers, by fostering more rigorous and clear reasoning as well as knowledge building. We ask: Can LLMs also learn by te...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-11
Hauptverfasser:	Ning, Xuefei, Wang, Zifu, Li, Shiyao, Lin, Zinan, Yao, Peiran, Fu, Tianyu, Blaschko, Matthew B, Dai, Guohao, Yang, Huazhong, Wang, Yu
Format:	Artikel
Sprache:	eng
Schlagworte:	Distillation Feedback Learning Learning by teaching Students Teachers Teaching
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!