Minor SFT loss for LLM fine-tune to increase performance and reduce model deviation

Instruct LLM provide a paradigm used in large scale language model to align LLM to human preference. The paradigm contains supervised fine tuning and reinforce learning from human feedback. This paradigm is also used in downstream scenarios to adapt LLM to specific corpora and applications. Comparin...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-08
Hauptverfasser:	Xie, Shiming, Chen, Hong, Yu, Fred, Sun, Zeye, Wu, Xiuyu
Format:	Artikel
Sprache:	eng
Schlagworte:	Algorithms Human performance Large language models Machine learning
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!