Interpreting Learned Feedback Patterns in Large Language Models

Reinforcement learning from human feedback (RLHF) is widely used to train large language models (LLMs). However, it is unclear whether LLMs accurately learn the underlying preferences in human feedback data. We coin the term \textit{Learned Feedback Pattern} (LFP) for patterns in an LLM's activ...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Marks, Luke, Abdullah, Amir, Neo, Clement, Arike, Rauno, Krueger, David, Torr, Philip, Barez, Fazl
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!