Large Language Models Are Not Robust Multiple Choice Selectors

Multiple choice questions (MCQs) serve as a common yet important task format in the evaluation of large language models (LLMs). This work shows that modern LLMs are vulnerable to option position changes in MCQs due to their inherent "selection bias", namely, they prefer to select specific...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Zheng, Chujie, Zhou, Hao, Meng, Fandong, Zhou, Jie, Huang, Minlie
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computation and Language
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!