Efficient LLM Comparative Assessment: a Product of Experts Framework for Pairwise Comparisons

LLM-as-a-judge approaches are a practical and effective way of assessing a range of text tasks. However, when using pairwise comparisons to rank a set of candidates, the computational cost scales quadratically with the number of candidates, which has practical limitations. This paper introduces a Pr...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Liusie, Adian, Raina, Vatsal, Fathullah, Yassir, Gales, Mark
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computation and Language
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!