UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

Copious amounts of relevance judgments are necessary for the effective training and accurate evaluation of retrieval systems. Conventionally, these judgments are made by human assessors, rendering this process expensive and laborious. A recent study by Thomas et al. from Microsoft Bing suggested tha...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-06
Hauptverfasser:	Upadhyay, Shivani, Ronak Pradeep, Thakur, Nandan, Craswell, Nick, Lin, Jimmy
Format:	Artikel
Sprache:	eng
Schlagworte:	Large language models Machine learning Open source software Retrieval System effectiveness Toolkits
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!