MIRACL : A Multilingual Retrieval Dataset Covering 18 Diverse Languages von Zhang, Xinyu, Thakur, Nandan, Ogundepo, Odunayo, Kamalloo, Ehsan, Alfonso-Hermelo, David, Li, Xiaoguang, Liu, Qun, Rezagholizadeh, Mehdi, Lin, Jimmy

Volltext

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems von Thakur, Nandan, Kazi, Suleman, Luo, Ge, Lin, Jimmy, Ahmad, Amin

Volltext bestellen

UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor von Upadhyay, Shivani, Pradeep, Ronak, Thakur, Nandan, Craswell, Nick, Lin, Jimmy

Volltext bestellen

Injecting Domain Adaptation with Learning-to-hash for Effective and Efficient Zero-shot Dense Retrieval von Thakur, Nandan, Reimers, Nils, Lin, Jimmy

Volltext bestellen

HAGRID: A Human-LLM Collaborative Dataset for Generative Information-Seeking with Attribution von Kamalloo, Ehsan, Jafari, Aref, Zhang, Xinyu, Thakur, Nandan, Lin, Jimmy

Volltext bestellen

SPRINT: A Unified Toolkit for Evaluating and Demystifying Zero-shot Neural Sparse Retrieval von Thakur, Nandan, Wang, Kexin, Gurevych, Iryna, Lin, Jimmy

Volltext bestellen

Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework von Pradeep, Ronak, Thakur, Nandan, Upadhyay, Shivani, Campos, Daniel, Craswell, Nick, Lin, Jimmy

Volltext bestellen

Systematic Evaluation of Neural Retrieval Models on the Touch\'e 2020 Argument Retrieval Subset of BEIR von Thakur, Nandan, Bonifacio, Luiz, Fröbe, Maik, Bondarenko, Alexander, Kamalloo, Ehsan, Potthast, Martin, Hagen, Matthias, Lin, Jimmy

Volltext bestellen

Ragnar\"ok: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track von Pradeep, Ronak, Thakur, Nandan, Sharifymoghaddam, Sahel, Zhang, Eric, Nguyen, Ryan, Campos, Daniel, Craswell, Nick, Lin, Jimmy

Volltext bestellen

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look von Upadhyay, Shivani, Pradeep, Ronak, Thakur, Nandan, Campos, Daniel, Craswell, Nick, Soboroff, Ian, Dang, Hoa Trang, Lin, Jimmy

Volltext bestellen

Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval von Thakur, Nandan, Ni, Jianmo, Ábrego, Gustavo Hernández, Wieting, John, Lin, Jimmy, Cer, Daniel

Volltext bestellen

GPL: Generative Pseudo Labeling for Unsupervised Domain Adaptation of Dense Retrieval von Wang, Kexin, Thakur, Nandan, Reimers, Nils, Gurevych, Iryna

Volltext bestellen

Resources for Brewing BEIR: Reproducible Reference Models and an Official Leaderboard von Kamalloo, Ehsan, Thakur, Nandan, Lassance, Carlos, Ma, Xueguang, Yang, Jheng-Hong, Lin, Jimmy

Volltext bestellen

Evaluating Embedding APIs for Information Retrieval von Kamalloo, Ehsan, Zhang, Xinyu, Ogundepo, Odunayo, Thakur, Nandan, Alfonso-Hermelo, David, Rezagholizadeh, Mehdi, Lin, Jimmy

Volltext bestellen

BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Models von Thakur, Nandan, Reimers, Nils, Rücklé, Andreas, Srivastava, Abhishek, Gurevych, Iryna

Volltext bestellen

Injecting Domain Adaptation with Learning-to-hash for Effective and Efficient Zero-shot Dense Retrieval von Thakur, Nandan, Reimers, Nils, Lin, Jimmy

Volltext

MIRAGE-Bench: Automatic Multilingual Benchmark Arena for Retrieval-Augmented Generation Systems von Thakur, Nandan, Suleman Kazi, Luo, Ge, Lin, Jimmy, Amin, Ahmad

Volltext

Augmented SBERT: Data Augmentation Method for Improving Bi-Encoders for Pairwise Sentence Scoring Tasks von Thakur, Nandan, Reimers, Nils, Daxenberger, Johannes, Gurevych, Iryna

Volltext bestellen

"Knowing When You Don't Know": A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation von Thakur, Nandan, Bonifacio, Luiz, Zhang, Xinyu, Ogundepo, Odunayo, Kamalloo, Ehsan, Alfonso-Hermelo, David, Li, Xiaoguang, Liu, Qun, Chen, Boxing, Rezagholizadeh, Mehdi, Lin, Jimmy

Volltext bestellen

UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor von Upadhyay, Shivani, Ronak Pradeep, Thakur, Nandan, Craswell, Nick, Lin, Jimmy

Volltext