SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning

We present SeaEval, a benchmark for multilingual foundation models. In addition to characterizing how these models understand and reason with natural language, we also investigate how well they comprehend cultural practices, nuances, and values. Alongside standard accuracy metrics, we investigate th...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-07
Hauptverfasser:	Wang, Bin, Liu, Zhengyuan, Huang, Xin, Jiao, Fangkai, Ding, Yang, Aw, AiTi, Chen, Nancy F
Format:	Artikel
Sprache:	eng
Schlagworte:	Bias Cultural factors Empirical analysis Investigations Launching pads Multilingualism Natural language processing Queries Reasoning Semantics
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!