BigScience: A Case Study in the Social Construction of a Multilingual Large Language Model

The BigScience Workshop was a value-driven initiative that spanned one and half years of interdisciplinary research and culminated in the creation of ROOTS, a 1.6TB multilingual dataset that was used to train BLOOM, one of the largest multilingual language models to date. In addition to the technica...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2022-12
Hauptverfasser:	Akiki, Christopher, Pistilli, Giada, Mieskes, Margot, Gallé, Matthias, Wolf, Thomas, Ilić, Suzana, Jernite, Yacine
Format:	Artikel
Sprache:	eng
Schlagworte:	Datasets Interdisciplinary studies Large language models Multilingualism Workshops
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!