RobBERT-2023: Keeping Dutch Language Models Up-To-Date at a Lower Cost Thanks to Model Conversion

Pre-training large transformer-based language models on gigantic corpora and later repurposing them as base models for finetuning on downstream tasks has proven instrumental to the recent advances in computational linguistics. However, the prohibitively high cost associated with pretraining often ha...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	Computational Linguistics in the Netherlands Journal 2024-03, Vol.13, p.193-203
Hauptverfasser:	Delobelle, Pieter, Remy, François
Format:	Artikel
Sprache:	eng
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!