Toucan: Token-Aware Character Level Language Modeling

Character-level language models obviate the need for separately trained tokenizers, but efficiency suffers from longer sequence lengths. Learning to combine character representations into tokens has made training these models more efficient, but they still require decoding characters individually. W...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Fleshman, William, Van Durme, Benjamin
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computation and Language Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!