MIXING TOKENS WITH SPECTRAL TRANSFORM

Transformer systems and methods of using such transformer systems including computer programs encoded on a computer storage medium, for performing a deep learning task on an input sequence to generate an encoded output. In one aspect, one of the transformer systems includes an encoder architecture b...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Lee-Thorp, James Patrick, Ainslie, Joshua Timothy, Ontañón, Santiago, Eckstein, Ilya
Format:	Patent
Sprache:	eng
Schlagworte:	CALCULATING COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!