Satellite-borne large model speculation decoding method and device based on pre-generated token

The invention discloses a satellite-borne large model speculation decoding method and device based on pre-generated tokens, and the method comprises the steps: 1) carrying out the offline pre-generation of next tokens of all tokens, and obtaining a pre-generated token dictionary pair; and 2) during...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	GONG LUQI, YING ZHIWEN, LI XIAOYUAN, JU RAN
Format:	Patent
Sprache:	chi ; eng
Schlagworte:	CALCULATING COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS COMPUTING COUNTING ELECTRIC DIGITAL DATA PROCESSING PHYSICS
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Schreiben Sie den ersten Kommentar!