AI model calculation kernel scheduling method and device, equipment and storage medium

The invention discloses an AI model calculation kernel scheduling method, device and equipment and a storage medium, and the method comprises the steps: obtaining a calculation graph corresponding to an AI model, and determining an alternative implementation mode corresponding to each operator in th...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG YUZHOU, ZHU JIANGJUN, ZHANG YALIN, WANG FENGMING, HAN YANGYANG, LI XIANG
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses an AI model calculation kernel scheduling method, device and equipment and a storage medium, and the method comprises the steps: obtaining a calculation graph corresponding to an AI model, and determining an alternative implementation mode corresponding to each operator in the calculation graph through employing a pre-trained operator selection model; generating a plurality of calculation core topological graphs according to the alternative implementation mode corresponding to each operator; sequentially obtaining a calculation core topological graph as a current topological graph, and determining an alternative scheduling strategy matched with the current topological graph by adopting a recursive retrieval algorithm according to the execution time required by the current topological graph under different core task scheduling strategies; after all the calculation core topological graphs are processed, alternative scheduling strategies matched with all the calculation core topological g