AI model calculation kernel scheduling method and device, equipment and storage medium
The invention discloses an AI model calculation kernel scheduling method, device and equipment and a storage medium, and the method comprises the steps: obtaining a calculation graph corresponding to an AI model, and determining an alternative implementation mode corresponding to each operator in th...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses an AI model calculation kernel scheduling method, device and equipment and a storage medium, and the method comprises the steps: obtaining a calculation graph corresponding to an AI model, and determining an alternative implementation mode corresponding to each operator in the calculation graph through employing a pre-trained operator selection model; generating a plurality of calculation core topological graphs according to the alternative implementation mode corresponding to each operator; sequentially obtaining a calculation core topological graph as a current topological graph, and determining an alternative scheduling strategy matched with the current topological graph by adopting a recursive retrieval algorithm according to the execution time required by the current topological graph under different core task scheduling strategies; after all the calculation core topological graphs are processed, alternative scheduling strategies matched with all the calculation core topological g |
---|