Inference service configuration method and device, electronic equipment and storage medium

The invention discloses an inference service configuration method and device, electronic equipment and a storage medium, and relates to the field of cloud computing; according to the specific implementation scheme, physical nodes of the reasoning service are configured in a cloud platform according...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: ZHANG HENGHUA, LI ZHENGUO, HU ZAIBIN, LUO BAOTONG, LI PANPAN, HUANG KAIWEN
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses an inference service configuration method and device, electronic equipment and a storage medium, and relates to the field of cloud computing; according to the specific implementation scheme, physical nodes of the reasoning service are configured in a cloud platform according to a configuration request of the reasoning service including regional requirements and resource requirements, so that operation resources of the reasoning service can run in the physical nodes of the cloud platform, and the reasoning service is deployed in the cloud platform. Compared with two existing service configuration modes, the cloud platform-based reasoning service configuration mode has the advantages that on one hand, GPU resources of the preset cloud platform can be effectively utilized, and on the other hand, the application range of the cloud platform-based reasoning service configuration mode is greatly expanded by depending on configuration and release of the reasoning service on the cloud platform.