Inference service configuration method and device, electronic equipment and storage medium
The invention discloses an inference service configuration method and device, electronic equipment and a storage medium, and relates to the field of cloud computing; according to the specific implementation scheme, physical nodes of the reasoning service are configured in a cloud platform according...
Gespeichert in:
Hauptverfasser: | , , , , , |
---|---|
Format: | Patent |
Sprache: | chi ; eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | The invention discloses an inference service configuration method and device, electronic equipment and a storage medium, and relates to the field of cloud computing; according to the specific implementation scheme, physical nodes of the reasoning service are configured in a cloud platform according to a configuration request of the reasoning service including regional requirements and resource requirements, so that operation resources of the reasoning service can run in the physical nodes of the cloud platform, and the reasoning service is deployed in the cloud platform. Compared with two existing service configuration modes, the cloud platform-based reasoning service configuration mode has the advantages that on one hand, GPU resources of the preset cloud platform can be effectively utilized, and on the other hand, the application range of the cloud platform-based reasoning service configuration mode is greatly expanded by depending on configuration and release of the reasoning service on the cloud platform. |
---|