Multi-model hot updating method and device

The invention provides a multi-model hot update method and device. The multi-model hot update method comprises the following steps: pre-defining a model service CRD resource and a CRD resource of an AI model; running an AI reasoning model service corresponding to the model service CRD resource; checking whether the AI reasoning model service runs normally or not; if yes, applying for CRD resources of the AI model through the AI reasoning model service; performing instantiation on CRD resources of the AI model to obtain an inference service instance; obtaining a target multi-model of a version to be updated and loading the target multi-model; and running the target multi-model in the reasoning service instance, and updating the template version in the reasoning service instance according to the target multi-model. Therefore, by implementing the implementation mode, operation and hot update of the multi-model service can be supported, and resource waste is reduced. 本申请提供一种多模型热更新方法及装置，该多模型热更新方法包括：预先定义模型服务CRD资源和A