Diffusion image generation method and system based on retrieval and segmentation enhancement

The invention discloses a diffusion image generation method and system based on retrieval and segmentation enhancement, and the method comprises the steps: model construction, data set construction, model training and image generation. An external retrieval image and a semantic segmentation result of the external retrieval image are introduced in the process of generating the image through the text of the diffusion model, the description text input by a user and image vector fusion obtained through retrieval and semantic segmentation are combined, and the types of input information are enriched. The external retrieval image expands the semantics of the description text; structural understanding of the to-be-generated image is refined through component part disassembly formed by semantic segmentation. On the basis of understanding, the diffusion model is guided to generate images more accurately and diverse, the semantic consistency and visual quality of the generated images are improved, and images better mat