Image generation model training method and device and style image generation method and device

The invention relates to an image generation model training method and device and a style image generation method and device, and the image generation model training method comprises the steps: carrying out the image-text feature alignment of each first sample image-text pair based on an image-text...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: GAO TINGTING, LI YAN, CUI SHUHAO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention relates to an image generation model training method and device and a style image generation method and device, and the image generation model training method comprises the steps: carrying out the image-text feature alignment of each first sample image-text pair based on an image-text alignment model, and extracting sample image features and sample text features; inputting the sample image features into a to-be-trained adaptation model for spatial adaptation mapping to obtain sample spatial adaptation features; inputting the sample text features and the sample space adaptation features into a text graph model for image generation processing to obtain a prediction style image; based on the predicted style image and the preset style image, training the to-be-trained adaptation model to obtain a spatial adaptation model; and constructing a style image generation model based on the image-text alignment model, the spatial adaptation model and the text graph model. According to the embodiment of the i