Large model prompt learning method based on category attribute knowledge enhancement

The invention discloses a large model prompt learning method based on category attribute knowledge enhancement, and the method comprises the steps: obtaining an image recognition training data set, and generating a visual attribute set of each category through manual annotation or the use of ChatGPT...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: NIE CHANGRU, LUO HAONAN, LI TIANRUI, CHU JIELEI, LYU FENGMAO
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The invention discloses a large model prompt learning method based on category attribute knowledge enhancement, and the method comprises the steps: obtaining an image recognition training data set, and generating a visual attribute set of each category through manual annotation or the use of ChatGPT; generating an attribute perceptible prompt background through an attribute integration module; respectively putting the training images and the corresponding prompt sentences carrying the visual attribute information into an image encoder and a text encoder to obtain image features and text classification weights; performing comparative learning on the image features and the text classification weights, and updating parameters of an attribute integration module through comparative learning to obtain a trained attribute integration module; generating a most significant visual attribute set of each test category according to the category space of the test task; and loading a to-be-tested image and the visual attrib