Method, system and device for detecting psoriasis and eczema based on multi-modal data

The invention discloses a method, a system and a device for detecting psoriasis and eczema based on multi-modal data, which are deployed in an APP or Web mode, a real-time mode and a non-real-time mode are adopted, in the real-time mode, a user photographs and uploads the skin, and the system identifies the skin lesion range and type by using a target detection model to preliminarily judge whether the disease is psoriasis or eczema disease; in the non-real-time mode, an artificial intelligence content generation technology is utilized, a chat interface between a patient and the system is provided, the system automatically generates medical feature information of psoriasis and eczema in the complaint of a dermatosis person in the interaction process with the patient, the feature information is converted into cue words, the cue words are input into a text-to-image model, and the cue words are input into the text-to-image model. According to the method, multiple sample pictures of psoriasis/eczema are automatica