Non-contact emotional state detection method and system for double video channels

The invention discloses a double-video-channel non-contact emotional state detection method. The method comprises the steps that RGB video images and thermal imaging video images of a to-be-detected user are acquired in real time at the same time in a multi-process mode; calibrating facial key points of the to-be-detected user in the RGB video image by using a video image processing tool; calibrating facial key points of the to-be-detected user in the thermal imaging video image by using the RGB facial key point data of the to-be-detected user and the correction parameters; according to the thermal imaging face key point data of the to-be-detected user, frame selection is carried out on the thermal imaging video image; according to the preset duration and the preset number, extracting temperature data corresponding to the thermal imaging face key area of the to-be-detected user; and performing feature extraction on the preprocessed temperature data by using a full convolutional neural network to obtain featur