APPARATUS AND METHOD OF MULTIMODAL CONTACTLESS VITAL SIGN MONITORING

A multimodal, contactless vital sign monitoring system is configured to perform the following operations. Images are received from a video capture device. An image of a subject is identified within the images. The image of the subject is segmented into a plurality of segments. A first analysis is performed on the plurality of segments to identify a color feature. A second analysis is performed of the plurality of segments to identify a motion feature. Using a combination of the color feature and the motion feature a plurality of vital signs for the subject are determined. The first analyzing and the second analyzing are performed in parallel. The plurality of vital signs include one or more of heart rate, respiration rate, oxygen saturation, heart rate variability, and atrial fibrillation.