Deep skin detection on low resolution grayscale images

•Facial skin detection is an important step in many applications, such as remote rPPG.•This method can detect skin pixels in low resolution grayscale face images.•A dataset is described and proposed in order to train a deep learning model.•A transfer learning approach is adopted and validated.•Quali...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Pattern recognition letters 2020-03, Vol.131, p.322-328
Hauptverfasser: Paracchini, Marco, Marcon, Marco, Villa, Federica, Tubaro, Stefano
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:•Facial skin detection is an important step in many applications, such as remote rPPG.•This method can detect skin pixels in low resolution grayscale face images.•A dataset is described and proposed in order to train a deep learning model.•A transfer learning approach is adopted and validated.•Qualitative and quantitative results are reported testing the method on different datasets. In this work we present a facial skin detection method, based on a deep learning architecture, that is able to precisely associate a skin label to each pixel of a given image depicting a face. This is an important preliminary step in many applications, such as remote photoplethysmography (rPPG) in which the hearth rate of a subject needs to be estimated analyzing a video of his/her face. The proposed method can detect skin pixels even in low resolution grayscale face images (64 × 32 pixel). A dataset is also described and proposed in order to train the deep learning model. Given the small amount of data available, a transfer learning approach is adopted and validated in order to learn to solve the skin detection problem exploiting a colorization network. Qualitative and quantitative results are reported testing the method on different datasets and in presence of general illumination, facial expressions, object occlusions and it is able to work regardless of the gender, age and ethnicity of the subject.
ISSN:0167-8655
1872-7344
DOI:10.1016/j.patrec.2019.12.021