Deep skin detection on low resolution grayscale images

•Facial skin detection is an important step in many applications, such as remote rPPG.•This method can detect skin pixels in low resolution grayscale face images.•A dataset is described and proposed in order to train a deep learning model.•A transfer learning approach is adopted and validated.•Quali...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Pattern recognition letters 2020-03, Vol.131, p.322-328
Hauptverfasser: Paracchini, Marco, Marcon, Marco, Villa, Federica, Tubaro, Stefano
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 328
container_issue
container_start_page 322
container_title Pattern recognition letters
container_volume 131
creator Paracchini, Marco
Marcon, Marco
Villa, Federica
Tubaro, Stefano
description •Facial skin detection is an important step in many applications, such as remote rPPG.•This method can detect skin pixels in low resolution grayscale face images.•A dataset is described and proposed in order to train a deep learning model.•A transfer learning approach is adopted and validated.•Qualitative and quantitative results are reported testing the method on different datasets. In this work we present a facial skin detection method, based on a deep learning architecture, that is able to precisely associate a skin label to each pixel of a given image depicting a face. This is an important preliminary step in many applications, such as remote photoplethysmography (rPPG) in which the hearth rate of a subject needs to be estimated analyzing a video of his/her face. The proposed method can detect skin pixels even in low resolution grayscale face images (64 × 32 pixel). A dataset is also described and proposed in order to train the deep learning model. Given the small amount of data available, a transfer learning approach is adopted and validated in order to learn to solve the skin detection problem exploiting a colorization network. Qualitative and quantitative results are reported testing the method on different datasets and in presence of general illumination, facial expressions, object occlusions and it is able to work regardless of the gender, age and ethnicity of the subject.
doi_str_mv 10.1016/j.patrec.2019.12.021
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2441888754</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0167865519303964</els_id><sourcerecordid>2441888754</sourcerecordid><originalsourceid>FETCH-LOGICAL-c380t-c5d202887eb4d90ec4477a8a39e22f188fb65e35c9b4f1704168b2a1e27ff96e3</originalsourceid><addsrcrecordid>eNp9kE9LxDAQxYMouK5-Aw8Fz61JmibpRZD1Lyx40XNI08mSWpuatMp-e7PWszAwMLz3ZuaH0CXBBcGEX3fFqKcApqCY1AWhBabkCK2IFDQXJWPHaJVkIpe8qk7RWYwdxpiXtVwhfgcwZvHdDVkLE5jJ-SFL1fvvLED0_fw72QW9j0b3kLkPvYN4jk6s7iNc_PU1enu4f9085duXx-fN7TY3pcRTbqqWYiqlgIa1NQbDmBBa6rIGSi2R0ja8grIydcMsEZgRLhuqCVBhbc2hXKOrJXcM_nOGOKnOz2FIKxVlLAVIUbGkYovKBB9jAKvGkO4Me0WwOhBSnVoIqQMhRahKhJLtZrFB-uDLQVDROBgMtC5JJ9V693_AD080cA8</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2441888754</pqid></control><display><type>article</type><title>Deep skin detection on low resolution grayscale images</title><source>Elsevier ScienceDirect Journals</source><creator>Paracchini, Marco ; Marcon, Marco ; Villa, Federica ; Tubaro, Stefano</creator><creatorcontrib>Paracchini, Marco ; Marcon, Marco ; Villa, Federica ; Tubaro, Stefano</creatorcontrib><description>•Facial skin detection is an important step in many applications, such as remote rPPG.•This method can detect skin pixels in low resolution grayscale face images.•A dataset is described and proposed in order to train a deep learning model.•A transfer learning approach is adopted and validated.•Qualitative and quantitative results are reported testing the method on different datasets. In this work we present a facial skin detection method, based on a deep learning architecture, that is able to precisely associate a skin label to each pixel of a given image depicting a face. This is an important preliminary step in many applications, such as remote photoplethysmography (rPPG) in which the hearth rate of a subject needs to be estimated analyzing a video of his/her face. The proposed method can detect skin pixels even in low resolution grayscale face images (64 × 32 pixel). A dataset is also described and proposed in order to train the deep learning model. Given the small amount of data available, a transfer learning approach is adopted and validated in order to learn to solve the skin detection problem exploiting a colorization network. Qualitative and quantitative results are reported testing the method on different datasets and in presence of general illumination, facial expressions, object occlusions and it is able to work regardless of the gender, age and ethnicity of the subject.</description><identifier>ISSN: 0167-8655</identifier><identifier>EISSN: 1872-7344</identifier><identifier>DOI: 10.1016/j.patrec.2019.12.021</identifier><language>eng</language><publisher>Amsterdam: Elsevier B.V</publisher><subject>CNN ; Datasets ; Deep learning ; Face ; Face recognition ; Gray scale ; Grayscale image ; Heart rate ; Image resolution ; Low resolution ; Machine learning ; Pixels ; Skin ; Skin detection ; Skin segmentation ; SPAD ; Transfer learning</subject><ispartof>Pattern recognition letters, 2020-03, Vol.131, p.322-328</ispartof><rights>2019</rights><rights>Copyright Elsevier Science Ltd. Mar 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c380t-c5d202887eb4d90ec4477a8a39e22f188fb65e35c9b4f1704168b2a1e27ff96e3</citedby><cites>FETCH-LOGICAL-c380t-c5d202887eb4d90ec4477a8a39e22f188fb65e35c9b4f1704168b2a1e27ff96e3</cites><orcidid>0000-0003-4040-5742</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://www.sciencedirect.com/science/article/pii/S0167865519303964$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,776,780,3536,27903,27904,65309</link.rule.ids></links><search><creatorcontrib>Paracchini, Marco</creatorcontrib><creatorcontrib>Marcon, Marco</creatorcontrib><creatorcontrib>Villa, Federica</creatorcontrib><creatorcontrib>Tubaro, Stefano</creatorcontrib><title>Deep skin detection on low resolution grayscale images</title><title>Pattern recognition letters</title><description>•Facial skin detection is an important step in many applications, such as remote rPPG.•This method can detect skin pixels in low resolution grayscale face images.•A dataset is described and proposed in order to train a deep learning model.•A transfer learning approach is adopted and validated.•Qualitative and quantitative results are reported testing the method on different datasets. In this work we present a facial skin detection method, based on a deep learning architecture, that is able to precisely associate a skin label to each pixel of a given image depicting a face. This is an important preliminary step in many applications, such as remote photoplethysmography (rPPG) in which the hearth rate of a subject needs to be estimated analyzing a video of his/her face. The proposed method can detect skin pixels even in low resolution grayscale face images (64 × 32 pixel). A dataset is also described and proposed in order to train the deep learning model. Given the small amount of data available, a transfer learning approach is adopted and validated in order to learn to solve the skin detection problem exploiting a colorization network. Qualitative and quantitative results are reported testing the method on different datasets and in presence of general illumination, facial expressions, object occlusions and it is able to work regardless of the gender, age and ethnicity of the subject.</description><subject>CNN</subject><subject>Datasets</subject><subject>Deep learning</subject><subject>Face</subject><subject>Face recognition</subject><subject>Gray scale</subject><subject>Grayscale image</subject><subject>Heart rate</subject><subject>Image resolution</subject><subject>Low resolution</subject><subject>Machine learning</subject><subject>Pixels</subject><subject>Skin</subject><subject>Skin detection</subject><subject>Skin segmentation</subject><subject>SPAD</subject><subject>Transfer learning</subject><issn>0167-8655</issn><issn>1872-7344</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><recordid>eNp9kE9LxDAQxYMouK5-Aw8Fz61JmibpRZD1Lyx40XNI08mSWpuatMp-e7PWszAwMLz3ZuaH0CXBBcGEX3fFqKcApqCY1AWhBabkCK2IFDQXJWPHaJVkIpe8qk7RWYwdxpiXtVwhfgcwZvHdDVkLE5jJ-SFL1fvvLED0_fw72QW9j0b3kLkPvYN4jk6s7iNc_PU1enu4f9085duXx-fN7TY3pcRTbqqWYiqlgIa1NQbDmBBa6rIGSi2R0ja8grIydcMsEZgRLhuqCVBhbc2hXKOrJXcM_nOGOKnOz2FIKxVlLAVIUbGkYovKBB9jAKvGkO4Me0WwOhBSnVoIqQMhRahKhJLtZrFB-uDLQVDROBgMtC5JJ9V693_AD080cA8</recordid><startdate>202003</startdate><enddate>202003</enddate><creator>Paracchini, Marco</creator><creator>Marcon, Marco</creator><creator>Villa, Federica</creator><creator>Tubaro, Stefano</creator><general>Elsevier B.V</general><general>Elsevier Science Ltd</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7TK</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0003-4040-5742</orcidid></search><sort><creationdate>202003</creationdate><title>Deep skin detection on low resolution grayscale images</title><author>Paracchini, Marco ; Marcon, Marco ; Villa, Federica ; Tubaro, Stefano</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c380t-c5d202887eb4d90ec4477a8a39e22f188fb65e35c9b4f1704168b2a1e27ff96e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>CNN</topic><topic>Datasets</topic><topic>Deep learning</topic><topic>Face</topic><topic>Face recognition</topic><topic>Gray scale</topic><topic>Grayscale image</topic><topic>Heart rate</topic><topic>Image resolution</topic><topic>Low resolution</topic><topic>Machine learning</topic><topic>Pixels</topic><topic>Skin</topic><topic>Skin detection</topic><topic>Skin segmentation</topic><topic>SPAD</topic><topic>Transfer learning</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Paracchini, Marco</creatorcontrib><creatorcontrib>Marcon, Marco</creatorcontrib><creatorcontrib>Villa, Federica</creatorcontrib><creatorcontrib>Tubaro, Stefano</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Neurosciences Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Pattern recognition letters</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Paracchini, Marco</au><au>Marcon, Marco</au><au>Villa, Federica</au><au>Tubaro, Stefano</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Deep skin detection on low resolution grayscale images</atitle><jtitle>Pattern recognition letters</jtitle><date>2020-03</date><risdate>2020</risdate><volume>131</volume><spage>322</spage><epage>328</epage><pages>322-328</pages><issn>0167-8655</issn><eissn>1872-7344</eissn><abstract>•Facial skin detection is an important step in many applications, such as remote rPPG.•This method can detect skin pixels in low resolution grayscale face images.•A dataset is described and proposed in order to train a deep learning model.•A transfer learning approach is adopted and validated.•Qualitative and quantitative results are reported testing the method on different datasets. In this work we present a facial skin detection method, based on a deep learning architecture, that is able to precisely associate a skin label to each pixel of a given image depicting a face. This is an important preliminary step in many applications, such as remote photoplethysmography (rPPG) in which the hearth rate of a subject needs to be estimated analyzing a video of his/her face. The proposed method can detect skin pixels even in low resolution grayscale face images (64 × 32 pixel). A dataset is also described and proposed in order to train the deep learning model. Given the small amount of data available, a transfer learning approach is adopted and validated in order to learn to solve the skin detection problem exploiting a colorization network. Qualitative and quantitative results are reported testing the method on different datasets and in presence of general illumination, facial expressions, object occlusions and it is able to work regardless of the gender, age and ethnicity of the subject.</abstract><cop>Amsterdam</cop><pub>Elsevier B.V</pub><doi>10.1016/j.patrec.2019.12.021</doi><tpages>7</tpages><orcidid>https://orcid.org/0000-0003-4040-5742</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0167-8655
ispartof Pattern recognition letters, 2020-03, Vol.131, p.322-328
issn 0167-8655
1872-7344
language eng
recordid cdi_proquest_journals_2441888754
source Elsevier ScienceDirect Journals
subjects CNN
Datasets
Deep learning
Face
Face recognition
Gray scale
Grayscale image
Heart rate
Image resolution
Low resolution
Machine learning
Pixels
Skin
Skin detection
Skin segmentation
SPAD
Transfer learning
title Deep skin detection on low resolution grayscale images
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-25T12%3A51%3A30IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Deep%20skin%20detection%20on%20low%20resolution%20grayscale%20images&rft.jtitle=Pattern%20recognition%20letters&rft.au=Paracchini,%20Marco&rft.date=2020-03&rft.volume=131&rft.spage=322&rft.epage=328&rft.pages=322-328&rft.issn=0167-8655&rft.eissn=1872-7344&rft_id=info:doi/10.1016/j.patrec.2019.12.021&rft_dat=%3Cproquest_cross%3E2441888754%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2441888754&rft_id=info:pmid/&rft_els_id=S0167865519303964&rfr_iscdi=true