Block-based adaptive ROI for remote photoplethysmography

Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Multimedia tools and applications 2018-03, Vol.77 (6), p.6503-6529
Hauptverfasser: Po, Lai-Man, Feng, Litong, Li, Yuming, Xu, Xuyuan, Cheung, Terence Chun-Ho, Cheung, Kwok-Wai
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 6529
container_issue 6
container_start_page 6503
container_title Multimedia tools and applications
container_volume 77
creator Po, Lai-Man
Feng, Litong
Li, Yuming
Xu, Xuyuan
Cheung, Terence Chun-Ho
Cheung, Kwok-Wai
description Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI.
doi_str_mv 10.1007/s11042-017-4563-7
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2019864401</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2019864401</sourcerecordid><originalsourceid>FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</originalsourceid><addsrcrecordid>eNp1kEtLAzEUhYMoWKs_wN2A6-i9mUwys9SitVAoiK5DJo8-bJsxmQr996aM4Mq7OWdxzrnwEXKLcI8A8iEhAmcUUFJeiZLKMzLCSmYjGZ5nX9ZAZQV4Sa5S2gCgqBgfkfppG8wnbXVyttBWd_362xVvi1nhQyyi24XeFd0q9KHbun51TLuwjLpbHa_Jhdfb5G5-dUw-Xp7fJ690vpjOJo9zakoUPbW8YaWHxrVeGoFGZM-8s147YY0zsrZtPs8ZOg9WA4MamAejm7YRjS_H5G7Y7WL4OrjUq004xH1-qRhgUwvOAXMKh5SJIaXovOrieqfjUSGoEyA1AFIZkDoBUjJ32NBJObtfuvi3_H_pB_vCaTM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2019864401</pqid></control><display><type>article</type><title>Block-based adaptive ROI for remote photoplethysmography</title><source>SpringerNature Journals</source><creator>Po, Lai-Man ; Feng, Litong ; Li, Yuming ; Xu, Xuyuan ; Cheung, Terence Chun-Ho ; Cheung, Kwok-Wai</creator><creatorcontrib>Po, Lai-Man ; Feng, Litong ; Li, Yuming ; Xu, Xuyuan ; Cheung, Terence Chun-Ho ; Cheung, Kwok-Wai</creatorcontrib><description>Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI.</description><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-017-4563-7</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Clustering ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Heart rate ; Motional resistance ; Multimedia Information Systems ; Quality ; Remote monitoring ; Signal monitoring ; Signal quality ; Special Purpose and Application-Based Systems</subject><ispartof>Multimedia tools and applications, 2018-03, Vol.77 (6), p.6503-6529</ispartof><rights>Springer Science+Business Media New York 2017</rights><rights>Multimedia Tools and Applications is a copyright of Springer, (2017). All Rights Reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</citedby><cites>FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</cites><orcidid>0000-0002-6716-3520</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11042-017-4563-7$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11042-017-4563-7$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Po, Lai-Man</creatorcontrib><creatorcontrib>Feng, Litong</creatorcontrib><creatorcontrib>Li, Yuming</creatorcontrib><creatorcontrib>Xu, Xuyuan</creatorcontrib><creatorcontrib>Cheung, Terence Chun-Ho</creatorcontrib><creatorcontrib>Cheung, Kwok-Wai</creatorcontrib><title>Block-based adaptive ROI for remote photoplethysmography</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI.</description><subject>Clustering</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Heart rate</subject><subject>Motional resistance</subject><subject>Multimedia Information Systems</subject><subject>Quality</subject><subject>Remote monitoring</subject><subject>Signal monitoring</subject><subject>Signal quality</subject><subject>Special Purpose and Application-Based Systems</subject><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNp1kEtLAzEUhYMoWKs_wN2A6-i9mUwys9SitVAoiK5DJo8-bJsxmQr996aM4Mq7OWdxzrnwEXKLcI8A8iEhAmcUUFJeiZLKMzLCSmYjGZ5nX9ZAZQV4Sa5S2gCgqBgfkfppG8wnbXVyttBWd_362xVvi1nhQyyi24XeFd0q9KHbun51TLuwjLpbHa_Jhdfb5G5-dUw-Xp7fJ690vpjOJo9zakoUPbW8YaWHxrVeGoFGZM-8s147YY0zsrZtPs8ZOg9WA4MamAejm7YRjS_H5G7Y7WL4OrjUq004xH1-qRhgUwvOAXMKh5SJIaXovOrieqfjUSGoEyA1AFIZkDoBUjJ32NBJObtfuvi3_H_pB_vCaTM</recordid><startdate>20180301</startdate><enddate>20180301</enddate><creator>Po, Lai-Man</creator><creator>Feng, Litong</creator><creator>Li, Yuming</creator><creator>Xu, Xuyuan</creator><creator>Cheung, Terence Chun-Ho</creator><creator>Cheung, Kwok-Wai</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0002-6716-3520</orcidid></search><sort><creationdate>20180301</creationdate><title>Block-based adaptive ROI for remote photoplethysmography</title><author>Po, Lai-Man ; Feng, Litong ; Li, Yuming ; Xu, Xuyuan ; Cheung, Terence Chun-Ho ; Cheung, Kwok-Wai</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Clustering</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Heart rate</topic><topic>Motional resistance</topic><topic>Multimedia Information Systems</topic><topic>Quality</topic><topic>Remote monitoring</topic><topic>Signal monitoring</topic><topic>Signal quality</topic><topic>Special Purpose and Application-Based Systems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Po, Lai-Man</creatorcontrib><creatorcontrib>Feng, Litong</creatorcontrib><creatorcontrib>Li, Yuming</creatorcontrib><creatorcontrib>Xu, Xuyuan</creatorcontrib><creatorcontrib>Cheung, Terence Chun-Ho</creatorcontrib><creatorcontrib>Cheung, Kwok-Wai</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Access via ABI/INFORM (ProQuest)</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>One Business (ProQuest)</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Po, Lai-Man</au><au>Feng, Litong</au><au>Li, Yuming</au><au>Xu, Xuyuan</au><au>Cheung, Terence Chun-Ho</au><au>Cheung, Kwok-Wai</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Block-based adaptive ROI for remote photoplethysmography</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2018-03-01</date><risdate>2018</risdate><volume>77</volume><issue>6</issue><spage>6503</spage><epage>6529</epage><pages>6503-6529</pages><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-017-4563-7</doi><tpages>27</tpages><orcidid>https://orcid.org/0000-0002-6716-3520</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1380-7501
ispartof Multimedia tools and applications, 2018-03, Vol.77 (6), p.6503-6529
issn 1380-7501
1573-7721
language eng
recordid cdi_proquest_journals_2019864401
source SpringerNature Journals
subjects Clustering
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Heart rate
Motional resistance
Multimedia Information Systems
Quality
Remote monitoring
Signal monitoring
Signal quality
Special Purpose and Application-Based Systems
title Block-based adaptive ROI for remote photoplethysmography
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T01%3A24%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Block-based%20adaptive%20ROI%20for%20remote%20photoplethysmography&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Po,%20Lai-Man&rft.date=2018-03-01&rft.volume=77&rft.issue=6&rft.spage=6503&rft.epage=6529&rft.pages=6503-6529&rft.issn=1380-7501&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-017-4563-7&rft_dat=%3Cproquest_cross%3E2019864401%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2019864401&rft_id=info:pmid/&rfr_iscdi=true