Block-based adaptive ROI for remote photoplethysmography
Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to...
Gespeichert in:
Veröffentlicht in: | Multimedia tools and applications 2018-03, Vol.77 (6), p.6503-6529 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 6529 |
---|---|
container_issue | 6 |
container_start_page | 6503 |
container_title | Multimedia tools and applications |
container_volume | 77 |
creator | Po, Lai-Man Feng, Litong Li, Yuming Xu, Xuyuan Cheung, Terence Chun-Ho Cheung, Kwok-Wai |
description | Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI. |
doi_str_mv | 10.1007/s11042-017-4563-7 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2019864401</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2019864401</sourcerecordid><originalsourceid>FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</originalsourceid><addsrcrecordid>eNp1kEtLAzEUhYMoWKs_wN2A6-i9mUwys9SitVAoiK5DJo8-bJsxmQr996aM4Mq7OWdxzrnwEXKLcI8A8iEhAmcUUFJeiZLKMzLCSmYjGZ5nX9ZAZQV4Sa5S2gCgqBgfkfppG8wnbXVyttBWd_362xVvi1nhQyyi24XeFd0q9KHbun51TLuwjLpbHa_Jhdfb5G5-dUw-Xp7fJ690vpjOJo9zakoUPbW8YaWHxrVeGoFGZM-8s147YY0zsrZtPs8ZOg9WA4MamAejm7YRjS_H5G7Y7WL4OrjUq004xH1-qRhgUwvOAXMKh5SJIaXovOrieqfjUSGoEyA1AFIZkDoBUjJ32NBJObtfuvi3_H_pB_vCaTM</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2019864401</pqid></control><display><type>article</type><title>Block-based adaptive ROI for remote photoplethysmography</title><source>SpringerNature Journals</source><creator>Po, Lai-Man ; Feng, Litong ; Li, Yuming ; Xu, Xuyuan ; Cheung, Terence Chun-Ho ; Cheung, Kwok-Wai</creator><creatorcontrib>Po, Lai-Man ; Feng, Litong ; Li, Yuming ; Xu, Xuyuan ; Cheung, Terence Chun-Ho ; Cheung, Kwok-Wai</creatorcontrib><description>Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI.</description><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-017-4563-7</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Clustering ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Heart rate ; Motional resistance ; Multimedia Information Systems ; Quality ; Remote monitoring ; Signal monitoring ; Signal quality ; Special Purpose and Application-Based Systems</subject><ispartof>Multimedia tools and applications, 2018-03, Vol.77 (6), p.6503-6529</ispartof><rights>Springer Science+Business Media New York 2017</rights><rights>Multimedia Tools and Applications is a copyright of Springer, (2017). All Rights Reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</citedby><cites>FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</cites><orcidid>0000-0002-6716-3520</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11042-017-4563-7$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11042-017-4563-7$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Po, Lai-Man</creatorcontrib><creatorcontrib>Feng, Litong</creatorcontrib><creatorcontrib>Li, Yuming</creatorcontrib><creatorcontrib>Xu, Xuyuan</creatorcontrib><creatorcontrib>Cheung, Terence Chun-Ho</creatorcontrib><creatorcontrib>Cheung, Kwok-Wai</creatorcontrib><title>Block-based adaptive ROI for remote photoplethysmography</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI.</description><subject>Clustering</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Heart rate</subject><subject>Motional resistance</subject><subject>Multimedia Information Systems</subject><subject>Quality</subject><subject>Remote monitoring</subject><subject>Signal monitoring</subject><subject>Signal quality</subject><subject>Special Purpose and Application-Based Systems</subject><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNp1kEtLAzEUhYMoWKs_wN2A6-i9mUwys9SitVAoiK5DJo8-bJsxmQr996aM4Mq7OWdxzrnwEXKLcI8A8iEhAmcUUFJeiZLKMzLCSmYjGZ5nX9ZAZQV4Sa5S2gCgqBgfkfppG8wnbXVyttBWd_362xVvi1nhQyyi24XeFd0q9KHbun51TLuwjLpbHa_Jhdfb5G5-dUw-Xp7fJ690vpjOJo9zakoUPbW8YaWHxrVeGoFGZM-8s147YY0zsrZtPs8ZOg9WA4MamAejm7YRjS_H5G7Y7WL4OrjUq004xH1-qRhgUwvOAXMKh5SJIaXovOrieqfjUSGoEyA1AFIZkDoBUjJ32NBJObtfuvi3_H_pB_vCaTM</recordid><startdate>20180301</startdate><enddate>20180301</enddate><creator>Po, Lai-Man</creator><creator>Feng, Litong</creator><creator>Li, Yuming</creator><creator>Xu, Xuyuan</creator><creator>Cheung, Terence Chun-Ho</creator><creator>Cheung, Kwok-Wai</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0002-6716-3520</orcidid></search><sort><creationdate>20180301</creationdate><title>Block-based adaptive ROI for remote photoplethysmography</title><author>Po, Lai-Man ; Feng, Litong ; Li, Yuming ; Xu, Xuyuan ; Cheung, Terence Chun-Ho ; Cheung, Kwok-Wai</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c316t-d4923f09ebf7c61c6f092fedfae6dcec78dbbbbf421ef0da020802f0ca9b969f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Clustering</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Heart rate</topic><topic>Motional resistance</topic><topic>Multimedia Information Systems</topic><topic>Quality</topic><topic>Remote monitoring</topic><topic>Signal monitoring</topic><topic>Signal quality</topic><topic>Special Purpose and Application-Based Systems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Po, Lai-Man</creatorcontrib><creatorcontrib>Feng, Litong</creatorcontrib><creatorcontrib>Li, Yuming</creatorcontrib><creatorcontrib>Xu, Xuyuan</creatorcontrib><creatorcontrib>Cheung, Terence Chun-Ho</creatorcontrib><creatorcontrib>Cheung, Kwok-Wai</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Access via ABI/INFORM (ProQuest)</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>One Business (ProQuest)</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Po, Lai-Man</au><au>Feng, Litong</au><au>Li, Yuming</au><au>Xu, Xuyuan</au><au>Cheung, Terence Chun-Ho</au><au>Cheung, Kwok-Wai</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Block-based adaptive ROI for remote photoplethysmography</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2018-03-01</date><risdate>2018</risdate><volume>77</volume><issue>6</issue><spage>6503</spage><epage>6529</epage><pages>6503-6529</pages><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>Remote photoplethysmography (rPPG) can achieve contactless human vital signs monitoring, but its signal quality is limited by the remote operation nature. In practical applications, improving the rPPG signal quality becomes an essential task. As a remote imaging technique, rPPG utilizes a camera to capture a video of a skin area, especially the facial area, then focuses on a particular sub-area as the region of interest (ROI). In this paper, we investigated a novel adaptive ROI (AROI) approach for improving the rPPG signal quality. In this approach, block-based spatial-temporal division is performed on a captured face video. Based on these segmented video pipelines, the spatial-temporal quality distribution of the rPPG signals is estimated using a signal-to-noise ratio (SNR) feature. Afterwards, AROIs are calculated through mean-shift clustering and adaptive thresholding in SNR maps. As the AROI can be dynamically adjusted according to the spatial-temporal quality distribution of rPPG signals on the face, the quality of the final recovered rPPG signal is improved. The performance of the proposed AROI approach was evaluated with both still and moving subjects. Compared to conventional ROI methods for rPPG, the proposed AROI obtained a higher accuracy in heart rate measurement. And the state-of-the-art motion-resistant rPPG techniques can be effectively enhanced through being integrated with the AROI.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-017-4563-7</doi><tpages>27</tpages><orcidid>https://orcid.org/0000-0002-6716-3520</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1380-7501 |
ispartof | Multimedia tools and applications, 2018-03, Vol.77 (6), p.6503-6529 |
issn | 1380-7501 1573-7721 |
language | eng |
recordid | cdi_proquest_journals_2019864401 |
source | SpringerNature Journals |
subjects | Clustering Computer Communication Networks Computer Science Data Structures and Information Theory Heart rate Motional resistance Multimedia Information Systems Quality Remote monitoring Signal monitoring Signal quality Special Purpose and Application-Based Systems |
title | Block-based adaptive ROI for remote photoplethysmography |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T01%3A24%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Block-based%20adaptive%20ROI%20for%20remote%20photoplethysmography&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Po,%20Lai-Man&rft.date=2018-03-01&rft.volume=77&rft.issue=6&rft.spage=6503&rft.epage=6529&rft.pages=6503-6529&rft.issn=1380-7501&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-017-4563-7&rft_dat=%3Cproquest_cross%3E2019864401%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2019864401&rft_id=info:pmid/&rfr_iscdi=true |