Spoofed replay attack detection by Multidimensional Fourier transform on facial micro-expression regions

Facial replay attacks have been a topic of interest in recent past due to the vulnerability of intrusive nature in biometric security systems. In order to build a robust biometric system many safeguard approaches have already been developed by the researchers to nullify spoofing activities like prin...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Signal processing. Image communication 2021-04, Vol.93, p.116164, Article 116164
Hauptverfasser: Karmakar, Dhiman, Sarkar, Rajib, Datta, Madhura
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 116164
container_title Signal processing. Image communication
container_volume 93
creator Karmakar, Dhiman
Sarkar, Rajib
Datta, Madhura
description Facial replay attacks have been a topic of interest in recent past due to the vulnerability of intrusive nature in biometric security systems. In order to build a robust biometric system many safeguard approaches have already been developed by the researchers to nullify spoofing activities like print and replay attacks. This paper proposes a comprehensive study on the application of Multidimensional Fourier transform to combat replay attacks. Since the higher frequency in Multidimensional Fourier transform contains the major feature variations, liveness of a face is mostly reflected in the high frequency spectrum. The spontaneous facial expressions like micro-expression(μE) carries the detailed inner facial variations. In this novel approach a modified high frequency descriptor is used for proper discrimination between a live and fake facial video streams. The descriptor in particular works efficiently for a change in facial μE. Inclusion of noise along with the feature variation is trivial in higher frequency spectrum. The method, therefore, during the pre-processing phase not only extracts the video frames with major μE changes but also filters out frames carrying any abrupt expression change (macro expression) or spike noise. The selected frame sequence are thereafter fed into the multi dimensional Fourier plane in order to detect the liveness. The experiment is performed on the self created dataset and also being tested on standard play back attack dataset. The result obtained by the proposed anti spoofing approach is satisfactory and verified to be statistically significant.
doi_str_mv 10.1016/j.image.2021.116164
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2508591748</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0923596521000199</els_id><sourcerecordid>2508591748</sourcerecordid><originalsourceid>FETCH-LOGICAL-c331t-346aa338f6fd0f8c3d3eccc299428c84fa3d6b9b54db8a1257d024f9fb4119283</originalsourceid><addsrcrecordid>eNp9kEtPwzAQhC0EEqXwC7hY4pzgVxL7wAFVFJCKOABny_GjOKRJsFNE_z0O4cxppd2Z1cwHwCVGOUa4vG5yv1NbmxNEcI5xiUt2BBaYVyIjZVUdgwUShGaFKItTcBZjgxAiDIkFeH8Z-t5ZA4MdWnWAahyV_oDGjlaPvu9gfYBP-3b0xu9sF9NGtXDd74O3AY5BddH1YQeT0Cnt023ndegz-z0EGyd5erxNI56DE6faaC_-5hK8re9eVw_Z5vn-cXW7yTSleMwoK5WilLvSGeS4poZarTURghGuOXOKmrIWdcFMzRUmRWVSEydczTAWhNMluJr_DqH_3Ns4yialTamjJAXihcAVm1R0VqWwMQbr5BASwnCQGMkJqWzkL1I5IZUz0uS6mV02FfhKBGTU3nbaGh8SLml6_6__B4Tvgjo</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2508591748</pqid></control><display><type>article</type><title>Spoofed replay attack detection by Multidimensional Fourier transform on facial micro-expression regions</title><source>Elsevier ScienceDirect Journals Complete - AutoHoldings</source><creator>Karmakar, Dhiman ; Sarkar, Rajib ; Datta, Madhura</creator><creatorcontrib>Karmakar, Dhiman ; Sarkar, Rajib ; Datta, Madhura</creatorcontrib><description>Facial replay attacks have been a topic of interest in recent past due to the vulnerability of intrusive nature in biometric security systems. In order to build a robust biometric system many safeguard approaches have already been developed by the researchers to nullify spoofing activities like print and replay attacks. This paper proposes a comprehensive study on the application of Multidimensional Fourier transform to combat replay attacks. Since the higher frequency in Multidimensional Fourier transform contains the major feature variations, liveness of a face is mostly reflected in the high frequency spectrum. The spontaneous facial expressions like micro-expression(μE) carries the detailed inner facial variations. In this novel approach a modified high frequency descriptor is used for proper discrimination between a live and fake facial video streams. The descriptor in particular works efficiently for a change in facial μE. Inclusion of noise along with the feature variation is trivial in higher frequency spectrum. The method, therefore, during the pre-processing phase not only extracts the video frames with major μE changes but also filters out frames carrying any abrupt expression change (macro expression) or spike noise. The selected frame sequence are thereafter fed into the multi dimensional Fourier plane in order to detect the liveness. The experiment is performed on the self created dataset and also being tested on standard play back attack dataset. The result obtained by the proposed anti spoofing approach is satisfactory and verified to be statistically significant.</description><identifier>ISSN: 0923-5965</identifier><identifier>EISSN: 1879-2677</identifier><identifier>DOI: 10.1016/j.image.2021.116164</identifier><language>eng</language><publisher>Amsterdam: Elsevier B.V</publisher><subject>Biometrics ; Datasets ; Facial spoofing ; Fourier transforms ; Frames (data processing) ; Frequency spectrum ; High frequencies ; Micro-expressions ; Multidimensional Fourier domain ; Replay attack ; Security systems ; Spoofing ; Video data</subject><ispartof>Signal processing. Image communication, 2021-04, Vol.93, p.116164, Article 116164</ispartof><rights>2021 Elsevier B.V.</rights><rights>Copyright Elsevier BV Apr 2021</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c331t-346aa338f6fd0f8c3d3eccc299428c84fa3d6b9b54db8a1257d024f9fb4119283</citedby><cites>FETCH-LOGICAL-c331t-346aa338f6fd0f8c3d3eccc299428c84fa3d6b9b54db8a1257d024f9fb4119283</cites><orcidid>0000-0002-8412-593X</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.image.2021.116164$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,778,782,3539,27907,27908,45978</link.rule.ids></links><search><creatorcontrib>Karmakar, Dhiman</creatorcontrib><creatorcontrib>Sarkar, Rajib</creatorcontrib><creatorcontrib>Datta, Madhura</creatorcontrib><title>Spoofed replay attack detection by Multidimensional Fourier transform on facial micro-expression regions</title><title>Signal processing. Image communication</title><description>Facial replay attacks have been a topic of interest in recent past due to the vulnerability of intrusive nature in biometric security systems. In order to build a robust biometric system many safeguard approaches have already been developed by the researchers to nullify spoofing activities like print and replay attacks. This paper proposes a comprehensive study on the application of Multidimensional Fourier transform to combat replay attacks. Since the higher frequency in Multidimensional Fourier transform contains the major feature variations, liveness of a face is mostly reflected in the high frequency spectrum. The spontaneous facial expressions like micro-expression(μE) carries the detailed inner facial variations. In this novel approach a modified high frequency descriptor is used for proper discrimination between a live and fake facial video streams. The descriptor in particular works efficiently for a change in facial μE. Inclusion of noise along with the feature variation is trivial in higher frequency spectrum. The method, therefore, during the pre-processing phase not only extracts the video frames with major μE changes but also filters out frames carrying any abrupt expression change (macro expression) or spike noise. The selected frame sequence are thereafter fed into the multi dimensional Fourier plane in order to detect the liveness. The experiment is performed on the self created dataset and also being tested on standard play back attack dataset. The result obtained by the proposed anti spoofing approach is satisfactory and verified to be statistically significant.</description><subject>Biometrics</subject><subject>Datasets</subject><subject>Facial spoofing</subject><subject>Fourier transforms</subject><subject>Frames (data processing)</subject><subject>Frequency spectrum</subject><subject>High frequencies</subject><subject>Micro-expressions</subject><subject>Multidimensional Fourier domain</subject><subject>Replay attack</subject><subject>Security systems</subject><subject>Spoofing</subject><subject>Video data</subject><issn>0923-5965</issn><issn>1879-2677</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><recordid>eNp9kEtPwzAQhC0EEqXwC7hY4pzgVxL7wAFVFJCKOABny_GjOKRJsFNE_z0O4cxppd2Z1cwHwCVGOUa4vG5yv1NbmxNEcI5xiUt2BBaYVyIjZVUdgwUShGaFKItTcBZjgxAiDIkFeH8Z-t5ZA4MdWnWAahyV_oDGjlaPvu9gfYBP-3b0xu9sF9NGtXDd74O3AY5BddH1YQeT0Cnt023ndegz-z0EGyd5erxNI56DE6faaC_-5hK8re9eVw_Z5vn-cXW7yTSleMwoK5WilLvSGeS4poZarTURghGuOXOKmrIWdcFMzRUmRWVSEydczTAWhNMluJr_DqH_3Ns4yialTamjJAXihcAVm1R0VqWwMQbr5BASwnCQGMkJqWzkL1I5IZUz0uS6mV02FfhKBGTU3nbaGh8SLml6_6__B4Tvgjo</recordid><startdate>202104</startdate><enddate>202104</enddate><creator>Karmakar, Dhiman</creator><creator>Sarkar, Rajib</creator><creator>Datta, Madhura</creator><general>Elsevier B.V</general><general>Elsevier BV</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-8412-593X</orcidid></search><sort><creationdate>202104</creationdate><title>Spoofed replay attack detection by Multidimensional Fourier transform on facial micro-expression regions</title><author>Karmakar, Dhiman ; Sarkar, Rajib ; Datta, Madhura</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c331t-346aa338f6fd0f8c3d3eccc299428c84fa3d6b9b54db8a1257d024f9fb4119283</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Biometrics</topic><topic>Datasets</topic><topic>Facial spoofing</topic><topic>Fourier transforms</topic><topic>Frames (data processing)</topic><topic>Frequency spectrum</topic><topic>High frequencies</topic><topic>Micro-expressions</topic><topic>Multidimensional Fourier domain</topic><topic>Replay attack</topic><topic>Security systems</topic><topic>Spoofing</topic><topic>Video data</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Karmakar, Dhiman</creatorcontrib><creatorcontrib>Sarkar, Rajib</creatorcontrib><creatorcontrib>Datta, Madhura</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Signal processing. Image communication</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Karmakar, Dhiman</au><au>Sarkar, Rajib</au><au>Datta, Madhura</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Spoofed replay attack detection by Multidimensional Fourier transform on facial micro-expression regions</atitle><jtitle>Signal processing. Image communication</jtitle><date>2021-04</date><risdate>2021</risdate><volume>93</volume><spage>116164</spage><pages>116164-</pages><artnum>116164</artnum><issn>0923-5965</issn><eissn>1879-2677</eissn><abstract>Facial replay attacks have been a topic of interest in recent past due to the vulnerability of intrusive nature in biometric security systems. In order to build a robust biometric system many safeguard approaches have already been developed by the researchers to nullify spoofing activities like print and replay attacks. This paper proposes a comprehensive study on the application of Multidimensional Fourier transform to combat replay attacks. Since the higher frequency in Multidimensional Fourier transform contains the major feature variations, liveness of a face is mostly reflected in the high frequency spectrum. The spontaneous facial expressions like micro-expression(μE) carries the detailed inner facial variations. In this novel approach a modified high frequency descriptor is used for proper discrimination between a live and fake facial video streams. The descriptor in particular works efficiently for a change in facial μE. Inclusion of noise along with the feature variation is trivial in higher frequency spectrum. The method, therefore, during the pre-processing phase not only extracts the video frames with major μE changes but also filters out frames carrying any abrupt expression change (macro expression) or spike noise. The selected frame sequence are thereafter fed into the multi dimensional Fourier plane in order to detect the liveness. The experiment is performed on the self created dataset and also being tested on standard play back attack dataset. The result obtained by the proposed anti spoofing approach is satisfactory and verified to be statistically significant.</abstract><cop>Amsterdam</cop><pub>Elsevier B.V</pub><doi>10.1016/j.image.2021.116164</doi><orcidid>https://orcid.org/0000-0002-8412-593X</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0923-5965
ispartof Signal processing. Image communication, 2021-04, Vol.93, p.116164, Article 116164
issn 0923-5965
1879-2677
language eng
recordid cdi_proquest_journals_2508591748
source Elsevier ScienceDirect Journals Complete - AutoHoldings
subjects Biometrics
Datasets
Facial spoofing
Fourier transforms
Frames (data processing)
Frequency spectrum
High frequencies
Micro-expressions
Multidimensional Fourier domain
Replay attack
Security systems
Spoofing
Video data
title Spoofed replay attack detection by Multidimensional Fourier transform on facial micro-expression regions
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-16T08%3A04%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Spoofed%20replay%20attack%20detection%20by%20Multidimensional%20Fourier%20transform%20on%20facial%20micro-expression%20regions&rft.jtitle=Signal%20processing.%20Image%20communication&rft.au=Karmakar,%20Dhiman&rft.date=2021-04&rft.volume=93&rft.spage=116164&rft.pages=116164-&rft.artnum=116164&rft.issn=0923-5965&rft.eissn=1879-2677&rft_id=info:doi/10.1016/j.image.2021.116164&rft_dat=%3Cproquest_cross%3E2508591748%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2508591748&rft_id=info:pmid/&rft_els_id=S0923596521000199&rfr_iscdi=true